Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (four figures with two donkeys carrying a large barrel)

Date

c. 1880-c. 1889

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.2

Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (four figures with two donkeys carrying a large barrel)

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Date

c. 1880-c. 1889

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.2

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Horse 99.4
Mammal 99.4
Animal 99.4
Horse 99.4
Bull 92.2
Person 87.8
Human 87.8
Horse Cart 86.3
Transportation 86.3
Vehicle 86.3
Wagon 86.3
Person 83.3
Person 78
Ox 71.6
Cattle 71.6
Horse 71.4
Person 68.7

Clarifai
created on 2023-10-28

cavalry 99.9
people 99.9
mammal 98.9
seated 98.8
art 98.1
man 96.9
print 95.7
vintage 95.2
transportation system 94.9
adult 94.3
retro 94.2
wear 92.8
lid 91.8
old 91.5
cattle 91.4
cowboy 90.7
group 89
camel 88.9
child 88.5
military 87.9

Imagga
created on 2022-02-25

horse cart 100
cart 88.5
wagon 69.8
horse 69.8
carriage 45.3
wheeled vehicle 43.7
horses 39.9
animal 36.5
ride 22.3
vehicle 21.6
riding 20.5
farm 19.6
cowboy 18.2
saddle 18
jockey 17.7
equestrian 17.6
harness 17.3
animals 16.7
stallion 16.6
mammal 16.1
equine 15.7
brown 15.4
outdoors 14.9
sport 14.8
rider 14.7
travel 13.4
people 12.8
speed 11.9
competition 11.9
western 11.6
ranch 11.1
bridle 11
horseback 10.8
silhouette 10.8
tourism 10.7
country 10.5
outdoor 9.9
mare 9.8
rural 9.7
landscape 9.7
sun 9.7
running 9.6
wild 9.6
tourist 9.1
black 9
sunset 9
transportation 9
sky 8.9
mane 8.8
man 8.7
sand 8.7
grass 8.7
summer 8.4
active 8.1
team 8.1
support 8.1
male 7.8
mammals 7.8
pasture 7.7
race 7.6
journey 7.5
vacation 7.4
historic 7.3
history 7.2
architecture 7

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99.7
horse 99.6
animal 95.1
old 91.2
person 86.4
outdoor 85.4
black 67.1
cart 64.8
white 64.2
rein 63.5
mule 59.2
halter 58.5
bridle 56.1
horse supplies 51.3
horse tack 50.7
clothing 50
vintage 28.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 79.2%
Confused 11.1%
Sad 3.2%
Fear 1.7%
Angry 1.4%
Surprised 1.3%
Disgusted 1.3%
Happy 0.8%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Angry 26.5%
Calm 17.6%
Sad 14.6%
Surprised 12%
Disgusted 12%
Confused 11.4%
Fear 3.8%
Happy 2%

AWS Rekognition

Age 23-31
Gender Male, 95.9%
Sad 52.5%
Calm 27.3%
Fear 8.1%
Angry 4.1%
Happy 2.6%
Surprised 2.5%
Disgusted 1.8%
Confused 1.3%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Confused 99.4%
Sad 0.2%
Angry 0.2%
Calm 0.1%
Disgusted 0%
Surprised 0%
Fear 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Horse
Person
Horse 99.4%
Horse 99.4%
Horse 71.4%
Person 87.8%
Person 83.3%
Person 78%
Person 68.7%

Categories

Imagga

pets animals 93%
nature landscape 4.5%