Human Generated Data

Title

Untitled (attempts at shoeing a mule)
Date

1900s
People

Artist: American Steel & Wire Co.,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Robert H. Millett, 2.2002.3892

Human Generated Data

Title

Untitled (attempts at shoeing a mule)

People

Artist: American Steel & Wire Co.,

Date

1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Robert H. Millett, 2.2002.3892

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 99.2
Human 99.2
Person 98.7
Person 98.5
Person 98.4
Person 98.3
Animal 98
Mammal 98
Horse 98
Person 96.8
Person 96
Military 95.4
Military Uniform 95.4
Person 94.5
Person 93.4
Person 93.1
Person 89.7
Army 88.4
Armored 88.4
Person 85.1
Person 83
Person 80.8
Person 78.7
Soldier 73.9
Rodeo 70.9
Person 63.8
People 60.7
Person 60.1
Equestrian 57.4
Bull 57.1
Troop 55.9
Apparel 55.4
Clothing 55.4
Person 53.9

Clarifai
created on 2019-11-10

people 99.9
group 97.7
many 96.6
cavalry 96.3
group together 95.1
adult 94.6
military 94.5
man 94.2
mammal 87.8
war 87.2
soldier 87.1
woman 86.4
wear 86
child 82.4
leader 81
outfit 79.3
administration 77.5
uniform 76
several 73.4
seated 73

Imagga
created on 2019-11-10

horse 27.6
cowboy 21.8
camel 21.1
animal 20.9
mammal 20.2
horses 18.5
travel 17.6
sand 16
pen 14.7
people 14.5
kin 14.3
tourism 14
animals 13.9
sport 13.6
outdoors 13.4
wild 13.1
beach 12.7
silhouette 12.4
trainer 11.7
riding 11.7
enclosure 11.6
bull 11.5
water 11.3
summer 10.9
sunset 10.8
ride 10.7
male 10.6
safari 10.6
danger 10
vacation 9.8
wildlife 9.8
running 9.6
desert 9.3
evening 9.3
sky 8.9
landscape 8.9
jockey 8.9
sun 8.9
stallion 8.8
man 8.7
world 8.7
sea 8.6
black 8.4
ungulate 8.3
park 8.2
group 8.1
farm 8
game 8
bullring 7.9
bullfighting 7.9
holiday 7.9
blood 7.7
military 7.7
ocean 7.5
environment 7.4
speed 7.3
competition 7.3
freedom 7.3
tourist 7.2
recreation 7.2

Google
created on 2019-11-10

Photograph 96.5
Snapshot 86.2
Working animal 79.6
Photography 75.7
Stock photography 74.6
Horse trainer 69.5
Horse 69.5
Black-and-white 68.3
Adaptation 67
Camel 64.8
Pack animal 53.4
Horse racing 51

Microsoft
created on 2019-11-10

text 95.9
animal 94.5
person 87.2
black 77.5
rein 75.3
mammal 71.7
halter 70.9
bridle 69.1
horse supplies 67.7
animal sports 66.7
people 64
old 62.3
horse tack 62.2
working animal 61.4
mare 56.8
mule 56.1
bull 55
wrangler 53.9
saddle 53.7
equestrianism 52.7
stallion 51.9
horse 15.7
riding 11.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 19-31
Gender Male, 53%
Surprised 45.2%
Calm 53.3%
Angry 46.1%
Fear 45.1%
Happy 45%
Disgusted 45.1%
Sad 45.2%
Confused 45%

AWS Rekognition

Age 43-61
Gender Male, 52%
Angry 45.8%
Happy 45.7%
Surprised 45%
Calm 45.8%
Sad 52.4%
Confused 45.1%
Disgusted 45%
Fear 45.1%

AWS Rekognition

Age 30-46
Gender Male, 50.3%
Angry 49.9%
Calm 49.5%
Disgusted 49.6%
Surprised 49.5%
Confused 49.7%
Happy 49.5%
Sad 49.6%
Fear 49.7%

AWS Rekognition

Age 19-31
Gender Male, 50.5%
Angry 49.5%
Happy 49.5%
Fear 49.5%
Disgusted 49.5%
Calm 50.5%
Sad 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 51-69
Gender Male, 50.5%
Fear 49.5%
Surprised 49.5%
Happy 49.6%
Sad 49.5%
Calm 50.4%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.4%
Happy 49.5%
Angry 49.5%
Fear 49.7%
Surprised 49.5%
Calm 49.5%
Disgusted 49.5%
Sad 50.2%
Confused 49.5%

AWS Rekognition

Age 35-51
Gender Male, 50.4%
Surprised 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 50.5%
Fear 49.5%
Confused 49.5%
Happy 49.5%
Sad 49.5%

AWS Rekognition

Age 22-34
Gender Male, 54.6%
Angry 45%
Happy 45.1%
Calm 54.5%
Surprised 45.1%
Disgusted 45.2%
Fear 45%
Sad 45%
Confused 45.1%

AWS Rekognition

Age 46-64
Gender Male, 50.9%
Fear 45%
Happy 46.5%
Surprised 46%
Angry 45.1%
Sad 45%
Confused 45%
Calm 52.2%
Disgusted 45%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Disgusted 49.7%
Calm 50.2%
Sad 49.5%
Angry 49.6%
Happy 49.5%
Surprised 49.5%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 18-30
Gender Male, 50.4%
Angry 49.7%
Calm 49.6%
Disgusted 49.5%
Surprised 49.5%
Confused 49.5%
Happy 49.6%
Sad 49.6%
Fear 50%

AWS Rekognition

Age 28-44
Gender Male, 50.4%
Surprised 49.5%
Confused 49.5%
Calm 50.4%
Happy 49.5%
Angry 49.5%
Sad 49.5%
Fear 49.5%
Disgusted 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.5%
Fear 49.5%
Sad 50%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.9%
Surprised 49.5%
Angry 49.5%

AWS Rekognition

Age 31-47
Gender Male, 51.7%
Sad 46.4%
Angry 48.4%
Fear 45.3%
Disgusted 45.1%
Confused 45.2%
Calm 49.3%
Surprised 45.2%
Happy 45.2%

AWS Rekognition

Age 34-50
Gender Male, 50.3%
Angry 50.1%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 49.6%
Fear 49.6%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 22-34
Gender Male, 53%
Fear 45.1%
Surprised 45.8%
Happy 45.1%
Sad 45.4%
Calm 52.9%
Disgusted 45.1%
Confused 45.1%
Angry 45.6%

AWS Rekognition

Age 49-67
Gender Female, 50%
Disgusted 49.5%
Happy 49.5%
Angry 49.6%
Calm 49.7%
Surprised 49.5%
Sad 50.2%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 39-57
Gender Male, 50.3%
Confused 49.5%
Surprised 49.5%
Sad 49.6%
Fear 49.5%
Happy 49.5%
Angry 50.3%
Disgusted 49.6%
Calm 49.6%

Feature analysis

Amazon

Person 99.2%
Horse 98%