Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2331
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2331

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Shorts 100
People 99
Person 96.5
Person 95.5
Person 95.5
Person 94.2
Person 92.9
Person 92.6
Person 91.1
Person 91
Person 87.8
Person 86.8
Outdoors 86.4
Person 84.3
Person 84.3
Plant 83.9
Tree 83.9
Person 80.2
Machine 79.8
Wheel 79.8
Face 79.4
Head 79.4
Person 77.6
Person 75.5
Person 75.3
Person 74.6
Nature 74.2
Person 74.1
Person 73.4
Person 73.2
Person 72.3
Person 71.9
Person 70.9
Hat 70.3
Person 67.8
Person 67.7
Person 67
Person 66.8
Person 66.8
Person 66.1
Person 65.5
Helmet 64.2
Person 63.3
Person 62.6
Person 62.4
Person 62
Person 61.8
Person 60.3
Person 59.8
Crowd 58
Summer 57.8
Bicycle 57.5
Transportation 57.5
Vehicle 57.5
Hula 57.2
Toy 57.2
Skirt 56.9
Person 56.6
Stilts 56
Slum 55.8
Cycling 55.6
Sport 55.6
Vegetation 55.5
Person 55

Clarifai
created on 2018-05-10

people 100
many 99.8
group 99.2
group together 98.8
adult 97.6
woman 94
crowd 94
vehicle 92.7
man 92.7
child 92.7
military 90
wear 89.5
facial expression 89
administration 88.4
recreation 86.7
spectator 85.3
war 84.6
street 83.6
biker 81.2
transportation system 80.4

Imagga
created on 2023-10-07

pedestrian 55.7
people 23.4
city 19.1
street 18.4
man 18.1
outdoors 16.9
travel 16.2
jinrikisha 15.8
architecture 15.6
park 14.8
person 14.8
male 14.2
cart 13.7
tourist 13.3
lifestyle 13
tree 12.9
men 12.9
clothing 12.8
military uniform 12.6
active 12.6
old 12.5
uniform 12.5
walking 12.3
adult 12.3
outdoor 12.2
building 12.1
road 11.7
tourism 11.5
wheelchair 11.1
transportation 10.8
horse 10.4
outside 10.3
sport 10
religion 9.8
activity 9.8
wagon 9.8
carriage 9.6
women 9.5
bicycle 9.3
holiday 9.3
stone 9.3
wheeled vehicle 9.1
riding 8.8
happy 8.8
buildings 8.5
leisure 8.3
historic 8.2
human 8.2
fall 8.1
history 8
day 7.8
black 7.8
bike 7.8
color 7.8
ride 7.8
summer 7.7
culture 7.7
sculpture 7.6
two 7.6
walk 7.6
statue 7.6
covering 7.5
girls 7.3
children 7.3
chair 7

Google
created on 2018-05-10

black and white 88.7
standing 76.6
history 72.6
monochrome photography 71
crowd 70.9
recreation 62.7
tree 62
monochrome 61.6
vehicle 57.3
pole 51.1

Microsoft
created on 2018-05-10

outdoor 99.7
person 99.6
group 94.6
people 88
standing 78.6
old 67.4
posing 60.6

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 14-22
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2.4%
Confused 1.6%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 6-16
Gender Female, 99.7%
Happy 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Sad 100%
Calm 7.7%
Fear 7.5%
Surprised 6.4%
Confused 2.1%
Happy 0.9%
Angry 0.8%
Disgusted 0.6%

AWS Rekognition

Age 4-12
Gender Male, 98%
Calm 72.2%
Sad 52%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Angry 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 7-17
Gender Male, 83.2%
Sad 99.7%
Calm 22.9%
Angry 6.7%
Surprised 6.7%
Fear 6%
Confused 1.5%
Disgusted 0.8%
Happy 0.2%

AWS Rekognition

Age 16-22
Gender Female, 60.8%
Confused 90.9%
Surprised 6.9%
Fear 6.3%
Calm 3%
Sad 2.7%
Angry 1.1%
Disgusted 1%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.3%
Confused 67.7%
Sad 59.1%
Surprised 6.3%
Fear 5.9%
Calm 2.7%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 92.2%
Surprised 6.7%
Fear 6%
Sad 4%
Happy 1.3%
Confused 0.5%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 51-59
Gender Female, 100%
Calm 98.6%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 98.3%
Calm 98.1%
Surprised 6.4%
Fear 6%
Sad 2.2%
Confused 0.4%
Disgusted 0.3%
Angry 0.3%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 91.9%
Surprised 6.6%
Fear 6.2%
Sad 2.5%
Confused 2.4%
Disgusted 1.6%
Angry 1.2%
Happy 0.3%

AWS Rekognition

Age 14-22
Gender Male, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2.3%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 16-24
Gender Female, 99.9%
Calm 28.2%
Angry 23.3%
Fear 21.9%
Sad 21.7%
Surprised 6.9%
Confused 4.9%
Disgusted 1.6%
Happy 0.7%

AWS Rekognition

Age 21-29
Gender Male, 97.5%
Sad 68.4%
Calm 42.1%
Disgusted 10.2%
Confused 7%
Surprised 7%
Fear 6.8%
Angry 3.3%
Happy 1.4%

AWS Rekognition

Age 11-19
Gender Female, 85.1%
Sad 100%
Fear 6.4%
Surprised 6.3%
Calm 4.4%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 11-19
Gender Male, 67.9%
Calm 84.7%
Sad 9.7%
Surprised 6.5%
Fear 6.3%
Angry 0.8%
Confused 0.8%
Happy 0.6%
Disgusted 0.5%

AWS Rekognition

Age 10-18
Gender Male, 99.2%
Sad 100%
Confused 9.5%
Fear 6.4%
Surprised 6.4%
Angry 4.5%
Calm 0.7%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Fear 91.3%
Sad 22.8%
Surprised 6.3%
Calm 3.2%
Confused 1.3%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 14-22
Gender Female, 99.9%
Sad 99.8%
Confused 14.4%
Fear 12.7%
Surprised 6.5%
Disgusted 0.6%
Angry 0.5%
Calm 0.5%
Happy 0.3%

AWS Rekognition

Age 6-12
Gender Male, 99.5%
Confused 68.4%
Sad 27.4%
Calm 9.4%
Surprised 6.5%
Fear 5.9%
Angry 1.6%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Happy 64.9%
Calm 22.4%
Surprised 7.5%
Fear 6.6%
Sad 3%
Disgusted 2.3%
Angry 1.9%
Confused 1.8%

AWS Rekognition

Age 36-44
Gender Female, 98.9%
Calm 88.6%
Surprised 6.4%
Fear 6.1%
Confused 5.1%
Sad 3.5%
Angry 1.3%
Disgusted 0.7%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Female, 97.2%
Happy 45.3%
Fear 19.3%
Disgusted 15.2%
Surprised 7.2%
Calm 6.1%
Confused 5.1%
Sad 4.8%
Angry 0.7%

AWS Rekognition

Age 23-31
Gender Female, 98.4%
Calm 92.8%
Surprised 6.6%
Fear 6.1%
Sad 3.6%
Happy 1.1%
Confused 0.5%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 28-38
Gender Female, 97.5%
Sad 99.9%
Angry 9.3%
Fear 8.5%
Surprised 6.6%
Disgusted 5.9%
Happy 2.1%
Confused 1.4%
Calm 1.4%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 69.8%
Sad 38.2%
Surprised 6.4%
Fear 6%
Confused 4.6%
Happy 1%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 18-24
Gender Female, 95.7%
Sad 99.5%
Disgusted 14.2%
Fear 8.6%
Surprised 8.1%
Calm 7.4%
Happy 2.4%
Angry 1.7%
Confused 1.1%

AWS Rekognition

Age 4-12
Gender Female, 74.1%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 0.3%
Calm 0.3%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 37-45
Gender Female, 100%
Sad 100%
Confused 9.6%
Surprised 6.3%
Fear 5.9%
Calm 2.3%
Disgusted 1.1%
Angry 0.5%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 98.8%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 1.4%
Confused 0.1%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Male, 97.6%
Calm 61.4%
Sad 17.6%
Confused 12.4%
Surprised 7.6%
Fear 6.7%
Disgusted 3.3%
Happy 1.6%
Angry 1%

AWS Rekognition

Age 12-20
Gender Female, 99.7%
Calm 53.1%
Surprised 44.7%
Fear 7.7%
Happy 4.2%
Sad 3.8%
Disgusted 2.2%
Confused 1.6%
Angry 1.5%

AWS Rekognition

Age 36-44
Gender Female, 83.9%
Calm 82.7%
Happy 14.7%
Surprised 6.9%
Fear 5.9%
Sad 2.3%
Confused 0.4%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Sad 95.7%
Surprised 21.6%
Angry 11.3%
Fear 10.8%
Confused 5.8%
Calm 5.4%
Disgusted 1.6%
Happy 1%

AWS Rekognition

Age 6-16
Gender Female, 99.4%
Angry 75.5%
Sad 13.3%
Fear 6.8%
Surprised 6.6%
Calm 3.5%
Confused 2.4%
Disgusted 1.4%
Happy 0.7%

AWS Rekognition

Age 22-30
Gender Female, 98.1%
Fear 72.5%
Calm 37.3%
Surprised 6.6%
Sad 2.9%
Happy 1.5%
Confused 1.2%
Disgusted 0.9%
Angry 0.5%

AWS Rekognition

Age 11-19
Gender Female, 78.1%
Sad 99.8%
Calm 24.4%
Fear 6.5%
Surprised 6.3%
Angry 1%
Confused 0.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Female, 93.8%
Sad 91%
Happy 48.5%
Fear 9%
Surprised 6.3%
Calm 1.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 16-22
Gender Female, 72.5%
Fear 73.6%
Sad 25.1%
Surprised 10.7%
Confused 6.9%
Happy 6.7%
Calm 2.2%
Disgusted 1.1%
Angry 0.7%

AWS Rekognition

Age 13-21
Gender Male, 94.2%
Calm 65%
Confused 25.2%
Fear 7.6%
Surprised 6.5%
Sad 3.3%
Angry 1.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Female, 99.5%
Fear 86.3%
Calm 14.6%
Surprised 8.7%
Happy 4.5%
Sad 3.6%
Confused 1.5%
Disgusted 1.4%
Angry 1.3%

AWS Rekognition

Age 23-31
Gender Female, 79.2%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 11-19
Gender Male, 99.5%
Calm 51.5%
Fear 31%
Angry 10.5%
Surprised 7%
Sad 3.1%
Happy 3%
Disgusted 0.8%
Confused 0.8%

AWS Rekognition

Age 11-19
Gender Female, 74.8%
Sad 99.7%
Angry 11.2%
Calm 8.5%
Surprised 7.3%
Fear 6.2%
Confused 5.9%
Disgusted 3.6%
Happy 1.2%

AWS Rekognition

Age 49-57
Gender Female, 98.8%
Happy 72.2%
Sad 26.5%
Surprised 6.6%
Fear 6.1%
Calm 4.2%
Angry 1.3%
Disgusted 1.1%
Confused 0.4%

AWS Rekognition

Age 16-24
Gender Male, 79.9%
Calm 48.6%
Angry 25.1%
Fear 13.4%
Surprised 7.1%
Confused 4%
Sad 3.8%
Happy 2.1%
Disgusted 0.9%

AWS Rekognition

Age 21-29
Gender Male, 97.5%
Sad 99.9%
Calm 18.3%
Surprised 6.7%
Fear 6.6%
Confused 2.2%
Angry 1%
Disgusted 0.9%
Happy 0.6%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 93.4%
Surprised 7.3%
Fear 5.9%
Confused 3.6%
Sad 2.2%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Male, 54.7%
Calm 80.7%
Fear 8.7%
Surprised 7.4%
Sad 5.9%
Confused 1.8%
Disgusted 0.6%
Happy 0.5%
Angry 0.4%

AWS Rekognition

Age 22-30
Gender Male, 86.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Disgusted 0%
Confused 0%
Calm 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 72%
Calm 79.3%
Angry 7.6%
Surprised 7.4%
Fear 6.4%
Disgusted 4%
Sad 3%
Happy 1.7%
Confused 1.7%

AWS Rekognition

Age 23-33
Gender Male, 67%
Calm 89.1%
Surprised 6.6%
Sad 6.3%
Fear 5.9%
Happy 1%
Confused 0.6%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 2-8
Gender Female, 99.8%
Sad 98.8%
Angry 25.1%
Fear 7.3%
Surprised 6.7%
Calm 5.6%
Happy 3.6%
Confused 3%
Disgusted 1%

AWS Rekognition

Age 1-7
Gender Female, 73.8%
Sad 99.9%
Confused 9.9%
Fear 6.7%
Surprised 6.7%
Calm 4.9%
Angry 2.1%
Disgusted 1.4%
Happy 0.8%

AWS Rekognition

Age 9-17
Gender Female, 82.4%
Confused 65%
Calm 16%
Sad 10.8%
Fear 8.1%
Surprised 6.5%
Angry 0.5%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 14-22
Gender Female, 88.6%
Sad 100%
Calm 8%
Surprised 6.6%
Fear 6.6%
Angry 0.8%
Disgusted 0.5%
Happy 0.4%
Confused 0.3%

AWS Rekognition

Age 19-27
Gender Female, 86.1%
Fear 97.4%
Surprised 6.4%
Sad 2.7%
Happy 1.1%
Calm 0.7%
Angry 0.4%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 18-24
Gender Male, 95.8%
Calm 75.8%
Sad 24.8%
Surprised 6.9%
Fear 6.2%
Happy 0.9%
Angry 0.9%
Confused 0.9%
Disgusted 0.4%

AWS Rekognition

Age 1-7
Gender Male, 99.2%
Calm 78.1%
Angry 18.9%
Surprised 6.4%
Fear 6%
Sad 2.7%
Happy 0.6%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 6-12
Gender Male, 98.4%
Sad 86.5%
Confused 37.5%
Fear 8.7%
Surprised 7.2%
Disgusted 6.5%
Calm 4.4%
Happy 2.2%
Angry 1.5%

AWS Rekognition

Age 23-33
Gender Male, 86.9%
Happy 90.4%
Calm 7.9%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.5%
Disgusted 0.4%
Confused 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Fear 47.7%
Calm 37.5%
Surprised 8.3%
Sad 5.1%
Disgusted 4.4%
Angry 3.4%
Happy 2.6%
Confused 2.3%

AWS Rekognition

Age 14-22
Gender Male, 86.2%
Sad 100%
Fear 7.7%
Surprised 6.4%
Calm 3.7%
Happy 0.5%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 18-24
Gender Female, 66.9%
Calm 86.5%
Surprised 6.5%
Fear 6.1%
Confused 4.8%
Disgusted 4.7%
Sad 2.5%
Happy 1.2%
Angry 0.9%

AWS Rekognition

Age 28-38
Gender Male, 70.8%
Sad 90.4%
Confused 33%
Surprised 14.2%
Fear 7.2%
Calm 5.1%
Disgusted 2%
Happy 1.9%
Angry 1.8%

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Feature analysis

Amazon

Person 96.5%
Wheel 79.8%
Helmet 64.2%