Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5073

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5073

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 99.9
Shorts 99.9
Person 96.6
Person 95.3
Architecture 93.8
Building 93.8
School 93.8
People 93.2
Outdoors 93
Person 92.6
Person 92.5
Person 91.6
Face 90.3
Head 90.3
Photography 90.3
Portrait 90.3
Person 89.3
Person 88.2
Person 87.6
Person 87.6
Person 86.9
Person 84.7
Person 83.7
Classroom 83.1
Indoors 83.1
Room 83.1
Nature 82.6
Person 82.5
Person 82.1
Person 81.6
Person 80.3
Person 80.2
Person 78.7
Person 77.3
Person 77.2
Person 76.7
Person 75.4
Person 74.5
Person 74.4
Person 69.8
Person 69.5
Person 68.5
Person 67.8
Countryside 67.4
Person 65.3
Person 64.4
Person 64.3
Person 63.5
Person 62.5
Person 62.2
Person 62
Person 61.6
Rural 57.5
Shelter 57.2
Hut 57.2
Hat 57.1
Person 56.9
Kindergarten 55.6

Clarifai
created on 2018-05-10

people 99.9
child 99.8
many 99.5
group 99.4
boy 98.1
group together 96.9
crowd 95.6
school 94.6
education 93.3
man 91.4
adult 90.5
woman 90.3
wear 87.7
war 86.8
uniform 85.7
family 83.2
portrait 82.1
military 80.9
son 79.9
elementary school 79.2

Imagga
created on 2023-10-07

percussion instrument 32.5
military uniform 32.2
uniform 31.4
steel drum 28.8
musical instrument 28.4
people 25.6
clothing 24.1
man 22.8
group 16.1
male 15.6
outfit 14.7
consumer goods 14.5
winter 14.5
walking 14.2
private 14
snow 13.8
old 13.2
men 12.9
covering 12.8
city 12.5
walk 12.4
adult 11.8
teamwork 11.1
street 11
person 10.9
helmet 10.8
silhouette 10.7
war 10.6
together 10.5
urban 10.5
outdoors 10.4
women 10.3
girls 10
outdoor 9.9
marimba 9.9
fun 9.7
business 9.7
sport 9.2
businessman 8.8
couple 8.7
crowd 8.6
cold 8.6
architecture 8.6
child 8.4
active 8.1
team 8.1
lifestyle 7.9
grass 7.9
holiday 7.9
black 7.8
army 7.8
travel 7.7
military 7.7
sky 7.6
two 7.6
happy 7.5
historic 7.3
history 7.1
mountain 7.1
day 7.1
happiness 7
season 7

Google
created on 2018-05-10

people 96.5
photograph 95.5
social group 89.9
black and white 85.5
history 80.1
standing 80
monochrome photography 65.6
monochrome 61.2
recreation 60.8
family 58.6
tree 57.9
crowd 57.4

Microsoft
created on 2018-05-10

outdoor 96.4
person 91.4
group 90.9
people 84.3
standing 79.8
old 69.1
posing 66.8
clothes 18

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Sad 99.7%
Calm 31%
Surprised 6.3%
Fear 5.9%
Confused 0.9%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 6-14
Gender Male, 99.5%
Sad 75.6%
Calm 63.8%
Surprised 6.3%
Fear 5.9%
Confused 0.7%
Angry 0.4%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 41-49
Gender Female, 100%
Calm 91.1%
Surprised 6.4%
Fear 5.9%
Sad 5%
Confused 0.8%
Angry 0.7%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 24-34
Gender Male, 100%
Sad 70.2%
Calm 64%
Surprised 6.4%
Fear 5.9%
Confused 2.2%
Disgusted 0.4%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Male, 90.8%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 3.2%
Confused 0.4%
Disgusted 0.3%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Female, 57.6%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 0.7%
Angry 0.5%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Male, 92.4%
Sad 99.7%
Surprised 47.6%
Fear 6%
Confused 1.4%
Disgusted 0.3%
Happy 0.2%
Angry 0.2%
Calm 0%

AWS Rekognition

Age 13-21
Gender Female, 99.1%
Sad 68.7%
Calm 59.6%
Fear 6.5%
Surprised 6.3%
Confused 4.3%
Angry 1.7%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Female, 69.8%
Sad 100%
Surprised 6.4%
Fear 6%
Calm 0.8%
Angry 0.4%
Confused 0.3%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 4-12
Gender Male, 95.4%
Sad 78.3%
Surprised 46.4%
Calm 29.1%
Fear 6%
Disgusted 2.5%
Confused 1.5%
Angry 0.6%
Happy 0.5%

AWS Rekognition

Age 18-26
Gender Male, 90.5%
Sad 99.3%
Calm 26.3%
Surprised 7.7%
Confused 7.7%
Fear 6%
Disgusted 0.7%
Angry 0.6%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 94%
Disgusted 66.8%
Sad 14.3%
Angry 10.3%
Surprised 6.9%
Fear 6.2%
Confused 3.2%
Happy 2.3%
Calm 1.2%

AWS Rekognition

Age 18-26
Gender Female, 92.6%
Sad 96.1%
Calm 22%
Confused 18.8%
Surprised 7.9%
Fear 6.3%
Angry 4.7%
Disgusted 1.1%
Happy 0.3%

AWS Rekognition

Age 4-12
Gender Female, 54.5%
Sad 80%
Calm 62.6%
Surprised 6.3%
Fear 5.9%
Confused 0.5%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-12
Gender Female, 96.6%
Sad 100%
Surprised 6.3%
Fear 6%
Angry 0.6%
Confused 0.6%
Calm 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 6-16
Gender Female, 74.8%
Calm 72.2%
Sad 41.7%
Surprised 6.7%
Fear 6%
Confused 0.8%
Happy 0.7%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 16-24
Gender Male, 97.9%
Calm 75.4%
Surprised 14.2%
Confused 8.4%
Fear 6.2%
Sad 3%
Disgusted 1.1%
Angry 0.8%
Happy 0.4%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Sad 99.9%
Calm 20.9%
Surprised 7.2%
Fear 6%
Confused 2.8%
Disgusted 0.7%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Male, 96.1%
Sad 100%
Calm 11%
Surprised 6.7%
Fear 6%
Confused 4.9%
Angry 0.5%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 14-22
Gender Female, 64.8%
Sad 100%
Fear 6.7%
Surprised 6.3%
Calm 0.9%
Angry 0.7%
Confused 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 71.7%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.8%
Confused 0.2%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 94.9%
Sad 92.9%
Calm 38.8%
Confused 7.4%
Surprised 6.6%
Fear 6.3%
Angry 5.1%
Disgusted 1.9%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 97.4%
Sad 100%
Surprised 6.4%
Fear 6%
Happy 2.5%
Calm 2%
Confused 1%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 96.5%
Surprised 6.5%
Fear 5.9%
Sad 2.9%
Confused 0.6%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 33-41
Gender Female, 89.6%
Sad 100%
Surprised 6.9%
Fear 5.9%
Confused 5.5%
Calm 3.9%
Disgusted 1.4%
Angry 0.5%
Happy 0.2%

AWS Rekognition

Age 19-27
Gender Female, 51.5%
Calm 82.2%
Sad 11.8%
Fear 6.6%
Surprised 6.4%
Confused 1.4%
Disgusted 0.9%
Angry 0.5%
Happy 0.3%

AWS Rekognition

Age 64-74
Gender Male, 75.5%
Sad 100%
Surprised 6.3%
Fear 5.9%
Angry 0.9%
Calm 0.6%
Confused 0.3%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 1-7
Gender Female, 84.3%
Surprised 99.5%
Fear 6.1%
Sad 3%
Calm 1.6%
Confused 1%
Happy 1%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 34-42
Gender Female, 86%
Confused 94.3%
Surprised 6.6%
Fear 6%
Sad 2.9%
Calm 2%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 6-12
Gender Female, 94%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 1.8%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 4-12
Gender Male, 83.3%
Sad 75.2%
Calm 48.1%
Angry 9.4%
Surprised 7%
Fear 6.9%
Confused 2.2%
Happy 0.9%
Disgusted 0.9%

AWS Rekognition

Age 18-24
Gender Female, 78.5%
Fear 63.9%
Calm 29.9%
Surprised 13.9%
Angry 4.2%
Sad 2.7%
Happy 1.7%
Disgusted 1.3%
Confused 1.3%

AWS Rekognition

Age 36-44
Gender Female, 81.5%
Calm 69.6%
Angry 15.5%
Sad 9.1%
Surprised 6.7%
Fear 6.1%
Happy 1.8%
Confused 0.5%
Disgusted 0.5%

AWS Rekognition

Age 26-36
Gender Female, 99.6%
Sad 100%
Surprised 6.7%
Fear 6.4%
Calm 3.5%
Confused 1.5%
Happy 0.9%
Disgusted 0.5%
Angry 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Sad 100%
Calm 9.9%
Surprised 6.3%
Fear 5.9%
Confused 3.8%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Male, 91.9%
Sad 78.8%
Calm 59.9%
Surprised 6.3%
Fear 5.9%
Happy 1.6%
Confused 1.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 51-59
Gender Male, 94.4%
Sad 56.4%
Calm 50.8%
Fear 8.2%
Happy 7.2%
Surprised 7%
Disgusted 2.4%
Confused 2.3%
Angry 2%

AWS Rekognition

Age 18-24
Gender Male, 98.9%
Calm 82%
Sad 9.2%
Surprised 6.5%
Fear 6%
Confused 3.2%
Happy 1.4%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 16-24
Gender Female, 65.2%
Sad 99.6%
Surprised 10.2%
Calm 9.9%
Confused 9%
Fear 6.6%
Angry 4%
Disgusted 2.3%
Happy 1.6%

AWS Rekognition

Age 42-50
Gender Female, 54.6%
Sad 55.8%
Calm 52.7%
Happy 9.1%
Surprised 7.7%
Fear 6.1%
Angry 4.2%
Confused 1.6%
Disgusted 0.6%

AWS Rekognition

Age 24-34
Gender Female, 62.2%
Sad 99.1%
Fear 22.2%
Calm 15.6%
Surprised 6.4%
Disgusted 0.6%
Confused 0.6%
Angry 0.5%
Happy 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99.1%
Sad 88.4%
Calm 45.1%
Surprised 9%
Fear 6.4%
Confused 5.3%
Disgusted 1%
Happy 1%
Angry 0.7%

AWS Rekognition

Age 23-33
Gender Male, 95.5%
Calm 25.4%
Fear 22.4%
Surprised 18.2%
Angry 17.9%
Disgusted 5.8%
Sad 5.4%
Happy 5.1%
Confused 2.3%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Calm 82.3%
Surprised 7.9%
Fear 7.6%
Sad 3.2%
Happy 2.6%
Confused 2.4%
Disgusted 2%
Angry 0.8%

AWS Rekognition

Age 14-22
Gender Female, 79.8%
Calm 42.4%
Sad 39.5%
Angry 24.1%
Surprised 6.8%
Fear 6.6%
Disgusted 3.7%
Happy 1.8%
Confused 1.3%

AWS Rekognition

Age 23-31
Gender Female, 98.3%
Sad 99.8%
Confused 12.3%
Calm 8.9%
Surprised 7.6%
Fear 6.7%
Disgusted 2%
Happy 0.6%
Angry 0.4%

AWS Rekognition

Age 19-27
Gender Male, 97.9%
Calm 83%
Happy 7.6%
Surprised 7.6%
Fear 6.1%
Sad 3.7%
Angry 1.2%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 94%
Surprised 6.3%
Fear 5.9%
Sad 4.7%
Confused 0.2%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 4-10
Gender Male, 98.7%
Fear 79.9%
Calm 12.5%
Sad 9%
Happy 8.1%
Surprised 6.6%
Angry 2.9%
Confused 2.2%
Disgusted 1.1%

AWS Rekognition

Age 18-26
Gender Female, 75.2%
Happy 96.2%
Surprised 6.4%
Fear 6.1%
Sad 2.7%
Calm 0.8%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Feature analysis

Amazon

Person 96.6%