Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2337

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2337

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

People 99.9
Person 97.8
Boy 97.8
Child 97.8
Male 97.8
Person 97.1
Person 97
Adult 97
Bride 97
Female 97
Wedding 97
Woman 97
Person 96.7
Male 96.7
Adult 96.7
Man 96.7
Person 94.4
Male 94.4
Adult 94.4
Man 94.4
Person 94.1
Person 92.8
Person 92.1
Person 91.2
Person 90.9
Accessories 90.8
Person 90.5
Person 89.8
Person 88.3
Person 85.2
Person 84.6
Person 84.5
Person 84.1
Person 83.7
Adult 83.7
Bride 83.7
Female 83.7
Woman 83.7
Person 83.6
Face 83.1
Head 83.1
Person 82.2
Person 81.4
Glasses 73.2
Glasses 73.2
Glasses 72.2
Crowd 68
Clothing 64.1
Hat 64.1
Hat 58.4
Parade 57.7
Fashion 57.3
Carnival 56.9
Transportation 56.1
Vehicle 56.1
Stilts 56.1
Sunglasses 56.1
Skirt 56
Dress 55.7
Photography 55.4
Portrait 55.4
Costume 55.2

Clarifai
created on 2018-05-10

people 99.9
group 99.3
many 98.9
adult 98.8
group together 97.2
wear 96.8
woman 94
administration 93.2
military 93.1
vehicle 92.8
man 92.4
outfit 92.2
war 90.6
leader 90
veil 87.4
uniform 87.3
music 84.2
portrait 83.7
child 83.2
facial expression 82.5

Imagga
created on 2023-10-05

man 25.5
people 24
person 18.7
male 17.8
wheelchair 17.8
adult 16.9
horse 14.9
musical instrument 13.8
outdoors 13.8
sport 12.8
ride 12.7
outdoor 12.2
city 11.6
wind instrument 11.3
attractive 11.2
outside 11.1
chair 11
lifestyle 10.8
carriage 10.6
fashion 10.5
black 10.4
love 10.3
old 9.7
sexy 9.6
couple 9.6
seat 9.5
street 9.2
activity 8.9
posing 8.9
men 8.6
brass 8.6
portrait 8.4
summer 8.4
cart 8.1
women 7.9
urban 7.9
military 7.7
elegant 7.7
pretty 7.7
two 7.6
dark 7.5
human 7.5
leisure 7.5
help 7.4
active 7.4
life 7.4
animal 7.3
accordion 7.3
device 7.2
dress 7.2
transportation 7.2
vehicle 7.1
happiness 7
travel 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.7
tree 98.8
posing 92.3
group 91.4
person 86.4
people 65.5
white 63.8
lined 21.8
clothes 15.5
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-22
Gender Male, 99.8%
Calm 84.3%
Sad 10%
Surprised 6.3%
Fear 5.9%
Confused 3.3%
Angry 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Male, 94.2%
Sad 94.6%
Disgusted 25.8%
Confused 17%
Fear 7.5%
Surprised 7.1%
Calm 4%
Angry 0.6%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Male, 99.1%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Disgusted 0%
Happy 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 23-31
Gender Male, 96.9%
Sad 100%
Surprised 6.3%
Fear 6%
Confused 1.1%
Calm 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 74.6%
Calm 98.3%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%
Happy 0.2%

AWS Rekognition

Age 10-18
Gender Male, 100%
Calm 89.3%
Sad 9%
Surprised 6.3%
Fear 5.9%
Confused 0.1%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 19-27
Gender Male, 70.2%
Calm 97.1%
Surprised 6.8%
Fear 6%
Sad 2.2%
Angry 0.4%
Disgusted 0.3%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 20-28
Gender Female, 99.3%
Fear 82.1%
Angry 19.1%
Surprised 9.3%
Calm 5%
Sad 3.3%
Confused 2.4%
Disgusted 1.2%
Happy 0.5%

AWS Rekognition

Age 2-8
Gender Female, 75.1%
Sad 99.9%
Angry 11.9%
Fear 6.7%
Surprised 6.6%
Calm 5.1%
Confused 3.4%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 92.1%
Calm 92.4%
Surprised 6.3%
Fear 6.1%
Sad 5.2%
Confused 0.2%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 99%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Angry 0%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 25-35
Gender Male, 100%
Confused 46.9%
Disgusted 32.7%
Sad 8.8%
Surprised 7%
Fear 6.2%
Calm 5.1%
Happy 2.2%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Male, 97.8%
Calm 44.7%
Angry 34.3%
Surprised 11.2%
Fear 7.2%
Confused 6.1%
Sad 2.6%
Disgusted 2.4%
Happy 0.5%

AWS Rekognition

Age 22-30
Gender Female, 88.3%
Sad 72.4%
Calm 56.3%
Surprised 8%
Fear 7.1%
Happy 1.2%
Angry 1.1%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 6-14
Gender Female, 92.6%
Surprised 67.6%
Confused 33.7%
Calm 22.6%
Fear 5.9%
Sad 2.4%
Disgusted 2%
Angry 0.5%
Happy 0.4%

AWS Rekognition

Age 18-24
Gender Female, 74.6%
Fear 84%
Calm 20.1%
Surprised 8.2%
Sad 4.8%
Confused 2%
Happy 1.2%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 6-16
Gender Female, 72.9%
Calm 41.7%
Fear 24.6%
Surprised 8.4%
Disgusted 8.3%
Sad 8.2%
Angry 7.7%
Happy 2.7%
Confused 1.5%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Boy 97.8%
Child 97.8%
Male 97.8%
Adult 97%
Bride 97%
Female 97%
Woman 97%
Man 96.7%
Glasses 73.2%
Hat 64.1%
Sunglasses 56.1%