Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5079

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5079

Machine Generated Data

Tags

Amazon
created on 2023-10-05

People 100
Accessories 98.7
Sunglasses 98.7
Person 97.8
Adult 97.8
Bride 97.8
Female 97.8
Wedding 97.8
Woman 97.8
Person 97.6
Person 95.9
Adult 95.9
Bride 95.9
Female 95.9
Woman 95.9
Person 94.4
Adult 94.4
Male 94.4
Man 94.4
Person 93.8
Person 93.6
Person 90.6
Person 86.6
Person 85
Adult 85
Bride 85
Female 85
Woman 85
Person 84
Face 82
Head 82
Photography 81.5
Portrait 81.5
Person 80.7
Person 80.3
Person 79
Person 76.1
Person 74.6
Person 71.4
Person 70.6
Person 70.4
Person 69.4
Clothing 69
Hat 69
Furniture 64.1
Person 61.4
Crowd 57.9
Fashion 57.8
Chair 57.8
Parade 57.3
Costume 57.1
Plant 57
Tree 57
Vegetation 56.6
Bag 56.5
Skirt 56
Baseball 55.6
Baseball Glove 55.6
Glove 55.6
Sport 55.6
Machine 55.5
Wheel 55.5
Bridegroom 55.3
Musical Instrument 55.1
Land 55.1
Nature 55.1
Outdoors 55.1
Woodland 55.1

Clarifai
created on 2018-05-10

people 99.9
group 99.2
many 98.1
child 97.4
group together 97.2
adult 95.9
woman 95.1
man 93.6
wear 92.9
vehicle 91.6
portrait 90.5
military 89.8
transportation system 89.1
administration 88.5
recreation 86.6
family 83.7
war 82.8
several 82.7
boy 80.3
facial expression 80.2

Imagga
created on 2023-10-05

brass 37.9
wind instrument 29.6
cornet 21
man 20.8
musical instrument 20.3
mountain 18.2
sky 17.2
male 17
outdoor 16.8
snow 16.1
people 15
vehicle 15
sport 14.1
winter 13.6
old 12.5
person 12.1
transportation 11.6
outdoors 11.5
wheelchair 11.5
pedestrian 11.4
travel 10.5
adventure 10.4
landscape 10.4
cold 10.3
mountains 10.2
vacation 9.8
horse 9.7
action 9.3
adult 9
device 9
human 9
trees 8.9
extreme 8.6
summer 8.3
city 8.3
road 8.1
scenery 8.1
history 8
bugle 8
building 7.9
scenic 7.9
day 7.8
bike 7.8
season 7.8
outside 7.7
bicycle 7.7
frost 7.7
dirt 7.6
active 7.5
leisure 7.5
silhouette 7.4
vintage 7.4
street 7.4
backpack 7.3
black 7.3
lifestyle 7.2
recreation 7.2
activity 7.2
seat 7.1
architecture 7

Google
created on 2018-05-10

black and white 92.5
monochrome photography 78
history 70.3
monochrome 69.6
stock photography 62.4
artwork 56.4
tree 54.7

Microsoft
created on 2018-05-10

outdoor 98.4
posing 81.5
old 70.6
group 69.5
black 65
people 63.3
white 63
vintage 46.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 77.8%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Disgusted 0%
Happy 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Female, 84.7%
Calm 99.4%
Surprised 6.3%
Fear 6%
Sad 2.2%
Confused 0.1%
Disgusted 0.1%
Happy 0%
Angry 0%

AWS Rekognition

Age 23-31
Gender Male, 68.6%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 18-24
Gender Male, 99.7%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 9-17
Gender Male, 100%
Calm 93.8%
Surprised 6.3%
Fear 5.9%
Sad 4.7%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Female, 90.3%
Calm 95.9%
Surprised 6.3%
Fear 6%
Sad 3.5%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 7-17
Gender Male, 90.3%
Sad 81.1%
Calm 39.4%
Surprised 12.8%
Fear 7.9%
Happy 3.1%
Angry 3%
Disgusted 2%
Confused 1.6%

AWS Rekognition

Age 20-28
Gender Female, 96.2%
Fear 47.1%
Calm 34.7%
Surprised 27.1%
Confused 3%
Sad 2.4%
Disgusted 0.9%
Happy 0.6%
Angry 0.5%

AWS Rekognition

Age 22-30
Gender Male, 99.1%
Confused 50%
Calm 31.1%
Sad 15.4%
Surprised 6.8%
Fear 6%
Angry 1.3%
Disgusted 1.2%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Sad 38.8%
Confused 38.6%
Disgusted 26.1%
Calm 7.4%
Surprised 6.9%
Fear 6.2%
Happy 1.2%
Angry 1%

AWS Rekognition

Age 22-30
Gender Female, 56.5%
Sad 100%
Surprised 6.3%
Fear 6.1%
Confused 2.6%
Angry 1.4%
Calm 1.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 94.7%
Calm 89%
Surprised 6.4%
Fear 6.4%
Sad 4.2%
Confused 1.7%
Happy 1.4%
Angry 1%
Disgusted 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99%
Sad 79.9%
Confused 46%
Surprised 10.6%
Fear 6.8%
Angry 4.3%
Calm 2.5%
Disgusted 1.4%
Happy 0.4%

AWS Rekognition

Age 7-17
Gender Male, 63.4%
Calm 52.3%
Disgusted 34.7%
Surprised 10.4%
Fear 6.6%
Sad 2.6%
Confused 1.4%
Happy 1.1%
Angry 0.8%

AWS Rekognition

Age 16-24
Gender Female, 98.1%
Calm 84.8%
Fear 7.9%
Surprised 6.5%
Happy 5.3%
Sad 2.7%
Angry 2%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 19-27
Gender Female, 98.3%
Sad 94.1%
Calm 16.9%
Happy 14.7%
Fear 13.5%
Surprised 7%
Disgusted 3.8%
Angry 2.7%
Confused 0.6%

AWS Rekognition

Age 9-17
Gender Female, 51.8%
Calm 70.9%
Fear 16.8%
Surprised 7.4%
Happy 3.7%
Sad 2.7%
Angry 1.8%
Confused 1.5%
Disgusted 1%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 13
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Bride
Female
Woman
Male
Man
Person 97.8%
Person 97.6%
Person 95.9%
Person 94.4%
Person 93.8%
Person 93.6%
Person 90.6%
Person 86.6%
Person 85%
Person 84%
Person 80.7%
Person 80.3%
Person 79%
Person 76.1%
Person 74.6%
Person 71.4%
Person 70.6%
Person 70.4%
Person 69.4%
Person 61.4%
Adult 97.8%
Adult 95.9%
Adult 94.4%
Adult 85%
Bride 97.8%
Bride 95.9%
Bride 85%
Female 97.8%
Female 95.9%
Female 85%
Woman 97.8%
Woman 95.9%
Woman 85%
Male 94.4%
Man 94.4%