Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1642
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1642

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.6
Shorts 99.6
Coat 99
Face 98.8
Head 98.8
Photography 98.8
Portrait 98.8
Person 98.4
Child 98.4
Female 98.4
Girl 98.4
People 98.3
Person 97.8
Child 97.8
Boy 97.8
Male 97.8
Person 97.5
Person 97.2
Child 97.2
Female 97.2
Girl 97.2
Person 97.2
Person 95.1
Person 94.8
Person 94.7
Child 94.7
Female 94.7
Girl 94.7
Person 94.5
Person 93.7
Person 93.4
Child 93.4
Boy 93.4
Male 93.4
Person 92.7
Hat 91.1
Person 90.5
Outdoors 88.5
Person 88
Person 84.9
Footwear 80.1
Shoe 80.1
Person 78
Nature 77.5
Shoe 77.1
Dress 75
Person 74.9
Plant 71.3
Tree 71.3
Shoe 65.4
Person 64.1
Shoe 63.9
Shoe 59.9
Shoe 59
Grass 57.9
Walking 57.8
Skirt 56.8
Path 56.1
Kindergarten 55.5
Baseball 55.3
Baseball Glove 55.3
Glove 55.3
Sport 55.3

Clarifai
created on 2018-05-11

people 99.9
child 99.8
group together 99.5
boy 98.8
group 98.5
many 98.2
man 94.8
recreation 94.8
school 93.3
adolescent 93.3
portrait 91.8
education 91.5
woman 90.7
adult 90.1
son 89.6
war 88.9
wear 86.3
five 84.2
several 83
crowd 82.8

Imagga
created on 2023-10-06

sport 49.9
snow 47.2
winter 42.5
cold 36.1
people 27.3
man 24.9
ski 23.9
season 23.4
active 23
mountain 22.2
outdoor 21.4
person 18.4
slope 18.1
fun 15.7
child 15.7
leisure 14.9
outdoors 14.9
outside 14.5
group 14.5
happy 14.4
male 14.3
walking 14.2
landscape 14.1
travel 14.1
together 14
family 13.3
vacation 13.1
weather 13.1
lifestyle 13
frozen 12.4
athlete 12.4
sports 12
recreation 11.6
activity 11.6
park 11.5
walk 11.4
ice 11.3
couple 11.3
ski slope 11.3
scene 11.2
hill 11.2
mountains 11.1
mother 10.9
smiling 10.8
skiing 10.8
snowing 10.8
holiday 10.7
snowy 10.7
freeze 10.7
boy 10.4
children 10
ballplayer 9.7
portrait 9.7
hiking 9.6
women 9.5
player 9.4
adult 9.1
world 8.9
tourist 8.9
chilly 8.8
scarf 8.8
forest 8.7
extreme 8.6
happiness 8.6
play 8.6
men 8.6
action 8.3
camera 8.3
sky 8.3
having fun 7.9
full length 7.7
youth 7.7
resort 7.7
adventure 7.6
skier 7.6
laughing 7.6
exercise 7.3
black 7.2
equipment 7.1
cool 7.1

Google
created on 2018-05-11

photograph 95
black and white 83.4
child 75.4
recreation 65.4
monochrome photography 59.7
monochrome 56
history 55.5
family 53.7

Microsoft
created on 2018-05-11

person 99.7
outdoor 99.5
posing 94.6
group 88.3
standing 80.5
black 65.7
people 59.8
old 44.3
team 33.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-20
Gender Female, 100%
Calm 88.5%
Angry 9.2%
Surprised 6.3%
Fear 6%
Sad 2.5%
Confused 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Sad 94.1%
Confused 40.6%
Angry 7.9%
Fear 6.7%
Surprised 6.4%
Disgusted 2.4%
Calm 0.4%
Happy 0.3%

AWS Rekognition

Age 6-12
Gender Female, 61.1%
Angry 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Calm 0.3%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 16-22
Gender Male, 86.5%
Happy 98%
Surprised 6.5%
Fear 6%
Sad 2.2%
Disgusted 0.4%
Angry 0.3%
Confused 0.2%
Calm 0.1%

AWS Rekognition

Age 10-18
Gender Female, 87.6%
Happy 74.1%
Sad 17.7%
Surprised 6.7%
Fear 6.2%
Confused 3.7%
Calm 2%
Angry 1.7%
Disgusted 0.9%

AWS Rekognition

Age 18-24
Gender Male, 88.2%
Calm 87.3%
Confused 9%
Fear 6.4%
Surprised 6.4%
Sad 2.5%
Angry 0.5%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 7-17
Gender Male, 75.7%
Confused 54.5%
Sad 47.4%
Angry 8.5%
Surprised 6.6%
Fear 6.1%
Happy 5.3%
Disgusted 2.3%
Calm 2%

AWS Rekognition

Age 10-18
Gender Male, 99.8%
Sad 59.2%
Calm 34.5%
Fear 14.5%
Confused 11.6%
Surprised 8.5%
Happy 3%
Disgusted 1.7%
Angry 1.1%

AWS Rekognition

Age 23-31
Gender Female, 99.5%
Sad 92.5%
Disgusted 29.1%
Fear 10.8%
Confused 7.6%
Surprised 7.1%
Happy 3.2%
Calm 2.5%
Angry 1.8%

AWS Rekognition

Age 2-8
Gender Male, 99.9%
Happy 98.4%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Calm 0.5%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 11-19
Gender Female, 100%
Fear 97.4%
Surprised 6.4%
Sad 2.9%
Calm 0.9%
Confused 0.7%
Happy 0.4%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 93.7%
Happy 67.6%
Fear 19%
Surprised 6.9%
Calm 5.7%
Sad 2.8%
Angry 1.9%
Confused 1%
Disgusted 0.9%

AWS Rekognition

Age 14-22
Gender Female, 93.9%
Fear 91%
Sad 24.5%
Surprised 7%
Calm 2.2%
Confused 0.6%
Angry 0.6%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 6-12
Gender Female, 92.9%
Sad 100%
Confused 9.1%
Surprised 6.8%
Fear 6%
Happy 0.5%
Disgusted 0.4%
Angry 0.3%
Calm 0.3%

AWS Rekognition

Age 18-24
Gender Female, 99.1%
Happy 62.3%
Calm 8.7%
Surprised 8.6%
Angry 8.1%
Fear 6.9%
Confused 6.3%
Disgusted 5.6%
Sad 3%

AWS Rekognition

Age 6-12
Gender Female, 92%
Surprised 34.3%
Fear 22.5%
Calm 21.3%
Confused 10.1%
Happy 10%
Sad 5.9%
Disgusted 3.3%
Angry 1.2%

AWS Rekognition

Age 6-12
Gender Female, 99.9%
Angry 98.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.8%
Confused 0.1%
Calm 0.1%
Happy 0.1%

AWS Rekognition

Age 14-22
Gender Female, 60.3%
Calm 84.7%
Fear 11%
Surprised 6.5%
Sad 3.1%
Angry 0.9%
Happy 0.5%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 35-43
Gender Female, 50.4%
Calm 90.4%
Surprised 6.3%
Sad 6.3%
Fear 6%
Happy 0.6%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Female, 80.3%
Sad 99.2%
Calm 38.6%
Surprised 6.3%
Fear 5.9%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 4-10
Gender Female, 96.1%
Calm 87%
Surprised 6.5%
Fear 6.4%
Confused 4%
Disgusted 3.6%
Sad 2.8%
Angry 1.3%
Happy 0.3%

AWS Rekognition

Age 6-12
Gender Female, 91.5%
Sad 98.1%
Calm 20.4%
Surprised 14.3%
Happy 9.4%
Fear 7.1%
Angry 1%
Disgusted 0.8%
Confused 0.4%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 46
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Child 98.4%
Female 98.4%
Girl 98.4%
Boy 97.8%
Male 97.8%
Shoe 80.1%