Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1638
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1638

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 99.9
Person 98.5
Child 98.5
Female 98.5
Girl 98.5
Clothing 98.4
Hat 98.4
Person 98.2
Child 98.2
Female 98.2
Girl 98.2
Person 97.1
Person 97.1
Child 97.1
Female 97.1
Girl 97.1
Person 96.8
Person 96.6
Child 96.6
Boy 96.6
Male 96.6
Person 96.6
Person 96.4
Child 96.4
Boy 96.4
Male 96.4
Person 96.1
Person 95.6
Person 95.6
Person 94.5
Person 93.5
Person 93.5
Footwear 92.9
Shoe 92.9
Person 92.5
Child 92.5
Female 92.5
Girl 92.5
Person 92.3
Child 92.3
Boy 92.3
Male 92.3
Person 92.2
Person 90.9
Outdoors 90.4
Shoe 90.2
Face 88.9
Head 88.9
Shoe 88.2
Shoe 85.9
Person 85.4
Person 85.4
Photography 84.4
Person 83.5
Person 83
Portrait 79.7
Shoe 78.7
Shoe 76.5
Coat 76.5
Nature 71.4
Shoe 66.3
Shoe 61.9
Shoe 59.7
Architecture 57.6
Building 57.6
School 57.6
Shorts 57.5
Shoe 57.3
Grass 56.7
Plant 56.7
Classroom 56.7
Indoors 56.7
Room 56.7
Slum 56.3
Baseball 56.2
Baseball Glove 56.2
Glove 56.2
Sport 56.2
Bench 56.2
Furniture 56.2
Kindergarten 56.1
Cap 55.9
Dress 55.6
Bus Stop 55.3
Ball 55.3
Football 55.3
Soccer 55.3
Soccer Ball 55.3
Baseball Cap 55.2

Clarifai
created on 2018-05-11

people 100
group together 99.3
child 99.1
group 99
many 97.5
adult 97
man 95.8
boy 95.4
military 93.3
woman 92
war 91.6
recreation 90.3
wear 89.9
uniform 83.6
administration 83
portrait 82.8
five 81.6
education 81.5
soldier 80.8
enjoyment 80.5

Imagga
created on 2023-10-06

snow 25.6
people 24.5
man 23.7
winter 19.6
male 19.5
musical instrument 18.6
child 18.4
person 18.1
percussion instrument 15.6
black 15
steel drum 14.8
cold 14.6
landscape 14.1
outdoor 13.8
world 13.6
couple 13.1
sport 13
group 12.9
men 12.9
old 12.5
season 12.5
adult 12.4
walking 12.3
tree 12.3
together 12.3
city 11.6
silhouette 11.6
lifestyle 10.8
walk 10.5
kin 10.2
sky 10.2
park 9.9
weather 9.8
portrait 9.7
scene 9.5
friends 9.4
grunge 9.4
friendship 9.4
outdoors 9.2
dirty 9
active 8.8
happy 8.8
forest 8.7
women 8.7
tourist 8.6
frozen 8.6
travel 8.4
vintage 8.3
human 8.2
danger 8.2
mountain 8
outside 7.7
hill 7.5
street 7.4
teen 7.4
exercise 7.3
businessman 7.1
day 7.1

Google
created on 2018-05-11

photograph 95.3
team 85.5
black and white 82
crew 81.9
history 70.5
recreation 61
monochrome photography 52.8

Microsoft
created on 2018-05-11

person 99.6
posing 97.2
group 92.3
outdoor 90.1
standing 85.7
team 47

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Female, 100%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Angry 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 7-17
Gender Female, 99.1%
Sad 100%
Fear 6.9%
Surprised 6.5%
Calm 3.7%
Confused 2.3%
Angry 1.2%
Disgusted 0.6%
Happy 0.3%

AWS Rekognition

Age 25-35
Gender Female, 98.5%
Sad 99.2%
Calm 33.9%
Surprised 6.5%
Fear 6%
Confused 2.9%
Disgusted 1%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 18-24
Gender Female, 95.5%
Sad 97.3%
Calm 28.3%
Angry 9.4%
Fear 7.4%
Surprised 7.1%
Disgusted 3.3%
Confused 1.3%
Happy 0.8%

AWS Rekognition

Age 6-14
Gender Female, 89.1%
Calm 77.4%
Fear 15.5%
Surprised 6.5%
Sad 3.4%
Confused 0.9%
Happy 0.9%
Angry 0.4%
Disgusted 0.4%

AWS Rekognition

Age 20-28
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Angry 0%

AWS Rekognition

Age 4-12
Gender Male, 59.5%
Sad 100%
Fear 6.6%
Surprised 6.6%
Confused 4.5%
Happy 2.5%
Calm 1.9%
Angry 1.8%
Disgusted 1.5%

AWS Rekognition

Age 7-17
Gender Female, 92.7%
Happy 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Calm 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 89.3%
Sad 98.6%
Calm 21.1%
Confused 12.2%
Surprised 6.9%
Fear 6.5%
Angry 3.2%
Disgusted 2.3%
Happy 1.8%

AWS Rekognition

Age 13-21
Gender Female, 99.8%
Sad 87.5%
Calm 46.9%
Surprised 7.6%
Confused 6.8%
Fear 6%
Disgusted 1.5%
Angry 0.8%
Happy 0.8%

AWS Rekognition

Age 4-12
Gender Female, 90.4%
Calm 86.6%
Happy 8.6%
Surprised 6.6%
Fear 6%
Sad 2.7%
Confused 1.6%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Sad 99.9%
Calm 16.4%
Confused 7.5%
Surprised 6.4%
Fear 6%
Disgusted 0.5%
Happy 0.5%
Angry 0.4%

AWS Rekognition

Age 18-24
Gender Female, 50.7%
Calm 67.4%
Surprised 21.7%
Confused 9.4%
Fear 6.1%
Sad 3.3%
Happy 1.4%
Angry 0.8%
Disgusted 0.6%

AWS Rekognition

Age 30-40
Gender Male, 99.4%
Sad 100%
Fear 12.9%
Surprised 6.3%
Calm 4.3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 16-22
Gender Male, 70.1%
Sad 50.3%
Fear 31.1%
Calm 30.3%
Confused 8.4%
Surprised 6.8%
Happy 1.8%
Disgusted 1.1%
Angry 1.1%

AWS Rekognition

Age 26-36
Gender Male, 90.5%
Happy 97.8%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Angry 0.9%
Calm 0.5%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 14-22
Gender Male, 98.5%
Happy 98.7%
Surprised 6.4%
Fear 6%
Sad 2.2%
Calm 0.4%
Angry 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 21-29
Gender Male, 92.8%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Happy 0.3%
Confused 0.1%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 18
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Child
Female
Girl
Boy
Male
Shoe
Person 98.5%
Person 98.2%
Person 97.1%
Person 97.1%
Person 96.8%
Person 96.6%
Person 96.6%
Person 96.4%
Person 96.1%
Person 95.6%
Person 95.6%
Person 94.5%
Person 93.5%
Person 93.5%
Person 92.5%
Person 92.3%
Person 92.2%
Person 90.9%
Person 85.4%
Person 85.4%
Person 83.5%
Person 83%
Child 98.5%
Child 98.2%
Child 97.1%
Child 96.6%
Child 96.4%
Child 92.5%
Child 92.3%
Female 98.5%
Female 98.2%
Female 97.1%
Female 92.5%
Girl 98.5%
Girl 98.2%
Girl 97.1%
Girl 92.5%
Boy 96.6%
Boy 96.4%
Boy 92.3%
Male 96.6%
Male 96.4%
Male 92.3%
Shoe 92.9%
Shoe 90.2%
Shoe 88.2%
Shoe 85.9%
Shoe 78.7%
Shoe 76.5%
Shoe 66.3%
Shoe 61.9%
Shoe 59.7%
Shoe 57.3%