Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1640

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1640

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 98.5
Shorts 98.5
Person 98.3
Person 98.1
Person 97.9
Child 97.9
Female 97.9
Girl 97.9
Person 97.9
Person 97.8
Person 97.3
Child 97.3
Female 97.3
Girl 97.3
Person 97.1
Child 97.1
Boy 97.1
Male 97.1
Person 97.1
Child 97.1
Boy 97.1
Male 97.1
Person 97
Child 97
Boy 97
Male 97
Person 97
Person 96.9
Person 96.7
Person 96.6
Person 96.4
Person 95.9
Child 95.9
Boy 95.9
Male 95.9
Person 95.7
People 94.8
Person 94.5
Plant 94.3
Tree 94.3
Person 93.8
Person 93.1
Person 92.2
Person 91.6
Child 91.6
Boy 91.6
Male 91.6
Outdoors 89.4
Face 83.3
Head 83.3
Footwear 83
Shoe 83
Person 81.9
Person 72.3
Shoe 70.6
Nature 69.8
Dress 69.1
Shoe 69.1
Shoe 67.2
Shoe 64.4
Photography 61.6
Portrait 61.6
Bicycle 57.2
Transportation 57.2
Vehicle 57.2
Skirt 56.4
Walking 56.4
Bus Stop 56.2
Hat 55.7

Clarifai
created on 2018-05-11

people 100
child 99.9
group 99.9
group together 99.4
many 98.9
boy 98.2
adult 97.5
war 97
family 96
man 95.4
several 94.8
five 94
sibling 93.9
son 93.8
offspring 93.1
military 92.8
administration 92.7
education 92.4
woman 92
recreation 90.1

Imagga
created on 2023-10-07

brass 100
wind instrument 83.4
trombone 61.6
musical instrument 55.8
man 29.5
people 27.3
male 20
group 17.7
silhouette 17.4
together 16.6
couple 16.5
winter 16.2
walking 16.1
sport 15.2
outdoors 15
person 14.9
child 14.7
men 14.6
outdoor 13.8
adult 12.9
snow 12.7
cold 12
happy 11.9
leisure 11.6
sky 11.5
women 11.1
lifestyle 10.8
team 10.7
park 10.7
walk 10.5
boy 10.4
friendship 10.3
active 9.9
fun 9.7
black 9.6
life 9.5
friends 9.4
human 9
family 8.9
businessman 8.8
cornet 8.8
day 8.6
play 8.6
season 8.6
beach 8.4
kin 8.2
girls 8.2
smiling 8
business 7.9
love 7.9
portrait 7.8
full length 7.8
summer 7.7
two 7.6
kids 7.5
city 7.5
landscape 7.4
children 7.3
mountain 7.1
happiness 7
travel 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.8
person 99.8
group 95.3
posing 91.5
standing 79.3
team 47.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Female, 99.6%
Happy 72.5%
Sad 18.7%
Surprised 6.9%
Fear 6.3%
Confused 4.4%
Calm 2.2%
Disgusted 1.1%
Angry 0.9%

AWS Rekognition

Age 6-14
Gender Female, 95.3%
Sad 81.3%
Calm 29.7%
Angry 25.1%
Surprised 6.9%
Fear 6.7%
Confused 4%
Disgusted 0.5%
Happy 0.5%

AWS Rekognition

Age 21-29
Gender Male, 96.5%
Angry 76.5%
Calm 11.3%
Surprised 6.8%
Fear 6.1%
Sad 6.1%
Confused 2%
Disgusted 0.6%
Happy 0.3%

AWS Rekognition

Age 6-16
Gender Female, 100%
Calm 90.5%
Surprised 6.5%
Fear 6.1%
Sad 4.2%
Angry 2%
Happy 0.7%
Confused 0.5%
Disgusted 0.3%

AWS Rekognition

Age 4-12
Gender Male, 100%
Happy 78.9%
Surprised 8.6%
Fear 6.7%
Angry 4.9%
Confused 4.9%
Sad 3%
Calm 2.1%
Disgusted 0.6%

AWS Rekognition

Age 16-24
Gender Male, 96.4%
Angry 86.6%
Surprised 6.6%
Fear 6.5%
Calm 5.4%
Sad 3.4%
Disgusted 1.2%
Confused 1.2%
Happy 0.3%

AWS Rekognition

Age 43-51
Gender Female, 79%
Confused 78.7%
Sad 12.9%
Fear 6.9%
Surprised 6.8%
Calm 2.1%
Disgusted 1%
Angry 0.8%
Happy 0.3%

AWS Rekognition

Age 16-24
Gender Female, 95.9%
Sad 99.8%
Calm 14.6%
Angry 12.2%
Surprised 6.5%
Fear 6.4%
Confused 1.5%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 14-22
Gender Female, 97.7%
Calm 87.7%
Surprised 6.8%
Fear 6%
Disgusted 4.1%
Sad 3%
Angry 2.8%
Confused 1.2%
Happy 0.6%

AWS Rekognition

Age 25-35
Gender Male, 59.8%
Sad 98.3%
Confused 18.7%
Calm 18.1%
Surprised 8.1%
Fear 6.5%
Happy 1.1%
Angry 1.1%
Disgusted 0.9%

AWS Rekognition

Age 2-8
Gender Male, 96.7%
Happy 79.8%
Calm 12.2%
Surprised 7.2%
Fear 6.2%
Sad 3.3%
Angry 1.1%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 11-19
Gender Male, 98.7%
Calm 86.5%
Angry 8.8%
Surprised 6.7%
Fear 6%
Sad 2.3%
Happy 1.3%
Confused 1.3%
Disgusted 0.5%

AWS Rekognition

Age 22-30
Gender Male, 85.4%
Calm 97.2%
Surprised 6.4%
Fear 5.9%
Sad 2.7%
Confused 0.2%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Sad 82.7%
Calm 32.9%
Fear 11.8%
Surprised 7.6%
Angry 6.6%
Happy 4.6%
Confused 3.1%
Disgusted 1.3%

AWS Rekognition

Age 42-50
Gender Male, 64.6%
Sad 99.5%
Calm 30.5%
Surprised 6.5%
Fear 6%
Disgusted 2.4%
Happy 1.8%
Confused 0.7%
Angry 0.5%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 17
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Child 97.9%
Female 97.9%
Girl 97.9%
Boy 97.1%
Male 97.1%
Shoe 83%