Human Generated Data

Title

Untitled (Purseglove Coal Mining Company Office, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1267

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Purseglove Coal Mining Company Office, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1267

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Hat 100
Coat 99.9
Sun Hat 99.5
People 99.4
Formal Wear 99
Suit 99
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Person 98.3
Adult 98.3
Male 98.3
Man 98.3
Person 98.1
Adult 98.1
Male 98.1
Man 98.1
Person 97.8
Adult 97.8
Male 97.8
Man 97.8
Person 97.5
Adult 97.5
Male 97.5
Man 97.5
Person 97.2
Adult 97.2
Male 97.2
Man 97.2
Person 97.1
Person 95.1
Person 92.6
Person 90.9
Person 87.9
Adult 87.9
Male 87.9
Man 87.9
Outdoors 87.3
Person 86.3
Nature 78.7
Face 78.5
Head 78.5
Cap 66.6
Person 66.3
Shirt 57.6
Jacket 57.5
Photography 57.5
Portrait 57.5
Plant 57
Vegetation 57
Overcoat 57
Walking 55.7
Blazer 55.4
Land 55.4
Tree 55.4
Woodland 55.4
Crowd 55

Clarifai
created on 2018-05-11

people 99.9
group together 99.6
many 99.1
group 98.9
adult 98.8
man 97.7
woman 95.6
several 94.6
wear 93
administration 92.4
leader 91.7
war 90.7
military 89
recreation 87.4
five 86.3
vehicle 84.7
crowd 84
monochrome 83.7
child 83.7
music 78.6

Imagga
created on 2023-10-06

brass 63.5
wind instrument 48.4
trombone 34.3
musical instrument 32.9
bugle 30.2
group 25
people 24.5
male 21.3
man 20.8
men 19.7
person 19.7
active 17.5
sky 16.6
pedestrian 15.5
crowd 15.4
outdoors 15.1
silhouette 14.9
sport 14.6
beach 14.3
summer 14.1
vacation 13.9
fun 13.5
boy 13
lifestyle 13
adult 13
travel 12.7
walking 12.3
together 12.3
outdoor 12.2
women 11.9
cornet 11.6
family 11.6
spectator 11.1
mountain 10.8
park 10.7
couple 10.4
athlete 10.4
uniform 10.3
happy 10
sand 9.6
happiness 9.4
tourist 9.2
child 9.2
life 8.9
device 8.7
standing 8.7
water 8.7
day 8.6
architecture 8.6
engineer 8.5
ocean 8.3
tourism 8.2
runner 8.2
businessman 7.9
building 7.9
sea 7.8
play 7.7
sunny 7.7
party 7.7
run 7.7
clothing 7.7
youth 7.7
old 7.7
animal 7.6
contestant 7.6
walk 7.6
clouds 7.6
joy 7.5
city 7.5
leisure 7.5
mother 7.4
company 7.4
stage 7.4
lake 7.3
teenager 7.3
business 7.3
history 7.2
grass 7.1
season 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.7
person 99.7
group 94.8
standing 88.5
posing 87.7
people 79.3
white 60.7
old 58
clothes 17.1
crowd 4.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.6%
Confused 0.2%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Male, 96.3%
Surprised 75.2%
Angry 20.8%
Confused 9.9%
Calm 9%
Fear 7%
Sad 5.8%
Happy 4.7%
Disgusted 1.3%

AWS Rekognition

Age 45-53
Gender Male, 87.8%
Happy 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Calm 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 69.5%
Sad 26.1%
Surprised 6.5%
Fear 6.1%
Angry 3.9%
Confused 3.7%
Disgusted 1.4%
Happy 1.1%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 84.6%
Happy 13.9%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Sad 51.1%
Confused 30.2%
Calm 25.7%
Fear 11.6%
Surprised 7%
Angry 2.4%
Happy 1.7%
Disgusted 0.6%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 98.4%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.5%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Female, 93.8%
Calm 81.7%
Surprised 8.7%
Sad 7.9%
Fear 6%
Confused 3.2%
Angry 0.5%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 43-51
Gender Male, 99.7%
Confused 41%
Calm 31.3%
Surprised 18.1%
Happy 9.4%
Fear 6.3%
Sad 2.5%
Angry 1.5%
Disgusted 0.8%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Happy 93.4%
Surprised 6.3%
Calm 6.2%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Confused 0.1%
Angry 0%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 73
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Adult 98.8%
Male 98.8%
Man 98.8%