Human Generated Data

Title

Untitled (Purseglove Coal Mining Company Office, Scotts Run, West Virginia)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3424

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Purseglove Coal Mining Company Office, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3424

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 99.9
Balcony 99.9
Building 99.9
Handrail 99.8
Railing 99.8
Person 98.5
Person 98.3
Adult 98.3
Male 98.3
Man 98.3
Person 98.1
Adult 98.1
Male 98.1
Man 98.1
Person 97.3
Person 97.3
Person 96.5
Person 96
Person 85
Face 82.2
Head 82.2
Person 79.7
Clothing 69.3
Coat 69.3
Person 64.7
Housing 61.8
Hat 57.6
Jacket 57.2
House 55.8
Porch 55.8

Clarifai
created on 2018-05-10

people 100
group 99.7
group together 99.5
administration 99.3
adult 99.2
many 97.3
man 97.1
several 96.8
four 96
military 95.9
leader 94.3
woman 93.7
three 93.4
five 92.8
war 92.5
outfit 91
two 90.8
wear 90.8
furniture 89.3
vehicle 88.4

Imagga
created on 2023-10-06

balcony 100
structure 35.4
architecture 18.7
people 18.4
house 18.4
man 18.1
old 16.7
marimba 16.5
building 15.8
male 14.9
percussion instrument 14.4
outdoor 13.7
home 13.5
happy 13.1
travel 12.7
vacation 12.3
lifestyle 11.6
musical instrument 11.3
resort 11.2
window 11
relax 10.9
wood 10.8
tourism 10.7
interior 10.6
outside 10.3
sea 10.2
holiday 10
water 10
city 10
person 10
leisure 10
outdoors 9.7
adult 9.7
couple 9.6
sky 9.6
sitting 9.4
two 9.3
historic 9.2
vintage 9.1
black 9
summer 9
family 8.9
wooden 8.8
fence 8.8
day 8.6
sunny 8.6
wall 8.5
beach 8.4
portrait 8.4
relaxation 8.4
room 8.3
night 8
to 8
porch 7.9
happiness 7.8
door 7.7
pretty 7.7
pool 7.7
residential 7.6
fun 7.5
ocean 7.5
baluster 7.4
island 7.3
landmark 7.2
history 7.1
women 7.1
together 7
modern 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 94.4
black 87.3
white 86.5
window 82.5
people 69
old 51.1
balcony 20.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Disgusted 69.7%
Calm 20.9%
Surprised 6.7%
Fear 6.2%
Angry 5.2%
Sad 2.6%
Confused 0.8%
Happy 0.5%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 89.2%
Surprised 6.7%
Fear 6.3%
Confused 2.9%
Angry 2.9%
Sad 2.6%
Happy 1.1%
Disgusted 0.7%

AWS Rekognition

Age 49-57
Gender Male, 95%
Calm 57.4%
Confused 36.8%
Surprised 6.8%
Fear 6.2%
Sad 2.4%
Angry 1.7%
Happy 0.9%
Disgusted 0.5%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 97.6%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Disgusted 0.5%
Confused 0.4%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 98.5%
Sad 58%
Fear 31.1%
Calm 19.9%
Surprised 8%
Disgusted 7.7%
Happy 3.9%
Angry 3.6%
Confused 3.3%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Confused 37.4%
Calm 26.2%
Surprised 12.6%
Disgusted 11.5%
Fear 8.3%
Sad 5.8%
Angry 2.3%
Happy 1.1%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 20
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Adult 98.3%
Male 98.3%
Man 98.3%