Human Generated Data

Title

Untitled (Purseglove Coal Mining Company Office, Scotts Run, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1266
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Purseglove Coal Mining Company Office, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1266

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Handrail 100
Railing 99.8
People 99.1
Architecture 97.1
Building 97.1
House 97.1
Housing 97.1
Staircase 97.1
Person 96.9
Person 96.8
Person 96.4
Person 96
Person 95.2
Person 94.9
Adult 94.9
Male 94.9
Man 94.9
Person 94.2
Person 93.4
Person 92.8
Person 92.4
Person 91.7
Person 91.3
Person 89.9
Person 89.8
Person 86.8
Person 86
Person 83.7
Person 81.7
Outdoors 80.1
Person 79.1
Face 76.9
Head 76.9
Crowd 72.6
Person 64.9
Clothing 57.5
Hat 57.5
Nature 57.2
Coat 57
Porch 56.2
Monastery 56.1
Audience 55.3
Fence 55.1

Clarifai
created on 2018-05-11

people 100
group together 99.6
group 99.6
many 99.6
adult 98.9
crowd 96.3
man 96.2
military 96.2
administration 95.6
leader 95.5
war 92.7
wear 90.5
soldier 90.1
one 89.3
spectator 84.4
home 83.7
woman 83.5
chair 82.5
uniform 80.8
step 77.1

Imagga
created on 2023-10-06

balcony 48.5
barrier 30.2
architecture 28.1
support 27.3
structure 24.8
obstruction 21.9
step 21.8
fence 21.6
building 20
picket fence 17.6
old 16.7
device 16.4
landmark 15.3
railing 15
city 15
statue 13.3
musical instrument 13.2
sky 12.7
baluster 12.7
travel 12.7
percussion instrument 12.7
man 12.1
people 11.7
marimba 11.7
house 11.7
outdoor 11.5
stone 11
history 10.7
tourism 10.7
urban 10.5
outdoors 10.4
wall 10.3
historic 10.1
male 9.9
water 9.3
monument 9.3
famous 9.3
street 9.2
column 8.8
design 8.4
black 8.4
summer 8.4
stairs 8
home 8
beach 7.7
vintage 7.4
sport 7.4
vacation 7.4
freedom 7.3
lifestyle 7.2
holiday 7.2

Google
created on 2018-05-11

photograph 95.1
black and white 91.8
monochrome photography 80.9
structure 78
history 77.8
monochrome 70.3
tree 55.3
stock photography 52.5

Microsoft
created on 2018-05-11

outdoor 95.5
black 89.5
white 87.2
people 83.8
group 61
old 55.9

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 90%
Surprised 7.4%
Fear 6%
Confused 5.4%
Sad 2.4%
Happy 0.7%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Sad 51.8%
Calm 39.7%
Surprised 15.8%
Fear 9.9%
Happy 4.2%
Confused 4.2%
Disgusted 2.4%
Angry 1.6%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Calm 66.4%
Confused 13.5%
Surprised 7.2%
Fear 6.5%
Disgusted 6.4%
Sad 4.6%
Angry 3%
Happy 1.9%

AWS Rekognition

Age 51-59
Gender Male, 96.6%
Calm 96.8%
Surprised 6.7%
Fear 6%
Sad 2.3%
Angry 0.5%
Happy 0.5%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Happy 80.8%
Surprised 7.9%
Calm 7.2%
Fear 6.1%
Sad 5.1%
Angry 1.2%
Disgusted 0.9%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 47.9%
Angry 30.3%
Confused 15.9%
Surprised 8.3%
Fear 6%
Sad 2.4%
Disgusted 1%
Happy 0.4%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 83.6%
Happy 8.1%
Surprised 6.6%
Fear 6.2%
Sad 4%
Angry 1.5%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Happy 69.4%
Surprised 12.4%
Fear 7.1%
Calm 6.7%
Sad 5.1%
Angry 3.2%
Confused 1.4%
Disgusted 1.2%

AWS Rekognition

Age 45-51
Gender Male, 94.9%
Surprised 84.2%
Calm 23.9%
Happy 14.2%
Fear 6%
Sad 4.2%
Angry 2.5%
Confused 2.3%
Disgusted 1.1%

AWS Rekognition

Age 23-31
Gender Male, 97.9%
Calm 87.6%
Sad 8.5%
Surprised 6.4%
Fear 6%
Confused 0.7%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Sad 70.7%
Calm 36.1%
Surprised 18.7%
Fear 6.8%
Happy 4.2%
Angry 4.1%
Disgusted 3.6%
Confused 2.5%

AWS Rekognition

Age 22-30
Gender Male, 61.9%
Calm 44.3%
Confused 37.2%
Surprised 9.5%
Sad 6.3%
Fear 6.2%
Happy 2.3%
Angry 1.5%
Disgusted 0.8%

AWS Rekognition

Age 22-30
Gender Male, 71.5%
Happy 84.2%
Angry 8.5%
Fear 6.7%
Surprised 6.5%
Sad 3.1%
Disgusted 1.2%
Calm 0.5%
Confused 0.3%

AWS Rekognition

Age 12-20
Gender Female, 87%
Calm 79.9%
Happy 14.2%
Surprised 6.5%
Fear 6.4%
Sad 2.9%
Angry 0.9%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 37-45
Gender Male, 80.7%
Calm 77.2%
Happy 8.4%
Surprised 6.5%
Confused 6%
Fear 6%
Sad 3.7%
Angry 3.2%
Disgusted 0.5%

AWS Rekognition

Age 18-26
Gender Female, 51.8%
Sad 98.8%
Calm 33.6%
Surprised 6.5%
Fear 6%
Confused 4%
Happy 2.4%
Disgusted 1.3%
Angry 0.3%

AWS Rekognition

Age 22-30
Gender Male, 92.9%
Calm 81.5%
Surprised 6.7%
Happy 6.7%
Fear 6.3%
Sad 4.9%
Angry 2.1%
Disgusted 1.2%
Confused 0.8%

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Feature analysis

Amazon

Person 96.9%
Adult 94.9%
Male 94.9%
Man 94.9%

Categories

Imagga

streetview architecture 96.4%
paintings art 2.1%
interior objects 1.1%