Human Generated Data

Title

Waiting for relief check, Scotts Run, West Virginia

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3082

Human Generated Data

Title

Waiting for relief check, Scotts Run, West Virginia

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Railing 99.8
Banister 97.5
Handrail 97.5
Person 96.7
Human 96.7
Furniture 90.8
Apparel 87.9
Clothing 87.9
Balcony 73.5
Wood 63.3
Beanie 58.5
Hat 58.5
Cap 58.5
Couch 58.3

Imagga
created on 2021-12-15

statue 52.1
prison 46.4
architecture 37.7
correctional institution 37.4
building 31.5
penal institution 28
sculpture 27
old 23.7
monument 21.5
ancient 19.9
travel 19
institution 18.6
stone 18.6
tourism 17.3
landmark 17.1
history 17
culture 16.2
historic 15.6
structure 15.5
religion 15.2
facade 15.2
famous 14.9
marble 14.5
art 14.4
column 14.2
city 13.3
university 13
temple 12.8
government 12.7
historical 12.2
classical 11.5
tourist 11
balcony 10.9
sky 10.8
memorial 10.6
detail 10.5
symbol 10.1
man 10.1
establishment 9.5
religious 9.4
face 9.2
male 9.2
barrier 7.9
carved 7.8
palace 7.8
gate 7.8
museum 7.8
capital 7.6
spectator 7.6
vintage 7.4
close 7.4
exterior 7.4
wall 7.2
world 7.1
portrait 7.1

Microsoft
created on 2021-12-15

human face 95.2
black and white 92.8
text 92.3
person 85.5
window 83.4
clothing 79.4
street 70.5
monochrome 66.2
white 63.1
posing 43

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 55.3%
Calm 43.6%
Surprised 21.5%
Disgusted 11%
Angry 8.7%
Sad 6.2%
Happy 3.9%
Fear 3.8%
Confused 1.3%

Microsoft Cognitive Services

Age 45
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.7%

Captions

Microsoft

a person sitting on a bench in front of a window 45.8%
a person posing for a photo in front of a window 45.7%
a person posing for a photo in front of a window 45.6%

Text analysis

Amazon

50
25
001