Human Generated Data

Title

Waiting for relief check, Scotts Run, West Virginia
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3082

Human Generated Data

Title

Waiting for relief check, Scotts Run, West Virginia

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3082

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Railing 99.8
Handrail 97.5
Banister 97.5
Person 96.7
Human 96.7
Furniture 90.8
Clothing 87.9
Apparel 87.9
Balcony 73.5
Wood 63.3
Cap 58.5
Beanie 58.5
Hat 58.5
Couch 58.3

Clarifai
created on 2023-10-15

people 99.3
portrait 99.1
adult 97.3
one 97.2
man 96.2
boy 94
child 93.5
bench 91.7
lid 90.8
two 89.5
monochrome 89.5
furniture 88.1
fence 87.7
step 87.3
chair 86.3
seat 85.8
wear 82.2
three 79.4
veil 77.9
vintage 77.1

Imagga
created on 2021-12-15

statue 52.1
prison 46.4
architecture 37.7
correctional institution 37.4
building 31.5
penal institution 28
sculpture 27
old 23.7
monument 21.5
ancient 19.9
travel 19
institution 18.6
stone 18.6
tourism 17.3
landmark 17.1
history 17
culture 16.2
historic 15.6
structure 15.5
religion 15.2
facade 15.2
famous 14.9
marble 14.5
art 14.4
column 14.2
city 13.3
university 13
temple 12.8
government 12.7
historical 12.2
classical 11.5
tourist 11
balcony 10.9
sky 10.8
memorial 10.6
detail 10.5
symbol 10.1
man 10.1
establishment 9.5
religious 9.4
face 9.2
male 9.2
barrier 7.9
carved 7.8
palace 7.8
gate 7.8
museum 7.8
capital 7.6
spectator 7.6
vintage 7.4
close 7.4
exterior 7.4
wall 7.2
world 7.1
portrait 7.1

Google
created on 2021-12-15

Style 83.8
Rectangle 83.8
Black-and-white 83.4
Fence 81
Tints and shades 77.4
Monochrome photography 74.1
Art 72.8
Monochrome 72.3
Wood 67.9
Font 67.8
Room 66.6
Vintage clothing 66.4
Stock photography 63.7
Sitting 62.1
Portrait photography 58.4
Visual arts 58.1
Symmetry 58.1
Photographic paper 56.2
Still life photography 55.8
Hoodie 53

Microsoft
created on 2021-12-15

human face 95.2
black and white 92.8
text 92.3
person 85.5
window 83.4
clothing 79.4
street 70.5
monochrome 66.2
white 63.1
posing 43

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 55.3%
Calm 43.6%
Surprised 21.5%
Disgusted 11%
Angry 8.7%
Sad 6.2%
Happy 3.9%
Fear 3.8%
Confused 1.3%

Microsoft Cognitive Services

Age 45
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.7%

Categories

Imagga

paintings art 72.4%
streetview architecture 26%

Text analysis

Amazon

50
25
001