Human Generated Data

Title

Untitled (Ben Shahn, Jersey Homesteads)
Date

c. 1936-1939
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1998.136

Human Generated Data

Title

Untitled (Ben Shahn, Jersey Homesteads)

People

Artist: Unidentified Artist,

Date

c. 1936-1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 96.8
Human 96.8
Photography 78.3
Photo 78.3
Window 67.3
Horn 65.2
Musical Instrument 65.2
Brass Section 65.2
Portrait 61.5
Face 61.5
Photographer 56.7

Imagga
created on 2022-01-08

house 27.6
window screen 26.8
window 26
sill 24.7
door 24.1
doormat 23.7
screen 23.1
covering 22
man 20.8
building 20.1
structural member 20.1
wall 19.9
architecture 19.6
mat 18.8
home 18.3
protective covering 17.4
people 17.3
male 17.2
person 16.6
portrait 14.9
street 14.7
adult 14.3
floor cover 14.2
old 13.2
support 13
pretty 12.6
urban 12.2
standing 12.2
fashion 11.3
happy 11.3
business 10.9
city 10.8
windows 10.6
residential 10.5
windowsill 10.4
world 10.3
outside 10.3
device 9.9
outdoor 9.9
job 9.7
businessman 9.7
outdoors 9.7
light 9.4
model 9.3
sliding door 9.1
brick 8.9
structure 8.7
stone 8.4
attractive 8.4
exterior 8.3
human 8.2
black 7.9
lifestyle 7.9
face 7.8
residence 7.8
property 7.7
entrance 7.7
modern 7.7
construction 7.7
youth 7.7
child 7.6
ball 7.6
one 7.5
equipment 7.5
town 7.4
copy space 7.2
hair 7.1
posing 7.1
happiness 7

Google
created on 2022-01-08

Window 92.4
Gesture 85.3
Fixture 81.6
Rectangle 78
Tints and shades 77.3
Sleeve 72.5
Monochrome photography 69.8
Home door 69.5
Vintage clothing 66.2
Monochrome 65.3
Room 64.6
Door 61.5
Art 60.8
Visual arts 60.1
Building 58.5
Sash window 54.4
Elbow 50.8
House 50.5

Microsoft
created on 2022-01-08

window 94.3
person 88.2
outdoor 86.7
standing 79.1
man 68.2
clothing 65.4
door 64.4
house 63.5
black and white 57.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Happy 91.7%
Calm 2.6%
Angry 2.2%
Sad 1.8%
Fear 1%
Disgusted 0.4%
Confused 0.2%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%

Captions

Microsoft

a man standing in front of a window 90.4%
a man standing in front of a building 90.3%
a man standing in front of a door 90.2%