Human Generated Data

Title

Untitled (Empire State Building under construction)

Date

c. 1930-31, printed 1980s

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.803

Human Generated Data

Title

Untitled (Empire State Building under construction)

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

c. 1930-31, printed 1980s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 73
Human 73
Door 71.1
Art 63.8
Sphere 59
Home Decor 56.8

Imagga
created on 2021-12-14

frame 32.2
empty 23.2
blank 22.3
device 17.7
object 16.8
window 16.8
old 16.7
wooden 15.8
instrument 15.6
home 15.1
guillotine 15
wall 14.6
photograph 14.2
house 14.2
wood 14.2
interior 14.1
design 14.1
sign 13.5
door 13.5
equipment 13.3
instrument of execution 12.9
light 12.7
glass 12.4
3d 12.4
retro 12.3
business 12.1
sky 12.1
paper 11.8
barrier 11.4
metal 11.3
construction 11.1
railing 10.9
space 10.9
hourglass 10.2
vintage 9.9
structure 9.7
antique 9.5
gymnastic apparatus 9.1
modern 9.1
chime 9.1
screen 9
open 9
horizontal bar 8.9
building 8.9
success 8.8
art 8.7
icon 8.7
framework 8.7
room 8.3
inside 8.3
note 8.3
obstruction 8.2
time 8.2
message 8.2
border 8.1
symbol 8.1
decoration 8.1
percussion instrument 8
architecture 8
representation 7.8
reflection 7.8
render 7.8
advertising 7.7
estate 7.6
real 7.6
sports equipment 7.3
collection 7.2
work 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

wall 98
indoor 97.5
gallery 93.7
room 90.5
person 86.4
scene 82.7
text 62.5
art 54.3
painting 21.7
picture frame 15.3

Face analysis

Amazon

AWS Rekognition

Age 33-49
Gender Male, 93.4%
Calm 80.5%
Angry 8%
Sad 4.5%
Confused 2.6%
Fear 1.7%
Disgusted 1.3%
Happy 0.9%
Surprised 0.5%

Feature analysis

Amazon

Person 73%

Captions

Microsoft

a painting hanging on a wall 79.1%
a painting on the wall 76.4%
a painting on a wall 75.2%