Human Generated Data

Title

Untitled (crowd entering H.J. Heinz Co. Building)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4452

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd entering H.J. Heinz Co. Building)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.7
Person 99.3
Person 99.1
Person 99
Person 98.7
Person 98.7
Person 98.4
Person 98.3
Person 94.2
Building 87.4
Person 70.4
Person 69.4
People 66.9
Housing 65.4
Crowd 63.1
Factory 62.5
Urban 59.1
Nature 59.1
Text 58.8
Apparel 57
Clothing 57

Imagga
created on 2022-01-23

building 45
architecture 44.1
city 27.4
house 23.6
travel 21.8
old 19.5
history 18.8
university 17.9
palace 16.8
tourism 16.5
landmark 16.2
residence 15.9
column 15.8
facade 15.6
structure 14.7
construction 14.5
religion 14.3
marimba 14.2
facility 14.1
monument 14
bank 13.5
urban 13.1
famous 13
window 13
historic 12.8
percussion instrument 12.5
night 12.4
sky 12.1
town 12.1
church 12
statue 11.6
historical 11.3
ancient 11.2
office 10.8
cathedral 10.8
capital 10.4
public house 10.4
wall 10.4
culture 10.2
sculpture 10.1
depository 9.9
center 9.9
musical instrument 9.7
arch 9.7
people 9.5
hall 9.3
exterior 9.2
street 9.2
business 9.1
station 9.1
government 8.8
lamp 8.6
temple 8.6
winter 8.5
tourist 8.4
square 8.1
gate 8
snow 7.9
door 7.9
dome 7.8
destination 7.5
traditional 7.5
place 7.4
vintage 7.4
gold 7.4
home 7.2
transportation 7.2

Google
created on 2022-01-23

Window 92.7
Building 92.1
Facade 74.5
Monochrome 73.1
Vintage clothing 68.3
History 67.5
Room 67.2
Monochrome photography 67.1
Suit 66.1
Paper product 65.7
Arch 65.6
Plant 64.2
Stock photography 63.7
Arcade 61
Classic 58.3
Art 58.1
Illustration 57.4
House 56.1
Rectangle 55.2
Holy places 53.5

Microsoft
created on 2022-01-23

text 98.9
clothing 93.3
person 92.8
man 77.4
woman 77
wedding dress 71.7
black 68.7
dress 64.6

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 96.3%
Calm 60%
Sad 21.2%
Confused 5%
Angry 4.7%
Happy 2.9%
Disgusted 2.2%
Fear 2.1%
Surprised 1.9%

AWS Rekognition

Age 23-33
Gender Female, 85.6%
Happy 63.2%
Fear 26.5%
Calm 6.2%
Sad 1.2%
Confused 0.8%
Angry 0.8%
Disgusted 0.7%
Surprised 0.6%

AWS Rekognition

Age 28-38
Gender Female, 69.3%
Calm 73%
Sad 17.7%
Happy 5.4%
Confused 1.5%
Surprised 0.7%
Fear 0.7%
Disgusted 0.6%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a building 94.7%
a group of people in front of a building 94.3%
a group of people that are standing in front of a building 90.1%

Text analysis

Amazon

CO.
H.J.HEINZ CO.
H.J.HEINZ
17225.
19225.
MAMTRAT
BC
HAGON
HAGON YTENAS MAMTRAT
YTENAS

Google

17225. Η.J. HΗEINZ CO. 225•
17225.
225•
CO.
HΗEINZ
Η.J.