Human Generated Data

Title

Untitled (woman playing piano and crowd in front of H.J. Heinz. Co. building)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4447
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman playing piano and crowd in front of H.J. Heinz. Co. building)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4447

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 98.4
Person 98.1
Audience 97.8
Crowd 97.8
Person 97.6
Interior Design 94.8
Indoors 94.8
Person 86.5
Person 79.1
Person 77.1
Person 72.1
Face 68.3
Room 68.2
Person 67.1
Person 62.6
Architecture 62
Building 62
Pillar 62
Column 62
People 61.9
Photography 56.5
Photo 56.5
Lecture 55.2
Speech 55.2
Person 49.4

Clarifai
created on 2023-10-27

people 99.4
many 98.5
administration 97.8
man 97.8
group 96.8
adult 95.9
crowd 94.6
monochrome 91.9
leader 89.1
group together 88.5
woman 87.5
war 84.1
chair 82.1
architecture 81.1
child 80.9
building 77.4
horizontal 75.5
outdoors 73.3
theater 71.5
street 71.5

Imagga
created on 2022-01-23

hall 70.2
building 50.5
city 43.2
architecture 39.2
urban 30.6
night 28.4
structure 26
classroom 25
cityscape 22.7
bridge 22.7
sky 22.3
buildings 21.7
room 20.8
landmark 20.8
travel 20.4
skyline 19.9
center 19.7
tourism 19
library 16.2
water 16
famous 15.8
tower 15.2
downtown 14.4
river 14.2
town 13.9
light 13.4
panorama 13.3
street 12.9
tourist 12.8
clouds 12.7
modern 12.6
office 12.5
sea 12.5
skyscraper 12.5
ocean 12.4
lights 11.1
construction 11.1
coast 10.8
windows 10.6
old 10.4
scene 10.4
business 10.3
evening 10.3
landscape 9.7
historic 9.2
school 9
new 8.9
bay 8.8
university 8.7
panoramic 8.6
dusk 8.6
supermarket 8.5
house 8.4
destination 8.4
monument 8.4
boat 8.4
vacation 8.2
history 8
houses 7.7
us 7.7
port 7.7
roof 7.6
illuminated 7.6
tall 7.5
dark 7.5
road 7.2

Google
created on 2022-01-23

Photograph 94.2
Building 92.6
Window 91.3
Black 89.8
World 89.5
Black-and-white 86.1
Style 84
Line 82
Font 79.9
Adaptation 79.3
Art 76.1
Monochrome photography 75.7
Monochrome 75.4
Snapshot 74.3
Crowd 72
Event 72
House 69.3
Facade 68.3
Stock photography 65.6
History 65.2

Microsoft
created on 2022-01-23

text 95
black 79.4
old 70.1
people 65.1
crowd 1.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-30
Gender Female, 92.5%
Happy 76.6%
Fear 6.8%
Angry 4.6%
Calm 4.6%
Sad 4.1%
Surprised 2%
Disgusted 1%
Confused 0.3%

AWS Rekognition

Age 22-30
Gender Female, 99.4%
Calm 88.1%
Fear 5.3%
Angry 2.6%
Happy 1.3%
Sad 0.9%
Disgusted 0.7%
Surprised 0.6%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Female, 53.5%
Calm 72.1%
Sad 14.8%
Happy 11.1%
Angry 0.9%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Female, 94.8%
Calm 63.5%
Happy 24.9%
Sad 4%
Angry 2.4%
Disgusted 1.7%
Fear 1.3%
Surprised 1.1%
Confused 1.1%

AWS Rekognition

Age 23-31
Gender Female, 89.1%
Calm 97.9%
Surprised 0.7%
Angry 0.3%
Happy 0.3%
Sad 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 36-44
Gender Female, 53.1%
Calm 67.6%
Happy 14.3%
Fear 5.4%
Sad 5.2%
Angry 3.2%
Disgusted 1.7%
Confused 1.3%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Female, 98.9%
Calm 90.4%
Happy 2.3%
Sad 2.2%
Fear 1.8%
Confused 1.6%
Surprised 0.8%
Angry 0.5%
Disgusted 0.5%

AWS Rekognition

Age 23-31
Gender Female, 74.4%
Calm 38%
Sad 22.3%
Surprised 14%
Angry 7.4%
Confused 6.8%
Happy 4.7%
Fear 3.8%
Disgusted 3.1%

AWS Rekognition

Age 21-29
Gender Male, 97.1%
Calm 87.6%
Sad 3.7%
Happy 2.8%
Fear 2.3%
Angry 1.3%
Disgusted 1.2%
Surprised 0.7%
Confused 0.5%

AWS Rekognition

Age 20-28
Gender Female, 97.9%
Calm 92.2%
Sad 4.1%
Happy 2.6%
Angry 0.4%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 33-41
Gender Male, 98.7%
Calm 85.8%
Angry 5.8%
Sad 3.7%
Happy 2.1%
Disgusted 0.8%
Fear 0.6%
Surprised 0.5%
Confused 0.5%

AWS Rekognition

Age 29-39
Gender Male, 72.9%
Happy 80.6%
Calm 13%
Sad 2.6%
Confused 1.1%
Angry 0.8%
Fear 0.8%
Surprised 0.7%
Disgusted 0.4%

AWS Rekognition

Age 41-49
Gender Male, 94.4%
Calm 97.3%
Disgusted 1%
Surprised 0.8%
Angry 0.3%
Sad 0.2%
Happy 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Male, 90.2%
Calm 51%
Sad 23.4%
Happy 11.4%
Surprised 5%
Confused 3.1%
Angry 2.6%
Disgusted 2.2%
Fear 1.4%

AWS Rekognition

Age 24-34
Gender Female, 83.1%
Sad 69.8%
Calm 27.7%
Happy 1.2%
Angry 0.5%
Fear 0.3%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

streetview architecture 64.5%
interior objects 30.4%
paintings art 2.2%

Text analysis

Amazon

HEINZ
CO.
J.
17236
H. J. HEINZ CO.
17236.
H.
19236. 17236.
19236.
JC

Google

172 36. CO H. J. HEINZ 1723
172
36.
CO
H.
J.
HEINZ
1723