Human Generated Data

Title

Untitled (street crowded with people)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5029

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (street crowded with people)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 98.8
Crowd 95.9
Person 92.4
People 89
Person 84.9
Person 82.2
Person 81.1
Audience 80.7
Drawing 80.7
Art 80.7
Person 74.5
Parade 73.1
Person 60.9
Person 60.8
Text 60.7
Concert 58.8
Sketch 57.7
Architecture 55.9
Building 55.9
Person 44.7

Imagga
created on 2022-01-22

city 49.1
architecture 40.7
signboard 39.5
urban 35
skyline 33.3
gymnasium 31.4
scoreboard 30.8
building 29.8
cityscape 28.4
downtown 26.9
athletic facility 26.7
tower 26
structure 25.8
buildings 25.5
sky 25.5
board 22.5
facility 22.2
night 21.3
skyscraper 21.1
town 20.4
scene 19.1
travel 19
landmark 19
billboard 18.5
business 17
tourism 16.5
grunge 16.2
jigsaw puzzle 16.1
old 16
landscape 15.6
office 15.5
modern 15.4
street 14.7
tourist 14.5
drawing 14.3
light 13.4
panorama 13.4
silhouette 13.3
snow 13.2
famous 13
construction 12.8
puzzle 12.7
bridge 12.3
water 12
negative 11.9
design 11.3
metropolis 10.8
vintage 10.8
weather 10.7
film 10.5
river 10.2
skyscrapers 9.8
district 9.7
game 9.6
evening 9.3
center 9.3
lights 9.3
dirty 9
history 8.9
graphic 8.8
panoramic 8.6
dusk 8.6
industry 8.5
capital 8.5
space 8.5
sketch 8.3
retro 8.2
vacation 8.2
black 7.8
bay 7.7
power 7.6
tall 7.5
historical 7.5
house 7.5
pattern 7.5
dark 7.5
art 7.5
place 7.5
reflection 7.4
exterior 7.4
historic 7.3
industrial 7.3
sunset 7.2
representation 7.1

Google
created on 2022-01-22

Font 83.9
Line 81.6
Art 81.5
Crowd 75.7
Building 75.4
Event 72
City 71.4
Poster 70.7
Monochrome 70.7
Monochrome photography 70.2
Illustration 69.8
Pole 68.3
History 67.4
Room 66.1
Stock photography 63.9
Paper product 62.6
Public event 61.9
Urban design 60.9
Rectangle 52.6
Painting 51.8

Microsoft
created on 2022-01-22

text 99.7
person 92.5
white 79.9
old 77
black 73.9
clothing 61.8
vintage 25.1

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 98.5%
Calm 74%
Disgusted 14.2%
Happy 4.8%
Sad 2.1%
Surprised 1.9%
Confused 1.3%
Angry 0.8%
Fear 0.8%

AWS Rekognition

Age 37-45
Gender Male, 66.9%
Fear 54%
Sad 37.2%
Calm 5.7%
Disgusted 0.9%
Confused 0.7%
Happy 0.6%
Angry 0.5%
Surprised 0.5%

AWS Rekognition

Age 25-35
Gender Female, 89%
Happy 47.5%
Calm 24.9%
Sad 8.7%
Confused 4.6%
Fear 4.4%
Angry 3.8%
Disgusted 3.7%
Surprised 2.4%

AWS Rekognition

Age 30-40
Gender Male, 98.9%
Calm 56.8%
Sad 16.4%
Confused 9.7%
Angry 8.4%
Happy 3.3%
Disgusted 2.9%
Surprised 1.7%
Fear 0.8%

AWS Rekognition

Age 29-39
Gender Female, 94.3%
Calm 95.7%
Happy 2.5%
Sad 0.8%
Disgusted 0.4%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-33
Gender Male, 96.6%
Happy 39.7%
Disgusted 38.6%
Confused 5.3%
Angry 5.1%
Calm 5%
Sad 3.7%
Surprised 1.6%
Fear 0.9%

AWS Rekognition

Age 28-38
Gender Male, 89.4%
Calm 88.1%
Sad 7.4%
Happy 2.3%
Disgusted 0.9%
Confused 0.7%
Angry 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Female, 94.1%
Calm 43.1%
Sad 27.3%
Fear 9.8%
Disgusted 8.4%
Happy 7.5%
Confused 2%
Angry 1.5%
Surprised 0.5%

AWS Rekognition

Age 28-38
Gender Male, 93%
Calm 76.9%
Sad 9.5%
Happy 5.8%
Disgusted 3.5%
Angry 2.1%
Confused 0.8%
Surprised 0.7%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92.4%

Captions

Microsoft

a vintage photo of a group of people standing in front of a crowd 80.5%
a vintage photo of a group of people in front of a crowd 80.4%
a vintage photo of a crowd 80.3%

Text analysis

Amazon

DeSoto
DeSoto Hotel
Hotel
Campus
CREAM
Cradle
WEAR
ICE CREAM
OLEANDER
from Cradle & Campus
OLEA
ICE
NATIONAL
from
TERN
ION
Young
31085
&
FIRST
INFANTS
Young Colony.
BANK
Colony.
CHILDRENS
PALMER
TEENS
Serve-Cae
BN
THENS
BN SEE
EVE.
SEE

Google

DeSoto Hotel AINER FIRST Moumg Colomy INFANTS CRILDRENS BANK TEEN'S WEAR from Cradle to Campus Serve-Ea OLEA TERN ION OLEANDER ICE CREAM 31085
Moumg
Colomy
INFANTS
OLEA
from
ION
DeSoto
Hotel
AINER
FIRST
Serve-Ea
ICE
CREAM
BANK
Cradle
to
CRILDRENS
TEEN'S
WEAR
Campus
TERN
OLEANDER
31085