Human Generated Data

Title

Untitled (crowd of people gathered around "Creamette")
Date

1949
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5384
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people gathered around "Creamette")

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.2
Person 99.2
Person 99
Person 98.9
Person 98.9
Person 98.8
Person 98.5
Person 98.3
Apparel 94.7
Clothing 94.7
Person 94.5
Person 92.6
Person 92.1
Person 90.2
Crowd 89.3
Person 88
Pedestrian 86.4
Person 85.5
Person 84.6
Text 84.4
People 81.1
Person 79.9
Person 79.2
Dress 74.8
Female 71
Suit 69.7
Overcoat 69.7
Coat 69.7
Person 69
Person 67.7
Face 65.8
Photography 63.4
Portrait 63.4
Photo 63.4
Audience 61.8
Bus Stop 56.6

Imagga
created on 2022-01-23

stage 36.7
platform 27.6
sky 19.8
cloud 17.2
landscape 13.4
architecture 13.3
grunge 12.8
man 12.8
business 12.7
city 11.6
silhouette 11.6
drawing 11.4
people 11.1
clouds 11
person 11
light 10
sax 10
travel 9.8
businessman 9.7
water 9.3
evening 9.3
male 9.2
old 9
tower 8.9
symbol 8.7
urban 8.7
black 8.4
event 8.3
building 8.3
sign 8.3
outfit 8.1
history 8
success 8
night 8
structure 8
scenic 7.9
forest 7.8
scene 7.8
outside 7.7
downtown 7.7
dark 7.5
cloudy 7.5
famous 7.4
wagon 7.4
spectator 7.3
design 7.3
new 7.3
group 7.2
scenery 7.2
team 7.2

Google
created on 2022-01-23

Outerwear 95.1
Photograph 94.3
Style 83.8
Font 82
Art 80
Crowd 75
Snapshot 74.3
Vintage clothing 72
Event 71.1
Monochrome photography 70.9
Monochrome 69.2
Design 68.4
Stock photography 67.5
Illustration 67.2
Poster 66.9
History 65.8
Paper product 61.6
Suit 59.8
Room 58.6
Visual arts 55.5

Microsoft
created on 2022-01-23

text 99.6
person 98.3
clothing 98.2
outdoor 91.7
man 84.9
people 84.2
standing 83.7
woman 70.3
group 69.4
crowd 30.9

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 85.9%
Sad 80.5%
Calm 17.5%
Confused 0.8%
Happy 0.5%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 23-33
Gender Female, 55.4%
Calm 99.2%
Sad 0.5%
Fear 0.1%
Confused 0%
Happy 0%
Disgusted 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 16-24
Gender Female, 63.7%
Calm 80.3%
Sad 10.6%
Happy 3.9%
Fear 1.8%
Confused 1.2%
Angry 1.1%
Surprised 0.8%
Disgusted 0.3%

AWS Rekognition

Age 23-31
Gender Male, 85.6%
Calm 99.9%
Sad 0%
Disgusted 0%
Happy 0%
Confused 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 77.2%
Calm 52.1%
Fear 36.2%
Sad 4.6%
Happy 2.3%
Confused 1.7%
Disgusted 1.2%
Surprised 1%
Angry 0.8%

AWS Rekognition

Age 36-44
Gender Male, 91.9%
Calm 98.5%
Happy 0.6%
Sad 0.4%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 86%
Calm 98.5%
Sad 0.5%
Confused 0.4%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Female, 81.8%
Calm 76.4%
Sad 17.9%
Confused 2.3%
Happy 1.2%
Angry 0.9%
Fear 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 27-37
Gender Female, 76.9%
Sad 83.7%
Calm 15%
Confused 0.9%
Fear 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 23-31
Gender Female, 80.5%
Calm 87.7%
Sad 7.1%
Fear 1.8%
Happy 1.7%
Angry 0.5%
Confused 0.5%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 20-28
Gender Male, 76.1%
Calm 97%
Sad 1.6%
Happy 0.5%
Confused 0.3%
Angry 0.3%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Female, 53.4%
Sad 51.4%
Happy 27.2%
Calm 8.3%
Confused 6.1%
Disgusted 2%
Surprised 1.9%
Angry 1.6%
Fear 1.4%

AWS Rekognition

Age 23-31
Gender Female, 58.2%
Calm 99%
Angry 0.4%
Sad 0.2%
Happy 0.2%
Confused 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 86.7%
Calm 80.2%
Sad 5.4%
Happy 3.7%
Fear 3.3%
Confused 2.5%
Angry 1.9%
Surprised 1.8%
Disgusted 1.2%

AWS Rekognition

Age 19-27
Gender Female, 56.2%
Calm 73.3%
Fear 10.8%
Sad 5.6%
Happy 4.3%
Angry 2.4%
Confused 1.6%
Disgusted 1.3%
Surprised 0.6%

AWS Rekognition

Age 23-31
Gender Female, 72.2%
Calm 58.6%
Sad 31.7%
Happy 3.7%
Confused 3.6%
Angry 1.1%
Disgusted 0.6%
Fear 0.5%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people standing in front of a crowd 93.6%
a group of people standing in front of a crowd of people 92.3%
a group of people standing in a crowd 90.5%

Text analysis

Amazon

ICE
ICE CREAM
CREAM
26918
FIREST
WORLDS FIREST
WORLDS
Creamelle

Google

FIREST
CREAM
26918-
26918.
ICE
lORIUS FIREST ICE CREAM 26918- 26918.
lORIUS