Human Generated Data

Title

Untitled (crowd of people gathered around "Creamette")

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5382

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people gathered around "Creamette")

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.4
Person 99.2
Person 99.1
Person 99
Person 98.9
Person 98.6
Person 98.5
Person 98.4
Clothing 96.4
Apparel 96.4
Person 96.3
Person 95.5
Person 95
Person 94.2
Person 92
Person 91.7
Person 89.9
Crowd 87.8
Person 86.1
Person 84.3
People 83.4
Overcoat 74.2
Coat 74.2
Suit 74.2
Person 71.6
Person 70.9
Person 69.8
Fashion 66.5
Robe 66.5
Text 65.9
Gown 64.8
Wedding 64.7
Outdoors 63.4
Photography 60.7
Photo 60.7
Wedding Gown 60.2
Shorts 59.7
Nature 58.7
Bridegroom 57.6
Party 57.2
Audience 56.7
Female 56.2

Imagga
created on 2022-01-23

stage 44.6
platform 33.7
wagon 16.6
silhouette 16.5
people 16.2
city 15.8
person 14.8
crowd 14.4
sky 14
men 13.7
spectator 13.7
gymnasium 13.5
landscape 13.4
travel 13.4
business 13.3
water 12.7
black 12.6
wheeled vehicle 12.5
urban 12.2
grunge 11.9
facility 11.9
male 11.3
drawing 11.2
athletic facility 11
light 10.7
night 10.6
event 10.2
architecture 10.1
man 10.1
scene 9.5
lights 9.3
life 9.1
retro 9
design 9
building 9
skyline 8.5
modern 8.4
outdoor 8.4
vintage 8.3
human 8.2
symbol 8.1
container 8.1
group 8.1
trees 8
adult 7.9
world 7.8
rock 7.8
sport 7.7
house 7.5
tourism 7.4
art 7.3
tourist 7.2
sax 7.2
tower 7.2
mountain 7.1
room 7.1
businessman 7.1
scenic 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.7
person 98.5
clothing 97.2
man 93.1
group 70.7
people 66.5
old 46.3

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 81.4%
Calm 88%
Sad 6.3%
Happy 2.8%
Confused 2%
Angry 0.4%
Fear 0.2%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 14-22
Gender Male, 84.7%
Sad 62.9%
Calm 16.3%
Confused 15.2%
Fear 1.4%
Disgusted 1.1%
Surprised 1.1%
Angry 1.1%
Happy 0.9%

AWS Rekognition

Age 20-28
Gender Female, 93.2%
Sad 41.9%
Fear 15.8%
Confused 13.1%
Angry 10.1%
Disgusted 7.1%
Calm 4.9%
Surprised 4.3%
Happy 2.8%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 36.7%
Happy 34.8%
Sad 17.4%
Fear 3.8%
Angry 2.8%
Confused 2.4%
Surprised 1.7%
Disgusted 0.4%

AWS Rekognition

Age 23-31
Gender Female, 76.3%
Calm 48.3%
Sad 21.5%
Happy 14.6%
Confused 5.2%
Angry 4.4%
Fear 3.3%
Disgusted 1.7%
Surprised 1%

AWS Rekognition

Age 16-22
Gender Female, 61.1%
Calm 80%
Sad 14.1%
Fear 1.7%
Happy 1.6%
Angry 1.6%
Confused 0.6%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 18-24
Gender Male, 77%
Calm 72.2%
Sad 12.6%
Happy 7.5%
Confused 3.3%
Angry 2.1%
Surprised 0.9%
Fear 0.9%
Disgusted 0.5%

AWS Rekognition

Age 19-27
Gender Female, 94%
Calm 98.4%
Happy 0.9%
Sad 0.5%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 27-37
Gender Male, 94.6%
Calm 92.7%
Sad 4.4%
Confused 1.4%
Surprised 0.5%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 50.5%
Sad 59.5%
Calm 21.5%
Happy 8.2%
Confused 6.1%
Angry 1.6%
Fear 1.5%
Surprised 0.9%
Disgusted 0.7%

AWS Rekognition

Age 27-37
Gender Male, 72.8%
Calm 33%
Happy 27.4%
Confused 14.3%
Sad 10.8%
Fear 5%
Angry 3.4%
Disgusted 3.3%
Surprised 2.8%

AWS Rekognition

Age 18-26
Gender Female, 96%
Calm 64.6%
Sad 29.9%
Happy 2.4%
Angry 1.1%
Confused 1.1%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 33-41
Gender Female, 55.6%
Calm 67.6%
Sad 20%
Happy 6.4%
Confused 3.5%
Fear 0.7%
Surprised 0.7%
Disgusted 0.6%
Angry 0.6%

AWS Rekognition

Age 38-46
Gender Female, 93.7%
Happy 43.4%
Fear 23.7%
Surprised 13.8%
Sad 7.3%
Calm 6%
Confused 2.2%
Disgusted 1.8%
Angry 1.7%

AWS Rekognition

Age 28-38
Gender Female, 58.1%
Happy 37.8%
Calm 25.6%
Sad 18.5%
Confused 9.2%
Angry 2.2%
Disgusted 2.2%
Fear 2.2%
Surprised 2.1%

AWS Rekognition

Age 24-34
Gender Male, 98.9%
Sad 76.7%
Calm 10.2%
Confused 4.8%
Angry 2.9%
Happy 2.3%
Fear 1.6%
Disgusted 1%
Surprised 0.6%

AWS Rekognition

Age 20-28
Gender Female, 84.8%
Sad 28.5%
Calm 24.3%
Happy 20.8%
Fear 12.8%
Confused 7%
Angry 4%
Surprised 1.5%
Disgusted 1.3%

AWS Rekognition

Age 20-28
Gender Female, 63%
Calm 44.1%
Fear 26.2%
Sad 8.4%
Happy 8.1%
Surprised 4.7%
Angry 4.2%
Disgusted 2.4%
Confused 1.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people standing in front of a crowd 89.7%
a group of people posing for a photo 89.4%
a group of people standing in front of a crowd posing for the camera 87.3%

Text analysis

Amazon

CREAM
STEINMETZ,
SARASOTA,
FLORIDA
ICE CREAM
ICE
STEINMETZ, SARASOTA, FLORIDA 26917.
Creamettz
26917.
WORDS
26917
WORDS Fness
Fness

Google

CREAM
SARASOTA,
WORLDS
FLORIDA
WORLDS FineST ICE CREAM 26917. STEINMETZ, SARASOTA, FLORIDA 26917.
FineST
ICE
26917.
STEINMETZ,