Human Generated Data

Title

Untitled (crowd of people gathered around "Creamette")

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5385

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people gathered around "Creamette")

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.3
Human 99.3
Person 99.3
Person 99.3
Person 99.1
Person 99
Person 99
Person 98.2
Person 97.7
Person 96.6
Person 95.5
Person 95.5
Apparel 91.9
Clothing 91.9
Person 91.3
Crowd 89.2
Person 87.4
Text 84.2
Person 83.6
Pedestrian 82.8
Person 81.2
People 80
Person 79.7
Dress 79.6
Suit 74.9
Coat 74.9
Overcoat 74.9
Person 73.8
Audience 71.5
Female 68.3
Face 66.7
Urban 65.4
Person 64.1
Shorts 56.7
Parade 56.4
Photography 55.4
Photo 55.4
Person 52.1

Imagga
created on 2022-01-23

stage 40.2
platform 31.7
sky 29.3
landscape 23.8
travel 21.1
city 20.8
cloud 17.2
architecture 16.4
spectator 15.8
flag 15.4
clouds 15.2
sport 15.2
urban 14.9
building 14
tree 13.8
scenery 13.5
person 13.2
tourist 13
lights 13
water 12.7
crowd 12.5
river 12.5
mountain 12.4
silhouette 12.4
people 11.7
gear 11.6
summer 11.6
athlete 11.3
protection 10.9
tower 10.7
bright 10.7
dangerous 10.5
forest 10.4
sea 10.3
design 10.1
park 10.1
competition 10.1
stab 9.9
coast 9.9
fencing 9.9
versus 9.9
stadium 9.8
technique 9.8
vacation 9.8
sword 9.8
cheering 9.8
nighttime 9.8
audience 9.7
championship 9.7
blade 9.7
weapon 9.7
fight 9.7
scenic 9.7
match 9.6
skill 9.6
patriotic 9.6
muscular 9.6
sharp 9.5
skyline 9.5
nation 9.5
cityscape 9.5
symbol 9.4
evening 9.3
vivid 9.3
mountains 9.3
event 9.2
training 9.2
island 9.1
ocean 9.1
outdoors 9.1
business 9.1
tourism 9.1
new 8.9
trees 8.9
vibrant 8.8
wagon 8.7
icon 8.7
grass 8.7
downtown 8.6
land 8.6
woods 8.6
hill 8.4
boat 8.4
life 8.3
landmark 8.1
scene 7.8
majestic 7.7
structure 7.7
harbor 7.7
buildings 7.6
field 7.5
house 7.5
cloudy 7.5
famous 7.4
street 7.4
stall 7.3
national 7.2
sun 7.2
night 7.1
day 7.1
rural 7
modern 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.8
clothing 97.1
person 96.5
outdoor 94
people 88.9
man 86.2
woman 69.4
crowd 61
group 60.9

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 58.6%
Confused 41.9%
Sad 24.2%
Calm 23.4%
Happy 4.4%
Fear 2.7%
Angry 1.4%
Disgusted 1.2%
Surprised 0.7%

AWS Rekognition

Age 22-30
Gender Female, 73.8%
Happy 27%
Sad 26.7%
Calm 26.5%
Angry 7.2%
Confused 7%
Fear 2.3%
Disgusted 2.1%
Surprised 1.2%

AWS Rekognition

Age 23-33
Gender Male, 97.3%
Calm 75.9%
Sad 9.1%
Angry 8.7%
Fear 1.9%
Confused 1.9%
Happy 1.6%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 18-26
Gender Female, 52.8%
Calm 87.6%
Sad 7.4%
Happy 1.8%
Fear 1.3%
Confused 0.7%
Angry 0.6%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 18-26
Gender Female, 77.8%
Calm 94.4%
Sad 2.1%
Happy 1.2%
Angry 0.6%
Surprised 0.5%
Confused 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Female, 84.9%
Calm 98.2%
Confused 0.6%
Sad 0.4%
Happy 0.2%
Disgusted 0.2%
Surprised 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 18-24
Gender Female, 94.6%
Happy 26.1%
Fear 22.8%
Sad 21.9%
Calm 13.1%
Surprised 7.5%
Disgusted 4.4%
Angry 2.8%
Confused 1.4%

AWS Rekognition

Age 24-34
Gender Male, 96.4%
Calm 98.3%
Sad 1.1%
Happy 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 12-20
Gender Female, 73.1%
Sad 64%
Calm 28.6%
Happy 3.2%
Fear 1.4%
Confused 1.2%
Angry 0.7%
Disgusted 0.5%
Surprised 0.5%

AWS Rekognition

Age 19-27
Gender Female, 88.6%
Calm 93.2%
Sad 2.1%
Happy 1.9%
Fear 0.7%
Confused 0.6%
Angry 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 26-36
Gender Female, 55.6%
Calm 70.3%
Happy 16%
Sad 5.8%
Angry 2.1%
Fear 1.9%
Confused 1.7%
Disgusted 1.4%
Surprised 0.8%

AWS Rekognition

Age 24-34
Gender Male, 58%
Calm 89.6%
Sad 5.3%
Happy 1.6%
Angry 1.1%
Confused 1.1%
Surprised 0.7%
Disgusted 0.4%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 53.8%
Calm 66.8%
Sad 22%
Happy 8.4%
Confused 1.7%
Fear 0.3%
Surprised 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 16-24
Gender Female, 99.9%
Calm 56.7%
Sad 21.3%
Fear 13.6%
Happy 5.5%
Confused 1.2%
Surprised 0.7%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 29-39
Gender Male, 67.6%
Calm 71.6%
Sad 23.4%
Happy 1.3%
Fear 1%
Confused 0.9%
Angry 0.8%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 23-33
Gender Male, 93.1%
Disgusted 38.9%
Calm 32.5%
Sad 11%
Happy 9.1%
Confused 4.4%
Angry 1.8%
Fear 1.3%
Surprised 1%

AWS Rekognition

Age 24-34
Gender Female, 55.9%
Sad 65.5%
Calm 24.9%
Confused 2.8%
Angry 2.6%
Disgusted 2%
Fear 1.1%
Happy 0.7%
Surprised 0.6%

AWS Rekognition

Age 31-41
Gender Female, 54.9%
Sad 36%
Happy 33%
Disgusted 16.1%
Calm 10.1%
Fear 1.5%
Angry 1.4%
Confused 1.1%
Surprised 0.9%

AWS Rekognition

Age 35-43
Gender Male, 56.5%
Sad 42.8%
Calm 33.3%
Confused 9.6%
Disgusted 6.1%
Surprised 3.2%
Happy 2.4%
Angry 2%
Fear 0.7%

AWS Rekognition

Age 12-20
Gender Female, 66.6%
Calm 42.5%
Sad 25.1%
Happy 20.3%
Angry 4.4%
Disgusted 2.3%
Fear 2.2%
Confused 1.9%
Surprised 1.3%

AWS Rekognition

Age 24-34
Gender Female, 68%
Calm 62.3%
Sad 10.2%
Fear 8.8%
Angry 7.1%
Happy 5%
Disgusted 2.7%
Confused 2.6%
Surprised 1.3%

AWS Rekognition

Age 23-31
Gender Female, 97.4%
Happy 67.5%
Calm 27.8%
Confused 1.5%
Sad 1.5%
Disgusted 0.5%
Angry 0.5%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 77.2%
Sad 65.3%
Calm 32.1%
Confused 1%
Happy 0.5%
Fear 0.4%
Disgusted 0.3%
Angry 0.3%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people standing in front of a crowd 94.6%
a group of people walking in front of a crowd 94.5%
a group of people standing in front of a crowd of people 93.5%

Text analysis

Amazon

CREAM
ICE CREAM
26916
ICE
Creamette
FINEST
WORLD FINEST
WORLD

Google

CRreanete IÇE CREAM 26916 26916.
IÇE
CREAM
26916.
CRreanete
26916