Human Generated Data

Title

Untitled (crowd gathered around man on platform in department store)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4493
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd gathered around man on platform in department store)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Crowd 99
Human 99
Audience 99
Person 97.7
Person 97.6
Person 92.9
Person 86.9
People 84.5
Interior Design 83.8
Indoors 83.8
Lighting 77
Text 74.8
Coat 73.5
Overcoat 73.5
Clothing 73.5
Apparel 73.5
Suit 73.5
Person 71.7
Person 68.6
Person 67.5
Photography 61.3
Photo 61.3
Person 60.7
Face 59.7
Dress 57.1

Imagga
created on 2022-01-23

shop 26.4
mercantile establishment 23.8
business 23.7
shoe shop 23
city 20.8
stall 18.1
hall 17
design 15.7
place of business 15.6
graphic 15.3
building 15.3
art 15.3
modern 14.7
diagram 14.4
architecture 14
skyline 13.3
urban 13.1
office 13.1
success 12.9
sign 12.8
male 12.8
finance 12.7
technology 12.6
texture 12.5
cityscape 12.3
retro 12.3
people 12.3
person 11.6
pattern 11.6
financial 11.6
world 11.4
buildings 11.3
human 11.2
men 11.2
blackboard 11.1
wallpaper 10.7
businessman 10.6
conceptual 10.6
computer 10.4
man 10.2
stage 10
light 10
hand 9.9
surface 9.7
figures 9.7
scene 9.5
drawing 9.4
structure 9.4
rough 9.1
lines 9
tower 8.9
digital 8.9
new 8.9
spectator 8.9
colors 8.8
symbol 8.7
education 8.6
downtown 8.6
crowd 8.6
cloud 8.6
unique 8.5
grunge 8.5
floral 8.5
contemporary 8.5
travel 8.4
film 8.4
black 8.4
silhouette 8.3
plant 8.2
newspaper 8.1
group 8.1
idea 8
night 8
vibrant 7.9
progressive 7.9
fresh 7.8
squares 7.8
visual 7.7
circles 7.7
money 7.6
sky 7.6
chart 7.6
seamless 7.6
plants 7.4
style 7.4
grain 7.4
creation 7.3
product 7.3
global 7.3
adult 7.2
establishment 7.1
supermarket 7.1
work 7.1

Google
created on 2022-01-23

Black 89.8
Black-and-white 85.1
Style 84
Font 81.1
Adaptation 79.3
Monochrome 76.4
Monochrome photography 76.4
Crowd 76.2
Snapshot 74.3
Event 73.1
Room 64.6
Stock photography 64.1
Audience 63.9
Team 62.5
Suit 58.7
Fun 54.7
Art 53.4
History 52.6
Photo caption 51.5

Microsoft
created on 2022-01-23

text 99.2
person 97.6
clothing 86.3
people 80.4
man 79
crowd 70.5
group 60.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 14-22
Gender Male, 87.9%
Calm 66.8%
Happy 15%
Sad 9.5%
Surprised 2.5%
Fear 2.1%
Confused 2%
Angry 1.6%
Disgusted 0.5%

AWS Rekognition

Age 25-35
Gender Male, 98.6%
Calm 73.5%
Happy 10.9%
Sad 9.6%
Angry 2.2%
Fear 1.5%
Confused 1.2%
Disgusted 0.7%
Surprised 0.5%

AWS Rekognition

Age 12-20
Gender Male, 96.8%
Calm 77.6%
Happy 10.7%
Sad 4.3%
Surprised 3.1%
Confused 1.3%
Angry 1.3%
Fear 1%
Disgusted 0.6%

AWS Rekognition

Age 28-38
Gender Male, 91.4%
Calm 79.5%
Happy 11.5%
Fear 2.9%
Sad 2.2%
Disgusted 1.4%
Surprised 1.1%
Angry 1%
Confused 0.5%

AWS Rekognition

Age 28-38
Gender Male, 96%
Calm 92.1%
Sad 3.4%
Happy 3.3%
Confused 0.4%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Calm 29.3%
Surprised 20.9%
Fear 18.9%
Happy 16.8%
Sad 7.7%
Angry 3.7%
Disgusted 1.4%
Confused 1.2%

AWS Rekognition

Age 23-33
Gender Male, 97.2%
Calm 94.5%
Happy 1.9%
Sad 1.3%
Surprised 0.8%
Angry 0.7%
Fear 0.4%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Male, 62.2%
Calm 71.1%
Happy 12.9%
Sad 6.8%
Angry 2.4%
Disgusted 2%
Confused 1.9%
Fear 1.6%
Surprised 1.2%

AWS Rekognition

Age 22-30
Gender Male, 85.4%
Calm 96.8%
Surprised 0.7%
Sad 0.6%
Angry 0.6%
Happy 0.5%
Confused 0.4%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Male, 98%
Calm 54.5%
Happy 16.1%
Sad 15.1%
Angry 6.5%
Fear 2.6%
Surprised 2.2%
Disgusted 1.6%
Confused 1.5%

AWS Rekognition

Age 18-26
Gender Male, 74.8%
Calm 98.9%
Angry 0.3%
Sad 0.3%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Female, 73.1%
Happy 48.8%
Sad 30.4%
Calm 17.3%
Confused 1.1%
Surprised 0.8%
Disgusted 0.7%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 18-26
Gender Male, 57%
Calm 94.1%
Happy 3.3%
Surprised 1.1%
Sad 0.6%
Angry 0.4%
Disgusted 0.3%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.2%
Calm 98%
Happy 0.7%
Angry 0.4%
Sad 0.3%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 88.9%
Calm 46.5%
Angry 20.5%
Happy 11.2%
Sad 10.8%
Fear 3.3%
Surprised 3.1%
Disgusted 2.3%
Confused 2.2%

AWS Rekognition

Age 25-35
Gender Male, 58.3%
Calm 97.8%
Happy 0.6%
Sad 0.5%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Female, 57.1%
Calm 79.1%
Sad 9.4%
Angry 5.4%
Confused 2.3%
Happy 2%
Disgusted 0.8%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 28-38
Gender Female, 85.7%
Happy 58.5%
Calm 35.8%
Sad 1.8%
Angry 1.1%
Confused 0.8%
Disgusted 0.8%
Surprised 0.8%
Fear 0.3%

AWS Rekognition

Age 48-54
Gender Male, 91.4%
Calm 54.8%
Happy 11.9%
Disgusted 11.6%
Sad 10.4%
Confused 4.4%
Angry 3.5%
Surprised 1.9%
Fear 1.5%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Sad 35.2%
Happy 23.2%
Calm 21.7%
Angry 6.1%
Surprised 4.2%
Fear 3.9%
Disgusted 3%
Confused 2.7%

AWS Rekognition

Age 26-36
Gender Female, 59.2%
Calm 68.3%
Sad 16.6%
Happy 5.1%
Angry 3.7%
Surprised 2.6%
Confused 1.7%
Disgusted 1%
Fear 0.9%

AWS Rekognition

Age 16-22
Gender Female, 99.6%
Happy 74.2%
Calm 18.5%
Sad 3.4%
Angry 1.1%
Fear 1%
Surprised 0.7%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 20-28
Gender Male, 79.4%
Calm 30.8%
Sad 30.4%
Disgusted 12.6%
Happy 10.2%
Confused 5.3%
Surprised 4.7%
Angry 3.8%
Fear 2.2%

AWS Rekognition

Age 21-29
Gender Male, 93.2%
Sad 76.8%
Calm 12.6%
Angry 3.4%
Fear 2.9%
Happy 2.3%
Confused 0.9%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 26-36
Gender Male, 98.2%
Happy 95.6%
Calm 1.7%
Sad 1.1%
Surprised 0.5%
Confused 0.3%
Angry 0.3%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 19-27
Gender Female, 72.6%
Calm 45.3%
Fear 36.6%
Happy 6%
Disgusted 4.6%
Sad 3.7%
Surprised 2.3%
Confused 0.8%
Angry 0.7%

AWS Rekognition

Age 25-35
Gender Male, 97.2%
Calm 68.2%
Sad 12%
Angry 7.6%
Happy 5.6%
Fear 3.7%
Disgusted 1.5%
Confused 0.7%
Surprised 0.7%

AWS Rekognition

Age 30-40
Gender Female, 82.8%
Calm 94%
Sad 2%
Fear 1.6%
Happy 1.3%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%
Surprised 0.1%

AWS Rekognition

Age 11-19
Gender Female, 99.6%
Happy 36.5%
Calm 29.1%
Sad 28.4%
Fear 2.1%
Angry 1.7%
Surprised 0.9%
Disgusted 0.7%
Confused 0.6%

AWS Rekognition

Age 36-44
Gender Male, 88.4%
Calm 64.2%
Sad 27.8%
Happy 4.7%
Angry 1.2%
Confused 0.9%
Disgusted 0.6%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Calm 57.4%
Happy 23.4%
Sad 8.1%
Angry 3.6%
Confused 2.8%
Surprised 2.3%
Fear 1.5%
Disgusted 0.9%

AWS Rekognition

Age 24-34
Gender Female, 69.6%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 93.6%
Calm 69.1%
Sad 16.6%
Happy 5.5%
Angry 3.9%
Confused 1.9%
Surprised 1.3%
Fear 0.9%
Disgusted 0.7%

AWS Rekognition

Age 25-35
Gender Male, 90.4%
Calm 97%
Happy 1.8%
Sad 0.4%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%

Feature analysis

Amazon

Person 97.7%

Captions

Microsoft

a group of people standing in front of a crowd 85.4%
a group of people in front of a crowd 85.3%
a group of people standing in front of a crowd of people 83.5%

Text analysis

Amazon

SIESTA
SECOND
23311
J.
FLOOR
BRUSHES
SUNDRIES
FLOOR DEPT.
DEPT.
6
LUCCAGE
J. J. STEINMETZ. SIESTA KEY. SARASOTA, FLA
SARASOTA,
KEY.
STEINMETZ.
15
81
FLA
OFTICAL
OFTICAL DEFT
DEFT
118EZ
DELIC

Google

SECOND FLOOR 35 IOOR BEPT ARUSHES 23311 J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA:
SECOND
FLOOR
35
BEPT
ARUSHES
23311
STEINMETZ,
SARASOTA,
FLA:
IOOR
J.
SIESTA
KEY,