Human Generated Data

Title

Untitled (men crowded into a cigar store, New York City)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12127

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men crowded into a cigar store, New York City)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.8
Person 99.8
Person 99.3
Clothing 97.3
Apparel 97.3
Hat 97.3
Person 93.2
Sailor Suit 93.2
Person 90.6
Person 90.1
Person 86.7
Furniture 80.2
Face 78.6
Helmet 71.1
Hat 69.4
Person 67.4
Hat 62.1
Person 61.6
Crowd 55.6
Hat 55.6
Person 52.4

Imagga
created on 2022-01-22

man 41.7
male 39.7
professional 36.4
work 34.6
person 33.4
medical 31.8
coat 31.3
doctor 31
people 30.1
business 28
adult 26.7
office 24.8
job 24.8
businessman 24.7
specialist 24
medicine 22.9
hospital 22.3
worker 21.6
looking 21.6
lab 21.4
laboratory 21.2
portrait 20.7
working 20.3
men 19.8
computer 19.2
lab coat 19.2
serious 19.1
team 18.8
clinic 18.7
nurse 18.2
desk 18
scientist 17.6
occupation 17.4
health 16.7
smiling 16.6
patient 16.5
group 16.1
happy 15.7
student 15.6
face 15.6
technology 15.6
research 15.2
necktie 15.1
teamwork 14.8
care 14.8
laptop 14.6
chemistry 14.5
uniform 14.3
biology 14.2
indoors 14.1
clothing 13.6
test 13.5
manager 13
sitting 12.9
two 12.7
chemical 12.7
colleagues 12.6
exam 12.5
science 12.5
bow tie 12.4
businesspeople 12.3
pharmacist 12.3
smile 12.1
corporate 12
casual 11.9
assistant 11.7
illness 11.4
garment 11.4
surgeon 11.3
education 11.3
table 11.3
study 11.2
indoor 11
thoughtful 10.7
expertise 10.7
plan 10.4
20s 10.1
color 10
businesswoman 10
stethoscope 9.8
one 9.7
success 9.7
suit 9.6
executive 9.6
building 9.6
profession 9.6
chart 9.6
builder 9.5
senior 9.4
mature 9.3
bright 9.3
engineer 9.2
treatment 9.2
shop 9.1
confident 9.1
attractive 9.1
handsome 8.9
together 8.8
scientific 8.7
waiter 8.7
lifestyle 8.7
project 8.7
room 8.6
staff 8.6
writing 8.6
talking 8.6
meeting 8.5
modern 8.4
case 8.4
company 8.4
focus 8.3
bar 8.3
cheerful 8.1
women 7.9
look 7.9
associates 7.9
health professional 7.9
couple 7.8
standing 7.8
organizer 7.8
pensive 7.8
middle aged 7.8
sample 7.8
designer 7.7
architect 7.7
construction 7.7
formal 7.6
customer 7.6
ethnic 7.6
pencil 7.6
horizontal 7.5
shirt 7.5
alone 7.3
black 7.2
employee 7.2

Google
created on 2022-01-22

Shirt 94.7
Hat 92.5
Fedora 85.9
Black-and-white 83
Sun hat 82.3
Eyewear 79.6
Cap 79.6
Motor vehicle 78.9
Art 77.8
Font 77.2
Snapshot 74.3
T-shirt 72.8
Monochrome photography 72.7
Crew 72.2
Monochrome 71
Cowboy hat 68.7
Event 68.3
Vintage clothing 67.2
White-collar worker 66.2
Uniform 65.9

Microsoft
created on 2022-01-22

text 99.3
clothing 96.1
person 95.4
man 90.2
hat 84.8
black and white 74.1

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 88.5%
Calm 98.8%
Sad 0.7%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 98.8%
Surprised 73%
Happy 24.4%
Confused 0.9%
Sad 0.6%
Calm 0.5%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Male, 98.8%
Calm 38.9%
Confused 37.3%
Disgusted 11.3%
Surprised 5.5%
Sad 2.9%
Happy 2.6%
Angry 0.9%
Fear 0.6%

AWS Rekognition

Age 48-54
Gender Male, 99%
Calm 50.7%
Surprised 22%
Happy 19.7%
Angry 2.7%
Confused 2.6%
Disgusted 1%
Sad 0.9%
Fear 0.4%

AWS Rekognition

Age 45-53
Gender Female, 96.7%
Calm 98%
Happy 1.3%
Sad 0.4%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 31-41
Gender Female, 93.2%
Happy 97.4%
Calm 0.8%
Sad 0.8%
Surprised 0.7%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 97.3%
Helmet 71.1%

Captions

Microsoft

a group of people wearing costumes 81.4%
a group of people posing for a photo 81.3%
a group of people standing around each other 81.2%

Text analysis

Amazon

OPTIMO
light
to light up
Chesterfield
with
to
up
Time
10747.
M 117
POPPER'S
70747.
POPPER'S ACO
ACE
M 117 YEET А7А
AMOOTH
AMOOTH wanted
Berkeing
5
ACO
H.B.PERFICTO
А7А
YEET
Ross
wanted
Ross DURA
DURA

Google

10747.
up
Chesterfield
A
OPTIMO
YT3RA
2
to
PPEL
MJ1R
AA
10747. to light up with Chesterfield PPEL A OPTIMO T0747. MJ1R YT3RA 2 AA
light
T0747.
with