Human Generated Data

Title

Untitled (men seated at table playing cards, while others stand watching)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4615

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men seated at table playing cards, while others stand watching)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 99.3
Person 99.1
Chair 99.1
Furniture 99.1
Person 98.9
Person 98.7
Person 98.6
Person 98.5
Person 98.4
Person 98.3
Person 97.3
Clinic 96
Person 95.3
Person 94.7
Chair 93.3
Restaurant 74.9
Cafeteria 74.2
Operating Theatre 71.4
Hospital 71.4
Clothing 64.2
Apparel 64.2
Helmet 63.9
Person 62.6
Room 61.6
Indoors 61.6
People 61.2
Hat 60
Chair 58
Table 57.5

Imagga
created on 2021-12-14

person 44.2
man 39.7
people 39.1
coat 34.2
patient 34.1
professional 33.5
male 32.6
lab coat 30.3
adult 30.3
nurse 29.6
businessman 29.1
business 27.3
colleagues 25.3
team 25.1
working 24.7
indoors 24.6
office 24.3
worker 22.4
medical 22.1
work 22
businesspeople 21.8
room 21.1
businesswoman 20.9
lab 20.4
clinic 20.4
laboratory 20.3
men 19.8
doctor 19.7
talking 19
smiling 18.8
case 18.5
shop 18.3
group 17.7
sick person 17.7
teamwork 17.6
scientist 16.7
women 16.6
sitting 16.3
happy 16.3
barbershop 16.3
20s 15.6
hospital 15.4
research 15.2
meeting 15.1
education 14.7
indoor 14.6
chemical 14.6
biology 14.2
desk 14.2
job 14.2
student 14
health 13.9
associates 13.8
corporate 13.7
clothing 13.6
casual 13.6
chemistry 13.5
30s 13.5
medicine 13.2
occupation 12.8
computer 12.8
color 12.8
face 12.8
40s 12.7
scientific 12.6
mercantile establishment 12.6
science 12.5
portrait 12.3
lifestyle 12.3
cheerful 12.2
table 12.1
day 11.8
horizontal 11.7
mid adult 11.6
four 11.5
looking 11.2
home 11.2
garment 11.1
technology 11.1
coworkers 10.8
assistant 10.7
test 10.6
couple 10.5
instrument 10.2
mature 10.2
happiness 10.2
pharmacist 10.1
confident 10
genes 9.9
care 9.9
teacher 9.8
study 9.3
manager 9.3
bright 9.3
communication 9.2
laptop 9.1
employee 8.9
boardroom 8.9
microscope 8.9
crew 8.9
chemist 8.9
discussing 8.8
experiment 8.8
together 8.8
discovery 8.8
optical 8.7
concentration 8.7
uniform 8.6
waiter 8.5
modern 8.4
place of business 8.3
suit 8.1
microbiology 7.9
biotechnology 7.8
smile 7.8
casual clothing 7.8
conference 7.8
cure 7.8
middle aged 7.8
two people 7.8
expertise 7.8
attractive 7.7
profession 7.7
development 7.6
executive 7.6
holding 7.4
newspaper 7.4
camera 7.4
health professional 7.4
inside 7.4
light 7.4
new 7.3
restaurant 7.2

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99.3
person 92.5
outdoor 90.1
chair 87.6
clothing 85.7
furniture 80.2
group 77.1
table 76.3
man 66.7
people 63.9

Face analysis

Amazon

Google

AWS Rekognition

Age 30-46
Gender Male, 90.1%
Calm 97.5%
Sad 1%
Angry 0.5%
Happy 0.5%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 41-59
Gender Male, 97.8%
Calm 99.2%
Confused 0.3%
Sad 0.2%
Angry 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 25-39
Gender Male, 94.4%
Calm 99.1%
Sad 0.3%
Angry 0.3%
Confused 0.1%
Surprised 0.1%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 39-57
Gender Male, 99.1%
Calm 99.5%
Sad 0.3%
Angry 0.1%
Confused 0.1%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 31-47
Gender Male, 95.3%
Calm 91.2%
Sad 5.5%
Angry 2.1%
Confused 0.7%
Surprised 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 23-37
Gender Female, 50.4%
Calm 75.3%
Sad 14.4%
Surprised 4.5%
Confused 4.2%
Angry 0.7%
Fear 0.4%
Happy 0.4%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 81.6%
Calm 71.3%
Happy 24.3%
Surprised 1.5%
Angry 0.8%
Confused 0.8%
Sad 0.7%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 47-65
Gender Male, 66.2%
Happy 66.7%
Calm 24.2%
Angry 5.4%
Sad 1.8%
Surprised 0.7%
Fear 0.6%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 49-67
Gender Female, 58.7%
Calm 65%
Happy 14.4%
Sad 11.1%
Confused 7.4%
Angry 0.7%
Surprised 0.7%
Disgusted 0.6%
Fear 0.1%

AWS Rekognition

Age 28-44
Gender Male, 90.6%
Sad 61.5%
Calm 30.8%
Angry 6.3%
Confused 1%
Surprised 0.2%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 99.1%
Helmet 63.9%
Hat 60%

Captions

Microsoft

a group of people in a room 96.2%
a group of people around each other 92.1%
a group of people standing in a room 92%

Text analysis

Amazon

Only
THE
Club
ATTENTION
ATTENTION PLEASE
FLOOR
PLEASE
NO
NO SPITTING ON THE FLOOR
Members
SPITTING
10739.
ON
Members Only Allewed
Slay
this
This
Allewed
le Slay 15 this Club
This Bleen live
le
live
EXECUTIVE
Bleen
15
EMERRY

Google

ATTENTION
PLEASE!
Members
te
THE
YT3RA2-NAMT2A3
10739. ATTENTION PLEASE! Members Only Alleued te Slay in this Club NO SPITTING ON THE FROOR SHEMORS 10739. YT3RA2-NAMT2A3
SPITTING
Only
Slay
in
ON
10739.
Alleued
Club
this
NO
FROOR
SHEMORS