Human Generated Data

Title

Untitled (two men and women looking in a glass case)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4693
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men and women looking in a glass case)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.9
Apparel 99.9
Person 99.3
Human 99.3
Tie 99.2
Accessories 99.2
Accessory 99.2
Shirt 98.7
Coat 98.7
Overcoat 98.7
Person 98.7
Tuxedo 96.8
Person 96.6
Person 96
Person 95.8
Clinic 89.3
Dress Shirt 84.9
Suit 77.5
Tie 75.6
Tie 68.4
Indoors 66.7
Person 61.9
People 56.6
Suit 51.3
Person 41.7

Imagga
created on 2022-01-29

person 53.2
man 48.4
patient 47.7
nurse 42.7
male 38.3
adult 35
doctor 34.8
professional 34.4
people 32.4
office 31.5
medical 30.9
coat 30.2
hospital 29.6
lab coat 29.4
business 26.1
mature 26
businessman 25.6
desk 25.5
men 24.9
happy 24.5
work 24.3
clinic 24.3
sick person 24.1
case 23.8
colleagues 23.3
job 23
working 23
indoors 22
health 21.5
team 21.5
casual 21.2
medicine 21.1
smiling 21
sitting 19.8
looking 19.2
indoor 19.2
meeting 18.8
color 18.4
30s 18.3
care 18.1
businesspeople 18
senior 17.8
worker 17.7
computer 17.6
occupation 17.4
businesswoman 17.3
group 16.9
portrait 16.8
smile 16.4
corporate 16.3
elderly 16.3
women 15.8
day 15.7
table 15.6
lifestyle 15.2
teamwork 14.8
coworkers 14.7
40s 14.6
laptop 14.6
mid adult 14.5
suit 14.4
bright 14.3
handsome 14.3
stethoscope 14.2
face 14.2
cheerful 13.8
associates 13.8
surgeon 13.3
room 13.1
standing 13
practitioner 12.9
doctors 12.8
home 12.8
confident 12.7
clinical 12.7
teacher 12.6
talking 12.4
education 12.1
camera 12
modern 11.9
general practitioner 11.9
50s 11.8
busy 11.6
manager 11.2
student 11.1
successful 11
executive 11
discussion 10.7
middle aged 10.7
expertise 10.7
together 10.5
attractive 10.5
clothing 10.2
two 10.2
20s 10.1
horizontal 10.1
fifties 9.8
discussing 9.8
30 35 years 9.8
good mood 9.8
consultant 9.7
older 9.7
success 9.7
laboratory 9.6
four 9.6
exam 9.6
profession 9.6
illness 9.5
happiness 9.4
light 9.4
human 9
employee 8.9
explaining 8.9
heal 8.8
60s 8.8
businessmen 8.8
thirties 8.8
staff 8.7
assistant 8.7
lab 8.7
couple 8.7
cooperation 8.7
uniform 8.6
healing 8.4
clipboard 8.4
inside 8.3
treatment 8.3
percussion instrument 8.2
classroom 8.2
technology 8.2
to 8
expert 7.9
crew 7.9
conference 7.8
old 7.7
workplace 7.6
adults 7.6
career 7.6
focus 7.4
glasses 7.4
black 7.2
golfer 7.1
musical instrument 7.1
specialist 7
look 7

Google
created on 2022-01-29

Shirt 94
Coat 87.3
Gesture 85.3
Black-and-white 84.7
Eyewear 76
Monochrome photography 74.7
Monochrome 74.5
Snapshot 74.3
Cooking 73.3
Event 73
White-collar worker 72.7
Hat 72.3
Service 71.8
Uniform 63.6
Stock photography 63
Conversation 62.1
Formal wear 61
Room 60.4
Tie 60.2
Job 53.1

Microsoft
created on 2022-01-29

person 98.6
man 94.8
text 92.5
clothing 82.9
black and white 75.2
old 54.7

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 78.3%
Calm 65.7%
Surprised 19.4%
Happy 11.1%
Fear 0.9%
Sad 0.9%
Disgusted 0.8%
Confused 0.7%
Angry 0.6%

AWS Rekognition

Age 47-53
Gender Male, 99%
Calm 94.4%
Happy 2%
Disgusted 0.8%
Angry 0.7%
Surprised 0.7%
Sad 0.5%
Fear 0.5%
Confused 0.3%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Confused 32%
Happy 30.5%
Calm 25.3%
Sad 3.9%
Surprised 2.6%
Angry 2%
Disgusted 1.9%
Fear 1.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 99.2%
Suit 77.5%

Captions

Microsoft

an old photo of a man 90.8%
old photo of a man 89.8%
a group of people posing for a photo 86.3%

Text analysis

Amazon

in
THE
AT
and
GUELLA
DE
es AT SOCIATIONS DE THE CHOCOLATE of TAIST MIA
of
СЕСИОЕВ GUELLA 8006
СЕСИОЕВ
is
de is
de
SOCIATIONS
MIA
TAIST
CHOCOLATE
8006
es

Google

ET
AT
AT OCATORSOFE ET AT RAR
RAR
OCATORSOFE