Human Generated Data

Title

Untitled (two men and a woman laughing)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8461
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men and a woman laughing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Apparel 99.6
Clothing 99.6
Human 99.1
Person 99.1
Person 98.8
Person 97.5
Person 96.9
Person 93.7
Face 93.4
Person 90.4
Coat 85.2
Overcoat 85.2
Suit 85.2
Sleeve 84.8
Head 80
Accessory 74.1
Tie 74.1
Accessories 74.1
Finger 66.3
People 64.7
Senior Citizen 64.6
Photo 63.9
Portrait 63.9
Photography 63.9
Shirt 61.5
Person 55.5
Text 55.4

Imagga
created on 2022-01-15

surgeon 100
man 45
nurse 38.9
patient 34.9
person 31.7
medical 30.9
male 30.5
doctor 29.1
people 29
senior 25.3
specialist 25.1
coat 23.6
adult 22.6
hospital 22
professional 19.8
elderly 19.1
lab coat 18.9
health 18.1
work 18.1
men 18
indoors 17.6
sitting 17.2
smiling 16.6
occupation 16.5
illness 16.2
worker 16
home 15.9
happy 15.7
student 15.1
medicine 15
clinic 14.5
profession 14.4
business 14
mature 13.9
education 13.9
looking 13.6
team 13.4
working 13.3
case 13.1
portrait 12.9
camera 12.9
office 12.8
room 12.8
scientist 12.7
surgery 12.7
to 12.4
care 12.3
old 11.8
two people 11.7
chemistry 11.6
science 11.6
job 11.5
businessman 11.5
equipment 11.4
couple 11.3
sick person 11.2
happiness 11
lifestyle 10.8
70s 10.8
holding 10.7
lab 10.7
face 10.7
laboratory 10.6
30s 10.6
exam 10.5
meeting 10.4
casual 10.2
40s 9.7
research 9.5
confident 9.1
human 9
color 8.9
half length 8.8
thirties 8.8
retired 8.7
women 8.7
concentration 8.7
serious 8.6
biology 8.5
desk 8.5
horizontal 8.4
teamwork 8.3
inside 8.3
school 8.1
handsome 8
surgical 7.9
operation 7.9
facing camera 7.9
smile 7.8
mask 7.8
standing 7.8
casual clothing 7.8
assistant 7.8
sick 7.7
mid adult 7.7
stethoscope 7.7
looking camera 7.7
retirement 7.7
teacher 7.7
development 7.6
hand 7.6
college 7.6
adults 7.6
enjoyment 7.5
study 7.5
technology 7.4
20s 7.3
cheerful 7.3
bright 7.1
day 7.1

Google
created on 2022-01-15

Sleeve 86.1
Health care provider 79.9
Font 78.1
Hat 76.8
Service 72.2
Event 72
Vintage clothing 68.8
Monochrome photography 68.4
Medical 67.6
Photo caption 64.5
Scrubs 63.4
Medical assistant 62.9
History 62.5
Nurse 61.8
Room 60.4
Monochrome 59.4
Photographic paper 55.7

Microsoft
created on 2022-01-15

text 99.7
clothing 94.5
man 92.6
person 91.9
human face 89.3

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 50.6%
Happy 31.2%
Calm 22.5%
Sad 18.8%
Fear 12.3%
Disgusted 5.6%
Angry 4.8%
Confused 2.8%
Surprised 2.1%

AWS Rekognition

Age 29-39
Gender Female, 72.9%
Surprised 41.1%
Happy 33.9%
Sad 9.5%
Calm 8%
Fear 3.4%
Confused 2%
Disgusted 1.7%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 85.2%
Tie 74.1%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 63.6%
a group of people in front of a mirror posing for the camera 63.5%
a man standing in front of a mirror posing for the camera 53.2%

Text analysis

Amazon

14505
14505.
14505 A-EEA-KODA
3G
A-EEA-KODA

Google

14505. 14505. 14505 AAQONーYT33A2-MAMT2A記
14505
AAQON
記
YT33A2
MAMT2A
14505.
ー
-