Human Generated Data

Title

Untitled (couple dancing at wedding reception)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12116

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple dancing at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.9
Apparel 99.9
Hat 99.5
Human 98.7
Person 98.7
Person 98.7
Accessory 96.7
Accessories 96.7
Tie 96.7
Coat 79.6
Sleeve 69.8
Face 68.2
Suit 64.2
Overcoat 64.2
Finger 62.6
Sun Hat 61.4
Text 59.8
Portrait 58.6
Photography 58.6
Photo 58.6
Long Sleeve 58

Imagga
created on 2022-01-22

doctor 49.9
man 44.4
coat 43.9
professional 42
lab coat 41.8
hospital 40.8
medical 39.8
person 39
male 37.6
medicine 34.4
clinic 32.5
office 32.2
people 30.7
job 30.1
care 29.7
adult 28.5
health 28.5
occupation 28.4
work 27.5
stethoscope 25.6
necktie 24.7
looking 24
business 23.1
bow tie 23.1
nurse 22.4
businessman 22.1
portrait 22
happy 22
patient 21.8
garment 20.8
uniform 20.2
clothing 19.7
mature 19.5
indoor 19.2
clinical 18.6
computer 18.4
worker 18.1
team 17.9
face 17.8
working 17.7
indoors 17.6
laboratory 17.4
exam 17.3
desk 17
handsome 17
smiling 16.7
glasses 15.8
doctors 15.7
expertise 15.5
confident 15.5
specialist 15.4
color 15
practitioner 14.8
student 14.6
laptop 14.6
examination 14.6
surgeon 14.4
casual 14.4
elderly 14.4
bright 14.3
businesspeople 14.2
senior 14.1
executive 14.1
men 13.8
mid adult 13.5
serious 13.4
attractive 13.3
corporate 12.9
smile 12.8
physician 12.7
consultant 12.7
lab 12.6
education 12.1
treatment 12
busy 11.6
science 11.6
profession 11.5
teamwork 11.1
diagnosis 10.8
scientist 10.8
surgery 10.8
test 10.6
30s 10.6
group 10.5
research 10.5
success 10.5
sitting 10.3
manager 10.3
day 10.2
camera 10.2
successful 10.1
horizontal 10.1
heal 9.8
modern 9.8
examining 9.8
healing 9.8
colleagues 9.7
chemistry 9.7
illness 9.5
one person 9.4
lifestyle 9.4
cheerful 8.9
general practitioner 8.9
associates 8.9
medic 8.8
middle aged 8.8
brunette 8.7
table 8.7
confidence 8.6
old 8.4
suit 8.3
room 8.3
holding 8.3
20s 8.3
pharmacist 8.2
alone 8.2
businesswoman 8.2
to 8
clinician 7.9
30 35 years 7.9
happiness 7.8
standing 7.8
health care 7.8
2 7.8
practice 7.7
1 7.7
hand 7.7
staff 7.7
only 7.6
tie 7.6
career 7.6
healthy 7.6
meeting 7.5
study 7.5
company 7.4
technology 7.4
school 7.2

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.1
book 92.3
person 91.7
black and white 87.6
human face 86.9
smile 84.8
clothing 81.2
posing 63
drawing 60.2
sketch 59.7
fashion accessory 55.5

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Female, 93.8%
Happy 95.7%
Calm 2.4%
Surprised 0.7%
Confused 0.4%
Fear 0.3%
Disgusted 0.3%
Sad 0.2%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Female, 50.4%
Calm 99.9%
Happy 0%
Sad 0%
Surprised 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.5%
Person 98.7%
Tie 96.7%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 79.5%
a person holding a book in front of a mirror posing for the camera 54.6%
a person that is standing in front of a mirror posing for the camera 54.5%

Text analysis

Amazon

7146.
MJI3
MJI3 YISHA2 A70A
A70A
YISHA2

Google

7146.
7146.