Human Generated Data

Title

Untitled (two men in tuxedos talking; man holds plate)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4817

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men in tuxedos talking; man holds plate)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 100
Apparel 100
Overcoat 99.1
Coat 99.1
Tie 98.5
Accessories 98.5
Accessory 98.5
Person 98.4
Human 98.4
Person 97.5
Person 96.2
Tuxedo 94.7
Tie 92.2
Shirt 91.4
Fashion 89.3
Robe 89.3
Gown 88.1
Wedding 85.7
Suit 85
Person 83.5
Bridegroom 83.4
Female 77.6
Suit 75.6
Wedding Gown 74.5
Woman 61.7
Bride 59.8
Man 59.8
Dress 59.3
Tie 57
Dress Shirt 56.5
Face 56.5
Portrait 55.6
Photography 55.6
Photo 55.6
Lab Coat 55.1

Imagga
created on 2022-01-29

lab coat 100
coat 98.4
doctor 57.5
man 50.5
medical 45.2
professional 44.3
hospital 44.3
male 41.3
garment 41
practitioner 40.3
medicine 39.7
stethoscope 36.9
clinic 36.5
job 36.4
people 36.4
person 35.8
adult 35.4
office 33
specialist 33
care 31.4
health 31.4
mature 30.8
occupation 29.4
portrait 28.6
work 27.5
business 27.4
clothing 26.8
looking 26.5
happy 26.4
businessman 25.7
elderly 24
smiling 23.9
doctors 23.7
team 23.4
indoors 22.9
patient 22.3
indoor 22
uniform 21
senior 20.7
clinical 20.6
expertise 20.4
men 19.8
handsome 19.7
desk 18.9
smile 18.6
computer 18.5
businesspeople 18.1
face 17.8
colleagues 17.5
laptop 17.4
confident 17.3
bright 17.2
nurse 17.1
working 16.8
teamwork 16.7
lifestyle 16.7
corporate 16.4
profession 16.3
casual 16.1
consultant 15.6
attractive 15.4
group 15.4
worker 15.3
executive 15.2
color 15.1
successful 14.7
30s 14.5
illness 14.3
treatment 13.8
sitting 13.8
surgeon 13.6
busy 13.5
exam 13.4
old 13.3
meeting 13.2
glasses 13
camera 13
success 12.9
general practitioner 12.9
heal 12.8
examining 12.8
mid adult 12.6
standing 12.2
table 12.1
suit 12
healing 11.9
clinician 11.9
day 11.8
diagnosis 11.8
horizontal 11.8
laboratory 11.6
talking 11.4
couple 11.4
expression 11.1
businesswoman 10.9
associates 10.8
physician 10.8
40s 10.7
examination 10.7
health care 10.7
hand 10.7
staff 10.6
together 10.5
women 10.3
two 10.2
expert 9.9
surgery 9.8
cheerful 9.8
middle aged 9.8
practice 9.7
look 9.7
confidence 9.6
shirt 9.4
necktie 9.3
human 9
explaining 8.9
medic 8.8
good mood 8.8
50s 8.8
medication 8.8
lab 8.8
daylight 8.8
older 8.8
2 8.7
brunette 8.7
light 8.7
serious 8.6
workplace 8.6
tie 8.6
modern 8.4
communication 8.4
pharmacist 8.4
holding 8.3
room 8.2
student 8.2
lady 8.1
medical instrument 8.1
40 45 years 7.9
intern 7.9
fifties 7.9
coworkers 7.9
happiness 7.9
visit 7.8
discussion 7.8
assistant 7.8
pharmacy 7.8
concentration 7.8
sick 7.7
corporation 7.7
1 7.7
formal 7.7
bow tie 7.6
technology 7.4
20s 7.4
aged 7.3
home 7.2

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

man 99.6
person 99.3
suit 97
wedding dress 93.9
text 91.6
bride 91.5
indoor 85.7
clothing 82.7
standing 77.4
old 73.1
ceremony 72.2
tie 72
wedding 71.1
human face 69.5
necktie 36.7

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 65.3%
Calm 98.4%
Sad 0.7%
Surprised 0.5%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 18-24
Gender Female, 70%
Calm 40.3%
Happy 35.3%
Fear 8.1%
Sad 5.7%
Confused 3.5%
Angry 3.5%
Disgusted 2.6%
Surprised 0.9%

AWS Rekognition

Age 40-48
Gender Female, 77.5%
Calm 64.6%
Happy 29%
Confused 3.4%
Sad 1.3%
Disgusted 0.7%
Angry 0.5%
Surprised 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.5%
Person 98.4%
Suit 85%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 80.1%
a man wearing a suit and tie 80%
a man standing in front of a mirror 79.9%

Text analysis

Amazon

10.
YT33A2
.01
sena YT33A2
sena

Google