Human Generated Data

Title

Untitled (group of men posing in suits)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8318
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of men posing in suits)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Suit 99.7
Clothing 99.7
Overcoat 99.7
Coat 99.7
Apparel 99.7
Person 99.2
Human 99.2
Person 97.8
Person 97
Person 96.8
Tuxedo 95.8
Person 95.2
Person 91.7
Tie 82.9
Accessories 82.9
Accessory 82.9
Person 82
Chair 80
Furniture 80
Face 76.5
Shirt 75.5
Tie 71.1
Tie 69.4
Portrait 66.1
Photography 66.1
Photo 66.1
Man 65.9
Bird 62.7
Animal 62.7
Indoors 60.1
Sailor Suit 57.7
Table Lamp 57.3
Lamp 57.3

Imagga
created on 2022-01-08

doctor 52.6
person 48.3
medical 46.8
coat 46.8
nurse 46.7
man 44.4
hospital 43.5
professional 42.7
male 40.4
lab coat 39.5
stethoscope 35.6
medicine 35.2
health 32.7
clinic 31
job 31
care 29.6
people 29
team 28.7
adult 28.3
patient 27.1
happy 25.7
practitioner 25
work 23.5
portrait 23.3
uniform 22.9
doctors 22.6
looking 22.4
handsome 22.3
business 21.3
occupation 21.1
profession 21.1
worker 20.8
surgeon 20.7
smile 20.7
golfer 20.3
group 20.1
confident 20
businessman 18.5
staff 18.2
office 17.7
mature 17.7
physician 17.6
smiling 17.4
men 17.2
clinical 16.6
player 16.1
specialist 16
senior 15.9
teamwork 15.8
standing 15.6
student 14.5
friendly 13.7
case 13.2
success 12.9
successful 12.8
indoor 12.8
casual 12.7
contestant 12.7
teacher 12.5
30s 12.5
elderly 12.4
chart 12.4
illness 12.4
working 12.4
cheerful 12.2
camera 12
brass 11.9
exam 11.5
writing 11.4
positive 11.1
two 11
happiness 11
garment 11
consultant 10.7
healthy 10.7
colleagues 10.7
face 10.7
laboratory 10.6
serious 10.5
women 10.3
human 9.7
lab 9.7
indoors 9.7
clothing 9.7
mid adult 9.6
confidence 9.6
sick person 9.5
building 9.5
wind instrument 9.4
cornet 9.3
blackboard 9.2
treatment 9.2
attractive 9.1
old 9.1
suit 9
general practitioner 8.9
heal 8.8
middle aged 8.8
assistant 8.7
health care 8.7
expertise 8.7
room 8.7
lifestyle 8.7
education 8.7
bright 8.6
desk 8.5
glasses 8.3
technology 8.2
aged 8.1
science 8
interior 8
hair 7.9
clinician 7.9
surgical 7.9
healing 7.8
black 7.8
color 7.8
ill 7.8
examination 7.8
practice 7.7
partnership 7.7
research 7.6
horizontal 7.5
guy 7.5
school 7.2

Google
created on 2022-01-08

Shirt 95
Coat 87.3
Black-and-white 82.1
Smile 81.7
Sleeve 79.8
Collar 78.1
Vintage clothing 76.5
Monochrome photography 73.5
Hat 72.2
Event 71.5
Monochrome 70.7
Uniform 70.7
Formal wear 67.4
Service 66
White-collar worker 65.9
Stock photography 63.9
Room 61.3
Team 59.9
Suit 58.2
White coat 58

Microsoft
created on 2022-01-08

text 99.5
wall 95.1
posing 93.7
person 87.7
drawing 87
clothing 79.6
white 77.6
smile 68.3
black 66.6
old 65.3
sketch 57.7
man 56.4

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 99.8%
Happy 93.8%
Sad 3.6%
Angry 0.7%
Surprised 0.7%
Disgusted 0.4%
Calm 0.3%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Surprised 76.7%
Happy 20.8%
Calm 0.6%
Disgusted 0.5%
Confused 0.5%
Angry 0.4%
Sad 0.4%
Fear 0.1%

AWS Rekognition

Age 49-57
Gender Male, 87.6%
Happy 99.8%
Surprised 0.1%
Calm 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Sad 56.5%
Calm 29.9%
Confused 6.7%
Angry 3%
Happy 2.3%
Surprised 0.7%
Disgusted 0.5%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Male, 98.9%
Happy 49.6%
Surprised 18.5%
Sad 10.8%
Confused 7.8%
Calm 5.8%
Angry 4.1%
Disgusted 2.2%
Fear 1%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Happy 90.2%
Surprised 9.1%
Confused 0.2%
Calm 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 82.9%
Bird 62.7%

Captions

Microsoft

a group of people posing for a photo 97.4%
a group of people posing for a picture 97.3%
a group of people posing for the camera 97.2%

Text analysis

Amazon

10111.
ИАЧЯ
.11101
ИАЧЯ 20bE ARDA
ARDA
20bE

Google

10111.
10111.