Human Generated Data

Title

Untitled (group of formally dressed men and a woman posed in a kitchen)
Date

c. 1945
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11660
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of formally dressed men and a woman posed in a kitchen)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.4
Human 99.4
Person 98.9
Person 98.8
Clothing 98.4
Apparel 98.4
Person 97.7
Person 97.7
Person 97
Person 93.8
Clinic 88.5
Helmet 87.7
Coat 76.8
Person 74.7
People 73.7
Face 67
Doctor 66.8
Lab Coat 65.1
Scientist 64.9
Person 63.5
Portrait 60.6
Photography 60.6
Photo 60.6
Shelter 59.2
Nature 59.2
Outdoors 59.2
Countryside 59.2
Building 59.2
Rural 59.2
Hospital 57.2
Suit 57.1
Overcoat 57.1

Imagga
created on 2022-01-15

nurse 100
doctor 49.8
medical 45.9
hospital 42.7
man 39.7
person 38.4
coat 36.2
professional 35.6
medicine 35.2
male 33.3
care 32.1
happy 31.3
health 31.3
team 30.5
clinic 30
stethoscope 29
lab coat 28.7
adult 28.1
people 27.9
doctors 25.6
uniform 23.8
patient 23.5
smiling 23.1
smile 22.1
practitioner 21.9
looking 21.6
men 21.5
occupation 21.1
worker 20.7
mature 20.5
job 20.4
group 20.2
portrait 20.1
business 20
surgeon 19.5
work 18.8
clinical 18.6
standing 18.3
staff 18.2
businessman 17.7
confident 17.3
teamwork 16.7
specialist 16.6
camera 15.7
happiness 15.7
friendly 15.6
elderly 15.3
profession 15.3
colleagues 14.6
lifestyle 14.5
handsome 14.3
golfer 14.3
indoors 14.1
casual 13.6
women 13.4
student 13.4
working 13.3
senior 13.1
two 12.7
physician 12.7
expertise 12.6
case 12.5
30s 12.5
day 11.8
consultant 11.7
laboratory 11.6
player 11.6
cheerful 11.4
healthy 11.3
couple 11.3
success 11.3
old 11.1
indoor 11
bright 10.7
face 10.7
partnership 10.6
illness 10.5
sick person 9.8
good mood 9.8
attractive 9.8
assistant 9.7
mid adult 9.6
office 9.6
teacher 9.6
confidence 9.6
color 9.5
clothing 9.4
successful 9.2
contestant 9.1
human 9
clinician 8.9
general practitioner 8.9
surgical 8.9
expert 8.9
coworkers 8.8
heal 8.8
healing 8.8
40s 8.8
ill 8.8
health care 8.7
older 8.7
building 8.7
practice 8.7
chart 8.6
corporate 8.6
black 8.4
treatment 8.3
aged 8.1
interior 8
gray hair 7.9
associates 7.9
lab 7.8
sick 7.7
diversity 7.7
hand 7.6
businesspeople 7.6
positive 7.4
businesswoman 7.3
home 7.2
hair 7.1

Google
created on 2022-01-15

Outerwear 95.1
Photograph 94.2
Black-and-white 83.6
Monochrome photography 77.3
Monochrome 76.6
Vintage clothing 74.7
Snapshot 74.3
Event 72.2
Crew 70.4
Uniform 70.3
Stock photography 68.3
Team 65.8
Fashion design 65.8
Art 64.6
Room 63.4
Service 63
History 60.8
Photo caption 55.9
Font 54.5
Visual arts 52.9

Microsoft
created on 2022-01-15

person 97
posing 91.8
text 86.9
standing 81
clothing 70.6
group 68.8
wedding dress 68.7
black and white 63.4
old 55.4
dressed 28.6
clothes 15.5

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 52.6%
Happy 59%
Confused 11.2%
Sad 7.8%
Surprised 6.5%
Disgusted 6.5%
Calm 4%
Fear 3.4%
Angry 1.6%

AWS Rekognition

Age 48-54
Gender Male, 97.1%
Happy 71.5%
Surprised 15.2%
Calm 5.6%
Sad 2.4%
Confused 1.6%
Fear 1.5%
Disgusted 1.1%
Angry 1%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Happy 79.5%
Surprised 13.4%
Confused 3.4%
Angry 1.5%
Disgusted 1%
Fear 0.6%
Sad 0.5%
Calm 0.1%

AWS Rekognition

Age 37-45
Gender Male, 89.8%
Happy 44.4%
Calm 41.3%
Surprised 8.7%
Sad 2.1%
Confused 1.2%
Disgusted 1%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 45-53
Gender Male, 99.2%
Happy 56.6%
Calm 37.8%
Surprised 1.8%
Sad 1.3%
Confused 0.8%
Fear 0.6%
Disgusted 0.6%
Angry 0.6%

AWS Rekognition

Age 30-40
Gender Female, 80.9%
Happy 64.7%
Fear 21.8%
Surprised 6.4%
Calm 4.4%
Disgusted 1.1%
Confused 0.7%
Sad 0.5%
Angry 0.5%

AWS Rekognition

Age 31-41
Gender Male, 98.6%
Calm 98.1%
Sad 0.5%
Surprised 0.4%
Happy 0.3%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Helmet 87.7%

Captions

Microsoft

a group of people posing for a photo 97.2%
a group of people posing for the camera 97.1%
a group of people posing for a picture 97%

Text analysis

Amazon

9354
9354.
A72A
MJI7
MJI7 УТЭРАЗ A72A
УТЭРАЗ

Google

9354. 9354.
9354.