Human Generated Data

Title

Untitled (group of guests at wedding reception)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8479
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of guests at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Clothing 99.5
Apparel 99.5
Person 98.8
Human 98.8
Person 98.2
Person 97.8
Person 97.6
Accessories 95.6
Tie 95.6
Accessory 95.6
Person 93.5
Person 88.7
Coat 81.8
Lab Coat 75.4
Suit 70
Overcoat 70
Tie 69.7
Clinic 62.5
Scientist 62.2
Shirt 56.7
Lab 56.4

Imagga
created on 2022-01-15

coat 100
lab coat 100
garment 52.1
doctor 44.2
man 43.7
male 40.5
professional 39.2
medical 38.9
clothing 36
hospital 34.1
adult 30.8
people 30.7
person 30.4
nurse 26.8
clinic 25.9
medicine 24.7
business 23.7
health 23.6
businessman 23
happy 22.6
men 21.5
occupation 20.2
care 19.8
team 19.7
indoors 19.3
looking 19.2
worker 19.1
smiling 18.8
mature 18.6
office 18.5
stethoscope 18.3
portrait 18.1
work 18.1
job 17.7
patient 17.5
colleagues 17.5
bright 17.2
practitioner 17
indoor 16.5
uniform 16.4
corporate 16.3
businesspeople 16.2
working 15.9
smile 15.7
color 15.6
lab 15.6
laboratory 15.4
group 15.3
face 14.9
expertise 14.6
30s 14.4
desk 14.2
20s 13.8
confident 13.7
assistant 13.6
casual 13.6
profession 13.4
attractive 13.3
senior 13.1
standing 13.1
lifestyle 13
teamwork 13
associates 12.8
doctors 12.8
businesswoman 12.7
day 12.6
mid adult 12.6
elderly 12.5
computer 12
women 11.9
happiness 11.8
scientist 11.8
handsome 11.6
serious 11.5
suit 10.9
coworkers 10.8
clinical 10.8
40s 10.7
chemistry 10.6
research 10.5
sitting 10.3
black 10.2
two 10.2
camera 10.2
modern 9.8
50s 9.8
physician 9.8
businessmen 9.8
cheerful 9.8
consultant 9.8
corporation 9.7
exam 9.6
confidence 9.6
staff 9.6
education 9.5
ethnic 9.5
study 9.3
room 9.2
student 9.2
treatment 9.2
surgeon 9.2
human 9
general practitioner 8.9
fifties 8.9
healing 8.8
look 8.8
cooperation 8.7
light 8.7
chemical 8.7
illness 8.6
biology 8.5
old 8.4
holding 8.3
friendly 8.2
success 8.1
science 8
pharmacist 7.9
good mood 7.8
middle aged 7.8
examination 7.8
partnership 7.7
meeting 7.5
horizontal 7.5
clothes 7.5
instrument 7.4
technology 7.4
focus 7.4
successful 7.3
building 7.1
together 7

Google
created on 2022-01-15

Sleeve 87.2
Gesture 85.3
Snapshot 74.3
Font 73.2
Uniform 72.8
Monochrome photography 70
Service 69.2
Room 65.7
Monochrome 65.7
Event 65.6
Team 64.9
Illustration 61.8
Hat 59
Art 58.7
Japanese martial arts 55.2
Chef 55
Vintage clothing 52.9
Workwear 51.8
History 50.3

Microsoft
created on 2022-01-15

person 96.4
text 94.8
clothing 90.7
man 87.1
smile 73.1
drawing 58.3

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 75.6%
Surprised 11%
Confused 6.1%
Sad 2.9%
Happy 2.2%
Angry 0.9%
Disgusted 0.8%
Fear 0.5%

AWS Rekognition

Age 34-42
Gender Male, 99.1%
Calm 93.8%
Happy 2.1%
Sad 2%
Confused 1%
Disgusted 0.4%
Fear 0.3%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 49-57
Gender Male, 100%
Sad 94.2%
Confused 2.3%
Happy 1.9%
Fear 0.4%
Calm 0.3%
Disgusted 0.3%
Surprised 0.3%
Angry 0.2%

AWS Rekognition

Age 50-58
Gender Male, 99.6%
Sad 92.2%
Confused 3.5%
Disgusted 1.1%
Calm 0.9%
Happy 0.8%
Surprised 0.7%
Fear 0.5%
Angry 0.3%

AWS Rekognition

Age 36-44
Gender Female, 56.2%
Calm 66.5%
Confused 15%
Sad 8.6%
Surprised 7.6%
Happy 1.1%
Disgusted 0.5%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 53-61
Gender Male, 99.6%
Calm 47%
Sad 15.2%
Confused 10.8%
Happy 7.3%
Fear 7.1%
Angry 6.3%
Surprised 4.3%
Disgusted 2.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 95.6%
Suit 70%

Captions

Microsoft

a group of people posing for a photo 92.4%
a group of people posing for the camera 92.3%
a group of people posing for a picture 92.2%

Text analysis

Amazon

14718
30

Google

14778.
14718. 14778. NAGOX- YT3RA2-NAMT2A3
NAGOX-
14718.
YT3RA2-NAMT2A3