Human Generated Data

Title

Untitled (two men in tuxedos posing for picture)
Date

1938
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7461
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men in tuxedos posing for picture)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Suit 98.6
Coat 98.6
Overcoat 98.6
Human 97
Person 97
Person 96.2
Person 96
Fashion 95.1
Robe 95.1
Accessory 95.1
Sunglasses 95.1
Accessories 95.1
Gown 95
Person 94.3
Dress 92.5
Tuxedo 92.3
Wedding 89.1
Tie 87.3
Bridegroom 86.6
Female 85.4
Wedding Gown 81
Bride 80.3
Shirt 79
Face 72.3
Woman 67.7
Evening Dress 66.8
Art 64.8
Chair 64.5
Furniture 64.5
Photo 64.5
Portrait 64.5
Photography 64.5
People 63.5
Girl 55.5

Imagga
created on 2022-01-08

coat 100
lab coat 100
garment 63.2
man 42.4
male 40.4
clothing 34.2
people 29.6
doctor 28.2
professional 26.6
businessman 26.5
person 26.4
adult 26.1
job 24.8
medical 24.7
business 23.7
hospital 21.6
work 21.2
smiling 20.3
portrait 19.4
couple 19.2
happy 18.8
nurse 17.7
looking 16.8
worker 16.8
medicine 16.7
health 16.7
occupation 16.5
corporate 16.3
team 16.1
group 15.3
businesspeople 15.2
handsome 15.2
suit 14.5
office 14.5
two 14.4
clinic 14.4
serious 14.3
attractive 14
men 13.7
stethoscope 13.6
smile 13.5
patient 12.9
bright 12.9
student 12.8
building 12.7
technology 12.6
happiness 12.5
profession 12.4
tie 12.3
manager 12.1
teamwork 12.1
confident 11.8
scientist 11.8
laboratory 11.6
black 11.4
groom 11.4
face 11.4
standing 11.3
businesswoman 10.9
holding 10.7
care 10.7
lab 10.7
working 10.6
uniform 10.5
day 10.2
indoor 10
science 9.8
expertise 9.7
chemistry 9.7
indoors 9.7
engineer 9.6
30s 9.6
staff 9.6
ethnic 9.5
women 9.5
plan 9.5
sitting 9.4
architecture 9.4
senior 9.4
mature 9.3
successful 9.2
cheerful 8.9
color 8.9
colleagues 8.7
builder 8.7
architect 8.7
mid adult 8.7
lifestyle 8.7
diversity 8.7
illness 8.6
research 8.6
desk 8.5
meeting 8.5
casual 8.5
human 8.2
20s 8.2
success 8
love 7.9
case 7.9
look 7.9
associates 7.9
education 7.8
thoughtful 7.8
partner 7.7
chemical 7.7
modern 7.7
pretty 7.7
project 7.7
partnership 7.7
elderly 7.7
biology 7.6
company 7.4
new 7.3

Google
created on 2022-01-08

Photograph 94.2
Smile 92.5
Coat 91.7
Sleeve 87.2
Eyewear 85.4
Gesture 85.3
Sunglasses 85.2
Style 83.9
Black-and-white 83.7
Collar 83.4
Art 82.9
Suit 81.5
Bow tie 81.4
Goggles 78.6
Blazer 78.3
Monochrome 75.2
Formal wear 74.7
Monochrome photography 74.7
Snapshot 74.3
Vintage clothing 72.8

Microsoft
created on 2022-01-08

text 99.7
person 98.9
suit 96.8
wedding dress 94
bride 91.2
smile 91.1
clothing 91.1
man 89.8
human face 89.1
outdoor 85.4
tie 71.4
posing 59.2
wedding 58.8
black and white 53.4
dressed 25.8
clothes 15.1

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Sad 45.5%
Confused 18.9%
Happy 17.8%
Disgusted 5.8%
Surprised 4.5%
Calm 4.3%
Angry 2%
Fear 1.2%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Happy 92.7%
Confused 2.2%
Calm 2%
Angry 0.9%
Surprised 0.8%
Disgusted 0.7%
Sad 0.6%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Male, 93.4%
Calm 100%
Happy 0%
Sad 0%
Surprised 0%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 86.2%
Calm 74.2%
Sad 19.2%
Confused 1.9%
Disgusted 1.3%
Angry 1.2%
Surprised 1.2%
Fear 0.5%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Sunglasses 95.1%
Tie 87.3%

Captions

Microsoft

a man and a woman posing for a photo 71.6%
a man and woman posing for a photo 66.2%
a man and a woman posing for a picture 66.1%

Text analysis

Amazon

8781