Human Generated Data

Title

Untitled (four men in suits in front of Heinz display)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7429
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men in suits in front of Heinz display)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Face 99.7
Human 99.7
Smile 99.3
Apparel 99
Clothing 99
Person 97.9
Person 97.2
Overcoat 97.2
Coat 97.2
Head 96.6
Person 95.8
Accessories 93.3
Accessory 93.3
Tie 93.3
Laughing 92.6
Suit 85.2
People 82.4
Person 81.8
Person 79.4
Word 77.2
Mouth 74.5
Lip 74.5
Teeth 74.5
Photography 73.9
Photo 73.9
Portrait 73.9
Tuxedo 73.1
Man 71.3
Suit 70.8
Bridegroom 70.1
Wedding 70.1
Crowd 67.9
Female 66.2
Shirt 65
Jacket 61.2
Blazer 61.2
Selfie 59.8
Glasses 58.8
Text 58.1
Beard 57.4
Advertisement 55.1
Poster 55.1

Imagga
created on 2022-01-08

specialist 100
man 49.7
male 41.9
person 39.2
people 33.5
portrait 32.4
senior 30.9
businessman 30.9
adult 29.7
professional 29.3
surgeon 29
looking 28.8
business 24.9
happy 24.4
doctor 24.4
medical 23.8
work 23.6
mature 23.2
elderly 23
executive 21.1
office 20.9
face 20.6
men 19.8
handsome 19.6
suit 19.1
coat 19
old 18.8
hospital 18.8
health 18.8
medicine 18.5
smile 17.8
occupation 17.4
manager 16.8
smiling 16.6
tie 16.1
worker 16.1
glasses 15.7
serious 15.3
working 15
care 14.8
couple 14.8
nurse 14.7
expression 14.5
success 14.5
uniform 14.3
lab coat 13.5
team 13.4
lifestyle 13
corporate 12.9
human 12.7
gray 12.6
clinic 12.5
look 12.3
hand 12.2
hair 11.9
confident 11.8
patient 11.8
retired 11.6
laboratory 11.6
retirement 11.5
job 11.5
black 11.4
computer 11.2
attractive 11.2
technology 11.1
laptop 10.9
aged 10.9
stethoscope 10.7
expertise 10.7
modern 10.5
together 10.5
illness 10.5
desk 10.4
sitting 10.3
casual 10.2
student 10.2
groom 10.1
successful 10.1
grandfather 10.1
indoor 10
bright 10
lab 9.7
age 9.5
table 9.5
wife 9.5
shirt 9.3
indoors 8.8
older 8.7
education 8.7
profession 8.6
husband 8.6
holding 8.3
gray hair 7.9
happiness 7.8
60s 7.8
color 7.8
busy 7.7
teamwork 7.4
guy 7.4
cheerful 7.3
active 7.2
science 7.1
pensioner 7.1
day 7.1

Google
created on 2022-01-08

Smile 97.1
Photograph 94.3
Gesture 85.3
Style 83.9
Font 80
Happy 79.2
Art 78.6
Suit 78.1
Collar 75.1
Snapshot 74.3
Monochrome photography 73.2
Monochrome 69.8
Photo caption 67.6
Formal wear 65.6
Stock photography 65.5
Event 64.1
White-collar worker 62.4
Team 62.2
Crew 61.8
Laugh 61.3

Microsoft
created on 2022-01-08

text 99.6
smile 97.9
human face 97.4
man 96.7
person 94.1
book 91.6
old 81.4
clothing 80
posing 75.7

Face analysis

Amazon

AWS Rekognition

Age 26-36
Gender Male, 93.9%
Happy 71.5%
Calm 13.1%
Surprised 4.1%
Disgusted 3.8%
Sad 2.9%
Confused 1.9%
Angry 1.6%
Fear 1.1%

AWS Rekognition

Age 48-56
Gender Male, 90.1%
Happy 94.1%
Surprised 2.1%
Disgusted 1.2%
Calm 0.9%
Angry 0.6%
Fear 0.5%
Confused 0.3%
Sad 0.2%

AWS Rekognition

Age 42-50
Gender Male, 85.2%
Happy 96.9%
Calm 1.7%
Surprised 0.5%
Sad 0.5%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%
Confused 0.1%

Feature analysis

Amazon

Person 97.9%
Tie 93.3%
Suit 85.2%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 91.1%
a group of people posing for a photo 91%
a group of people posing for the camera 90.9%

Text analysis

Amazon

19284.
17284
MAGOY

Google

17284.
172
17284. 172