Human Generated Data

Title

Untitled (man shaking hands with highschool graduate)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8362
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man shaking hands with highschool graduate)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 100
Apparel 100
Person 99.1
Human 99.1
Person 97.9
Person 97.7
Robe 94.5
Fashion 94.5
Gown 93.2
Wedding 89.7
Bride 78.6
Wedding Gown 78.6
Female 77.4
Floor 72.2
Guitar 67.4
Musical Instrument 67.4
Leisure Activities 67.4
Indoors 66.6
Bridegroom 66
Photography 64.4
Photo 64.4
Evening Dress 64.1
Shoe 63.9
Footwear 63.9
Portrait 62.5
Face 62.5
Woman 60.9
Suit 59.3
Overcoat 59.3
Coat 59.3
Flooring 59.1
Furniture 58.3
Dress 57.7
Room 57.6
Long Sleeve 56.6
Sleeve 56.6
Shoe 56
Flower 56
Plant 56
Blossom 56

Imagga
created on 2022-01-09

barbershop 35.7
shop 34.5
people 32.4
man 31.6
professional 31.3
hairdresser 29.6
person 25.9
male 24.1
salon 23.4
mercantile establishment 22.2
business 21.9
office 21.7
adult 21.6
work 21.2
medical 21.2
indoors 21.1
room 19.9
corporate 18.9
men 18.9
clinic 18.8
businessman 18.5
happy 17.5
coat 16.8
worker 16
home 16
patient 15.2
interior 15
smile 15
place of business 14.9
lab coat 14.7
job 14.2
doctor 14.1
smiling 13.7
occupation 13.7
kitchen 13.5
women 13.4
clothing 13.2
hospital 12.9
inside 12
team 11.7
lifestyle 11.6
group 11.3
clothes 11.2
modern 11.2
health 11.1
portrait 11
indoor 11
nurse 10.6
working 10.6
profession 10.5
pretty 9.8
computer 9.6
talking 9.5
career 9.5
meeting 9.4
study 9.3
attractive 9.1
businesswoman 9.1
chair 9.1
medicine 8.8
looking 8.8
life 8.8
standing 8.7
laboratory 8.7
education 8.7
employee 8.7
happiness 8.6
house 8.4
teamwork 8.3
window 8.2
confident 8.2
waiter 8
couple 7.8
black 7.8
table 7.8
color 7.8
assistant 7.8
lab 7.8
colleagues 7.8
full length 7.8
sitting 7.7
uniform 7.7
casual 7.6
two 7.6
businesspeople 7.6
adults 7.6
desk 7.6
garment 7.5
building 7.5
establishment 7.5
executive 7.4
laptop 7.3
student 7.2
board 7.2
family 7.1

Google
created on 2022-01-09

Black-and-white 84.8
Monochrome photography 74.8
Monochrome 74.4
Hat 73.6
Vintage clothing 69.7
Event 67.1
Art 67.1
Room 67
Door 66.7
Stock photography 64
Service 63.9
Uniform 63.4
Nurse uniform 59.4
History 57.4
Health care provider 54.3

Microsoft
created on 2022-01-09

clothing 91.3
text 90.9
person 88
black and white 83.1
woman 65.3
dress 62.9
preparing 41.3

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 69.4%
Calm 90.7%
Surprised 4%
Sad 1.9%
Angry 0.9%
Disgusted 0.8%
Happy 0.7%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 39-47
Gender Male, 91.4%
Surprised 74.2%
Calm 13.6%
Happy 7.3%
Confused 1.7%
Sad 1.1%
Disgusted 1%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 27-37
Gender Female, 66.6%
Sad 64.1%
Calm 35.1%
Confused 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Guitar 67.4%
Shoe 63.9%

Captions

Microsoft

a man standing in a kitchen 80.7%
a man that is standing in the kitchen 77.2%
a man standing in the kitchen 77.1%