Human Generated Data

Title

Untitled (three men and a woman under large umbrella)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8380

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three men and a woman under large umbrella)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.9
Apparel 99.9
Person 98.6
Human 98.6
Person 98.5
Person 98.4
Person 94.7
Person 90.1
Hat 89.7
Helmet 87.4
Face 85.8
Shirt 80.8
Female 78.8
Coat 77.8
Overcoat 77.8
Suit 77.8
Accessories 77
Tie 77
Accessory 77
Musical Instrument 76.2
Guitar 76.2
Leisure Activities 76.2
Sailor Suit 75.8
Photography 74.8
Photo 74.8
Portrait 74.8
Cake 74.5
Cream 74.5
Icing 74.5
Creme 74.5
Food 74.5
Dessert 74.5
Finger 74.4
Head 66.5
Suit 65.8
Wedding 65.8
Gown 64.9
Fashion 64.9
Robe 64.7
Sleeve 63.3
Canopy 60.8
Girl 60.3
Flower 59
Plant 59
Blossom 59
Bridegroom 57.8
Wedding Gown 57.8
Woman 57.8
Man 56.9

Imagga
created on 2022-01-09

surgeon 66.2
man 31.6
person 30.9
people 25.1
medical 23.8
nurse 23.6
coat 23.6
mask 23
male 22
lab coat 20.2
adult 18.8
doctor 17.9
professional 17.8
medicine 17.6
laboratory 17.4
portrait 16.8
scientist 16.6
worker 16
black 15.6
lab 15.5
chemistry 15.5
research 15.2
astronaut 15.2
science 15.1
clothing 14.8
hospital 14.2
biology 14.2
work 14.1
health 13.9
human 13.5
chemical 12.5
clinic 12.5
face 12.1
happy 11.9
attractive 11.2
student 11.2
men 11.2
equipment 10.7
scientific 10.7
studio 10.6
development 10.5
expression 10.2
smile 10
care 9.9
working 9.7
assistant 9.7
technology 9.7
serious 9.5
instrument 9.3
emotion 9.2
occupation 9.2
hand 9.1
pretty 9.1
danger 9.1
team 9
garment 8.8
looking 8.8
test 8.7
exam 8.6
uniform 8.6
business 8.5
study 8.4
umbrella 8.3
lady 8.1
suit 8.1
specialist 8
investigation 7.9
happiness 7.8
surgery 7.8
ruler 7.8
analysis 7.8
education 7.8
eyes 7.7
disguise 7.7
white 7.7
industry 7.7
profession 7.7
illness 7.6
sword 7.6
fun 7.5
covering 7.5
holding 7.4
patient 7.4
teenager 7.3
protection 7.3
color 7.2
lifestyle 7.2
women 7.1
businessman 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 95.3
black and white 86.4
person 84.7
man 65.6
clothing 60.4
human face 53.8
street 53
accessory 30.2

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Surprised 70.8%
Happy 19.4%
Calm 3.6%
Fear 2.5%
Sad 1.1%
Confused 0.9%
Disgusted 0.9%
Angry 0.8%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 51.8%
Sad 27.8%
Happy 7.1%
Confused 6.8%
Surprised 2.5%
Disgusted 2.1%
Angry 1%
Fear 0.9%

AWS Rekognition

Age 35-43
Gender Female, 97%
Happy 95.3%
Surprised 3.3%
Calm 0.6%
Sad 0.4%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Hat 89.7%
Helmet 87.4%
Suit 77.8%
Tie 77%
Guitar 76.2%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 55.8%
a group of people in front of a mirror posing for the camera 55.7%
a person standing in front of a mirror posing for the camera 51.2%

Text analysis

Amazon

12263.
6

Google

12263.
12263. 12263.