Human Generated Data

Title

Untitled (clown with glasses and cigar wearing graduation cap)
Date

1947
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11846
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (clown with glasses and cigar wearing graduation cap)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99
Person 99
Clothing 97.8
Apparel 97.8
Chair 89.5
Furniture 89.5
Sunglasses 87.8
Accessory 87.8
Accessories 87.8
Face 87.4
Person 70.7
Female 69.6
Portrait 69
Photography 69
Photo 69
Shorts 66.8
Finger 62.2
Sleeve 59
Text 58.8
Cushion 55.4
Pillow 55.4

Imagga
created on 2022-01-15

man 36.3
person 35.7
hat 33.1
male 32.6
clothing 30.1
umbrella 29.4
covering 29.3
mask 28
adult 25.3
people 24.5
suit 21.6
portrait 21.3
face 21.3
professional 20.4
coat 18.5
work 18
holding 17.3
worker 17.1
costume 17.1
business 16.4
hand 15.9
cap 15.8
disguise 15.6
surgeon 14.5
smile 14.2
attractive 14
black 13.8
headdress 13.6
businessman 13.2
education 13
safety 12.9
success 12.9
occupation 12.8
human 12.7
garment 12.6
comedian 12.6
happy 12.5
model 12.4
job 12.4
smiling 12.3
standing 12.2
student 12
protection 11.8
graduation 11.8
performer 11.7
medical 11.5
mortarboard 11.4
attire 11.3
gown 11.3
canopy 11.2
men 11.2
teen 11
graduate 10.8
school 10.8
guy 10.7
studio 10.6
lab coat 10.6
shelter 10.3
expression 10.2
consumer goods 10
jacket 9.9
handsome 9.8
lab 9.7
profession 9.6
university 9.6
hair 9.5
tie 9.5
rain 9.4
nurse 9.4
shirt 9.3
manager 9.3
successful 9.1
one 9
uniform 8.9
working 8.8
scientist 8.8
chemistry 8.7
laboratory 8.7
achievement 8.6
serious 8.6
research 8.6
industry 8.5
modern 8.4
head 8.4
pretty 8.4
executive 8.3
teenager 8.2
pose 8.2
entertainer 8.1
office 8
employee 8
boy 7.8
protective covering 7.8
construction 7.7
necktie 7.6
biology 7.6
fashion 7.5
style 7.4
hold 7.4
lifestyle 7.2
looking 7.2
science 7.1
posing 7.1
gun 7.1
day 7.1
medicine 7

Google
created on 2022-01-15

Street light 91.7
Hat 91
Sleeve 87.2
Coat 86.4
Style 83.9
Collar 83.4
Black-and-white 82.8
Headgear 82.1
Blazer 78.2
Formal wear 75.8
Fashion design 74.8
Vintage clothing 73
Monochrome photography 72.5
Monochrome 70.6
White-collar worker 69.6
Art 69.4
Event 69.1
Uniform 69
Sun hat 68.7
Dress shirt 67.4

Microsoft
created on 2022-01-15

text 99.5
person 96.3
black and white 94.6
fashion accessory 93.1
clothing 88.6
human face 87.4
sunglasses 81.3
glasses 79.1
man 78.6
hat 74.4
street 73.6
monochrome 64.7

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.2%
Calm 98.6%
Confused 0.5%
Happy 0.2%
Sad 0.2%
Angry 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Sunglasses 87.8%

Captions

Microsoft

a person holding an umbrella 44%
a person holding a large umbrella 35.2%
a person wearing a hat 35.1%