Human Generated Data

Title

Untitled (portrait of man with pipe)

Date

c. 1930-1940, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5760

Human Generated Data

Title

Untitled (portrait of man with pipe)

People

Artist: Durette Studio, American 20th century

Date

c. 1930-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Accessories 99.4
Glasses 99.4
Accessory 99.4
Person 98.9
Human 98.9
Face 94.7
Tie 86
Overcoat 77.5
Apparel 77.5
Suit 77.5
Clothing 77.5
Coat 77.5
Advertisement 67.5
Finger 65.4
Poster 64.9
Photography 63.5
Portrait 63.5
Photo 63.5
Text 59.4
Brochure 55.3
Flyer 55.3
Paper 55.3
Head 55.2

Clarifai
created on 2019-11-16

people 99.1
portrait 98.7
adult 97.7
business 96.3
man 95.8
one 95.7
office 94.5
monochrome 93.8
eyewear 93.7
actor 92.6
eyeglasses 92.2
person 91.1
telephone 86.9
face 86.8
desktop 84
corporate 83.7
smile 81.4
work 80.9
communication 80.5
desk 79.3

Imagga
created on 2019-11-16

person 46.2
man 37.8
portrait 37.6
face 32.7
male 31.2
comedian 31
call 30.3
performer 30
people 27.4
businessman 25.6
suit 25.4
business 24.9
phone 24
adult 23.3
entertainer 21
attractive 20.3
black 18.8
expression 18.8
human 18.8
handsome 18.7
communication 18.5
confident 17.3
professional 16.9
eyes 16.4
telephone 16.4
office 16.1
head 16
looking 15.2
hair 15.1
smile 15
model 14.8
corporate 14.6
success 14.5
look 14
hand 13.8
happy 13.8
smiling 13.8
sexy 13.7
talking 13.3
tie 13.3
mobile 13.2
work 12.6
studio 12.2
sunglasses 12.1
fashion 12.1
glasses 12
lips 12
microphone 11.9
dark 11.7
eye 11.6
close 11.4
executive 11.3
guy 11.3
shirt 11.3
headset 10.6
cheerful 10.6
serious 10.5
one 10.5
support 10.3
beard 10.1
device 9.9
pretty 9.8
worker 9.8
masculine 9.8
cigarette 9.8
conversation 9.7
style 9.7
talk 9.6
men 9.5
youth 9.4
successful 9.2
modern 9.1
sensual 9.1
job 8.9
speaking 8.8
nose 8.8
cellphone 8.8
sight 8.7
makeup 8.5
manager 8.4
smoke 8.4
service 8.3
friendly 8.2
technology 8.2
cool 8
lifestyle 8
skin 7.9
tobacco 7.9
brunette 7.9
agent 7.8
smoking 7.8
cell 7.7
communicate 7.7
mouth 7.6
businesspeople 7.6
closeup 7.4
occupation 7.3
make 7.3
gray 7.2
cute 7.2
wind instrument 7.1
boy 7.1

Google
created on 2019-11-16

Photograph 95.3
Eyewear 92.1
Glasses 87.2
Black-and-white 87.2
Snapshot 82
Portrait 76.3
Lip 75.4
Monochrome 74.2
Photography 73.8
Moustache 73.4
Monochrome photography 69.6
Vision care 68.8
Mouth 67.9
Room 65.7
Self-portrait 63.6
Jaw 63
Art 62.5
Gentleman 57.3
Style 54.3
Drawing 51.1

Microsoft
created on 2019-11-16

person 99.5
man 96.9
indoor 94.3
human face 92.6
glasses 81.9
face 78.4
black and white 77.3
smile 76.9
portrait 76.8
text 70.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-56
Gender Male, 98.8%
Angry 0%
Happy 98.8%
Disgusted 0%
Sad 0%
Calm 0.2%
Surprised 0.1%
Confused 0.8%
Fear 0%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Glasses 99.4%
Person 98.9%
Tie 86%
Suit 77.5%

Captions

Microsoft

a man brushing his teeth 55.3%
a man is brushing his teeth 43.2%
a man brushing his teeth in front of a mirror posing for the camera 43.1%

Text analysis

Amazon

VCEVPVLELALITW