Human Generated Data

Title

Untitled (portrait of man with pipe)

Date

c. 1930-1940, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5759

Human Generated Data

Title

Untitled (portrait of man with pipe)

People

Artist: Durette Studio, American 20th century

Date

c. 1930-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 98.9
Human 98.9
Glasses 98.5
Accessories 98.5
Accessory 98.5
Clothing 76.5
Apparel 76.5
Overcoat 76.5
Suit 76.5
Coat 76.5
Smoke Pipe 73.5
Face 60.8

Clarifai
created on 2019-11-16

people 99.3
portrait 99.3
monochrome 99.3
adult 96.6
one 95.9
eyewear 95.6
man 95.2
black and white 89.7
eyeglasses 89.1
actor 85.8
face 85
art 84.2
business 80.5
person 79.5
leader 76.3
desktop 75.4
wear 75.4
administration 72.2
office 71.1
retro 70.9

Imagga
created on 2019-11-16

person 44.1
portrait 38.9
call 35.6
face 33.4
people 29.1
attractive 27.3
adult 26.6
business 25.5
phone 23.1
man 22.6
smile 22.1
professional 22
headset 21.5
telephone 21.2
communication 21
suit 20.3
office 20.1
male 19.9
work 18.1
expression 17.9
model 17.9
businesswoman 17.3
corporate 17.2
happy 16.9
pretty 16.8
comedian 16.4
performer 16.3
support 15.5
smiling 15.2
fashion 15.1
black 14.8
eyes 14.7
confident 14.6
hair 14.3
businessman 14.1
brunette 14
cheerful 13.8
close 13.7
head 13.5
eye 13.4
lifestyle 13
friendly 12.8
looking 12.8
worker 12.5
job 12.4
look 12.3
makeup 12.2
sexy 12.1
make 11.8
agent 11.7
secretary 11.6
talk 11.5
talking 11.4
businesspeople 11.4
lady 11.4
service 11.3
microphone 11.3
success 11.3
human 11.3
lips 11.1
entertainer 10.8
handsome 10.7
conversation 10.7
studio 10.7
customer 10.5
hand 10.4
lipstick 10.1
sensual 10
receptionist 9.8
speaking 9.8
operator 9.8
mouth 9.8
one 9.7
style 9.7
sunglasses 9.6
cute 9.3
modern 9.1
helpline 8.9
consultant 8.8
center 8.8
executive 8.8
closeup 8.8
contact 8.7
staff 8.6
communicate 8.6
mobile 8.5
dark 8.4
hand glass 8.4
glasses 8.3
occupation 8.3
successful 8.2
care 8.2
necktie 8
women 7.9
representative 7.8
skin 7.7
sight 7.7
men 7.7
device 7.6
career 7.6
elegance 7.6
holding 7.4
technology 7.4
emotion 7.4
sensuality 7.3
adolescent 7.2

Google
created on 2019-11-16

Black-and-white 89
Nose 84.2
Glasses 83.4
Lip 75.4
Portrait 71.3
Photography 70.6
Mouth 67.9
Art 67.7
Monochrome photography 64.7
Monochrome 64.3
Picture frame 63.5
Eyewear 61.2
Self-portrait 59.6
Gentleman 59.6
Jaw 57.4
Style 55.5

Microsoft
created on 2019-11-16

indoor 91.8
human face 91.8
text 89.6
black and white 88.9
glasses 78.6
face 77.7
smile 77.2
person 67.9
portrait 60
man 50.4

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 32-48
Gender Male, 96.1%
Fear 0%
Disgusted 0%
Calm 0.1%
Happy 99.8%
Surprised 0%
Angry 0%
Sad 0%
Confused 0.1%

Microsoft Cognitive Services

Age 49
Gender Male

Feature analysis

Amazon

Person 98.9%
Glasses 98.5%
Suit 76.5%
Smoke Pipe 73.5%

Captions

Microsoft

a person brushing the teeth in front of a mirror posing for the camera 36.7%
a person brushing the teeth in front of a mirror 35.6%
a person brushing the teeth while looking in the mirror 31.2%

Text analysis

Amazon

YELY 2VEELALILW