Human Generated Data

Title

Leslie Howard

Date

1932, printed 1985

People

Artist: Edward Steichen, American 1879 - 1973

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.180.10

Copyright

© The Estate of Edward Steichen / Artists Rights Society (ARS), New York

Human Generated Data

Title

Leslie Howard

People

Artist: Edward Steichen, American 1879 - 1973

Date

1932, printed 1985

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Clothing 99.2
Apparel 99.2
Human 98.9
Person 98.9
Hat 98
Suit 97.9
Overcoat 97.9
Coat 97.9
Finger 94.4
Performer 90.1
Face 71.7
Portrait 62.3
Photo 62.3
Photography 62.3
Magician 57.3
Tuxedo 56.7
Shirt 56.1
Sun Hat 55.1

Clarifai
created on 2018-02-09

people 99.8
portrait 99.6
adult 99.5
one 99.1
lid 99
man 98.7
facial expression 97.8
veil 97
wear 97
dinner jacket 96.7
movie 95.8
fedora 95.7
magician 94.7
outfit 92.9
cigar 92.5
menswear 91.9
actor 89.2
retro 88.2
bow tie 87.7
music 87.6

Imagga
created on 2018-02-09

person 45.6
megaphone 44.6
man 44.4
male 36.2
scholar 32.9
face 32.7
device 32.5
hat 31.1
cleaver 29.5
black 28.3
intellectual 27.3
adult 25.9
portrait 25.9
people 25.1
knife 24.2
suit 20.8
handsome 18.7
model 17.9
men 17.2
head 16.8
business 15.8
guy 15.6
clothing 15.4
looking 15.2
serious 14.3
human 14.2
businessman 14.1
studio 13.7
hand 13.7
hair 13.5
smoke 13
one 12.7
old 12.5
necktie 12.2
cutter 12.2
eyes 12.1
sexy 12
professional 11.9
work 11.8
dark 11.7
fashion 11.3
boy 11.3
attractive 11.2
expression 11.1
lifestyle 10.8
cigarette 10.7
cap 10.4
senior 10.3
shirt 10.3
smile 10
microphone 9.9
retro 9.8
eye 9.8
hands 9.6
youth 9.4
weapon 9.3
worker 9
smoking 8.8
look 8.8
elderly 8.6
manager 8.4
holding 8.3
mortarboard 8.1
closeup 8.1
job 8
smiling 8
smart 7.5
happy 7.5
beard 7.5
close 7.4
emotion 7.4

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 99.8
wall 97.3
indoor 88.3
hat 78.5
wearing 75.8
suit 60.6
posing 37.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 82%
Angry 6.5%
Disgusted 4%
Calm 70%
Happy 2.4%
Sad 8.8%
Surprised 2.2%
Confused 6%

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Hat 98%
Suit 97.9%

Captions

Microsoft

Leslie Howard wearing a hat 90.6%
Leslie Howard wearing a black hat 89%
Leslie Howard wearing a suit and hat 88.9%