Human Generated Data

Title

J. P. Morgan, New York

Date

1903, printed 1982

People

Artist: Edward Steichen, American 1879 - 1973

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.179.1

Copyright

© The Estate of Edward Steichen / Artists Rights Society (ARS), New York

Human Generated Data

Title

J. P. Morgan, New York

People

Artist: Edward Steichen, American 1879 - 1973

Date

1903, printed 1982

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Tie 99.5
Accessories 99.5
Accessory 99.5
Human 97.6
Person 97.6
Face 92.4
Apparel 86.1
Clothing 86.1
Man 85.7
Photography 69
Portrait 69
Photo 69
Coat 61.4
Overcoat 61.4
Suit 58.3

Clarifai
created on 2018-02-09

people 99.9
portrait 99.8
one 99.5
man 98.3
adult 98.2
leader 95.7
music 95.7
menswear 93
musician 92.3
profile 91.6
wear 90.5
outfit 88.1
dinner jacket 88
writer 87.4
actor 86.6
administration 85.9
side view 85.6
singer 84.3
mustache 83.5
tie 82.1

Imagga
created on 2018-02-09

man 50.4
person 50.3
male 45.4
suit 35.7
black 33.4
portrait 30.4
businessman 30
handsome 29.4
baron 27.2
executive 25
adult 24.8
people 24
business 21.9
senior 21.6
planner 21.2
confident 20.9
face 20.6
men 18.9
looking 18.4
dark 18.4
old 18.1
expression 17.9
professional 17.5
tie 16.1
elderly 15.3
jacket 14.8
clothing 14.3
necktie 13.6
human 13.5
boss 13.4
serious 13.4
shirt 13.1
manager 13
mature 13
grandfather 12.7
work 12.6
standing 12.2
older 11.7
formal 11.5
smile 11.4
studio 11.4
hands 11.3
success 11.3
modern 11.2
eyes 11.2
guy 11.1
hand 10.6
job 10.6
couple 10.5
one 10.5
love 10.3
smiling 10.1
occupation 10.1
happy 10
fashion 9.8
attractive 9.8
masculine 9.7
office 9.6
confidence 9.6
corporate 9.5
smart 9.4
speaker 9.4
glasses 9.3
head 9.2
elder 8.9
hair 8.7
lifestyle 8.7
secretary 8.4
alone 8.2
family 8
communicator 7.9
60s 7.8
model 7.8
articulator 7.7
close 7.4
closeup 7.4
posing 7.1
night 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

man 97.3
person 93.7
standing 83.9
dark 79.8
black 66
suit 64.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 96.3%
Calm 43.6%
Sad 2.8%
Happy 1%
Angry 31.7%
Surprised 5.2%
Disgusted 3.3%
Confused 12.4%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.5%
Person 97.6%
Suit 58.3%

Captions

Microsoft

a man wearing a suit and tie standing in a dark room 97.3%
a man standing in a dark room 90.6%
a man that is standing in the dark 90.5%