Human Generated Data

Title

Elisabeth Bergner, New York

Date

1935, printed 1985

People

Artist: Edward Steichen, American 1879 - 1973

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.180.3

Copyright

© The Estate of Edward Steichen / Artists Rights Society (ARS), New York

Human Generated Data

Title

Elisabeth Bergner, New York

People

Artist: Edward Steichen, American 1879 - 1973

Date

1935, printed 1985

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Apparel 100
Clothing 100
Sleeve 100
Long Sleeve 99.4
Person 96.2
Human 96.2
Sweater 75.5
Finger 75.3
Coat 64.1
Overcoat 64.1
Suit 64.1
Home Decor 59.3

Clarifai
created on 2018-02-09

portrait 99.4
people 99.4
one 99.1
adult 98.8
wear 98.6
man 97.5
woman 95.5
fashion 95.5
model 95.4
monochrome 94.7
girl 92.4
music 91.7
jacket 89.8
facial expression 88.8
fashionable 85.4
side view 83.6
pensive 83.2
profile 82.5
studio 81.9
outerwear 80.2

Imagga
created on 2018-02-09

person 47.4
suit 41.1
black 34.8
adult 33.6
portrait 32.4
man 32.3
male 30.3
people 29
face 26.3
business 24.9
professional 24.9
attractive 23.8
businessman 23
adolescent 22.9
office 22.6
clothing 21.6
fashion 20.4
hand 19.8
handsome 19.6
one 18.7
model 18.7
juvenile 18.6
confident 18.2
garment 18.2
shirt 18.1
corporate 18.1
tie 18
smile 17.8
work 17.3
casual 17
jacket 16.9
sexy 16.9
guy 16.5
job 15.9
lifestyle 15.9
executive 15.6
success 15.3
human 15
indoor 14.6
happy 14.4
looking 14.4
hair 14.3
sitting 13.8
successful 13.7
elegant 13.7
businesswoman 13.6
dark 13.4
serious 13.4
lady 13
alone 12.8
indoors 12.3
happiness 11.8
smiling 11.6
confidence 11.5
look 11.4
modern 11.2
manager 11.2
head 10.9
posing 10.7
pretty 10.5
businesspeople 10.4
standing 10.4
boy 10.4
fashionable 10.4
style 10.4
smart 10.4
men 10.3
20s 10.1
elegance 10.1
cheerful 9.8
brunette 9.6
expression 9.4
room 9.1
covering 9
planner 9
gray 9
worker 8.8
women 8.7
corporation 8.7
boss 8.6
formal 8.6
youth 8.5
one person 8.5
studio 8.4
single 8.2
necktie 8.1
body 8
sweater 7.9
1 7.7
health 7.6
only 7.6
student 7.6
chair 7.6
relaxation 7.5
trendy 7.5
holding 7.4
make 7.3
stylish 7.2
color 7.2
cute 7.2
cool 7.1

Google
created on 2018-02-09

photograph 95.9
black 95.8
white 95.8
standing 91.2
black and white 90.1
sitting 89.1
shoulder 86.8
beauty 85.6
photography 84.2
monochrome photography 80.1
outerwear 79.4
gentleman 76.1
photo shoot 73.4
girl 73
joint 72.6
portrait 68.3
arm 67.5
monochrome 67.4
neck 65.1
sleeve 63.1

Microsoft
created on 2018-02-09

person 99.9
man 97.9
wall 97

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.9%
Happy 14.4%
Disgusted 1.6%
Calm 21%
Surprised 38.2%
Angry 2.2%
Sad 10.6%
Confused 12%

Microsoft Cognitive Services

Age 14
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.2%
Suit 64.1%

Captions

Microsoft

a man looking at the camera 86%
a man wearing a black shirt 82.9%
a man in a black shirt 82.8%