Human Generated Data

Title

Homeless Women: The Depression, New York

Date

1932, printed 1982

People

Artist: Edward Steichen, American 1879 - 1973

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.179.20

Copyright

© The Estate of Edward Steichen / Artists Rights Society (ARS), New York

Human Generated Data

Title

Homeless Women: The Depression, New York

People

Artist: Edward Steichen, American 1879 - 1973

Date

1932, printed 1982

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.2
Human 99.2
Person 98.9
Person 98.8
Person 98.6
Person 97.7
Person 96.9
Person 96.1
Person 95.4
Person 94.7
Person 92.4
Crowd 89.6
Person 89.6
Audience 86.2
Face 84.2
Performer 82.2
People 67.3
Finger 65
Sitting 64.6
Apparel 60.5
Clothing 60.5
Photography 59.7
Photo 59.7
Portrait 59.7
Overcoat 58.7
Coat 58.7
Suit 56.7
Skin 55.4
Musician 55.2
Musical Instrument 55.2
Person 49.3
Person 43.2

Clarifai
created on 2018-02-09

people 99.9
group 99.7
many 99.1
group together 98.6
portrait 98.1
adult 98.1
music 97.2
woman 96.7
man 96.7
performance 93
theater 91.6
wear 91.5
child 91.4
musician 88.8
several 87.9
crowd 87.5
leader 85.5
dancing 84.2
adolescent 83.3
audience 82.8

Imagga
created on 2018-02-09

person 40.3
black 32.9
attractive 29.4
people 27.3
sexy 27.3
adult 24.8
dark 23.4
performer 23.1
model 22.6
fashion 21.9
pretty 21
portrait 20.7
male 20.6
lady 18.7
body 18.4
man 18.1
studio 17.5
posing 16.9
dress 16.3
style 15.6
sensual 15.5
elegant 15.4
hair 14.3
human 14.3
face 14.2
one 14.2
love 13.4
passion 13.2
brunette 13.1
lifestyle 13
seductive 12.4
women 11.9
sensuality 11.8
gorgeous 11.8
singer 11.8
entertainer 11.7
musician 11.4
dance 11.4
erotic 11.3
couple 11.3
happy 11.3
feminine 11.2
party 11.2
skin 11
make 10.9
world 10.8
looking 10.4
kin 10.4
happiness 10.2
makeup 10.1
pose 10
silhouette 9.9
night 9.8
emotional 9.7
scary 9.7
dancer 9.6
eyes 9.5
expression 9.4
clothes 9.4
elegance 9.2
slim 9.2
hand 9.2
costume 9
handsome 8.9
romantic 8.9
evil 8.8
stage 8.7
hands 8.7
clothing 8.5
energy 8.4
art 8.4
suit 8.3
horror 7.8
men 7.7
hot 7.5
holding 7.4
light 7.4
emotion 7.4
player 7.2
romance 7.1
smile 7.1
to 7.1
device 7.1
modern 7

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 96.6
people 67.3
group 62.4
posing 49.3
dark 39
night 30.1
crowd 3.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 95.4%
Calm 90.4%
Angry 1.8%
Disgusted 0.8%
Sad 3.7%
Surprised 1.4%
Confused 1.4%
Happy 0.4%

AWS Rekognition

Age 20-38
Gender Female, 99.8%
Happy 0.8%
Surprised 1.2%
Angry 3.3%
Calm 44.3%
Disgusted 2.5%
Sad 46%
Confused 1.7%

AWS Rekognition

Age 48-68
Gender Female, 57.3%
Happy 2.6%
Disgusted 3.4%
Calm 85.1%
Surprised 2.6%
Angry 2%
Sad 2.2%
Confused 2.1%

AWS Rekognition

Age 20-38
Gender Female, 96%
Happy 8%
Confused 6.4%
Angry 12.7%
Surprised 9.5%
Disgusted 4.4%
Calm 21.5%
Sad 37.6%

AWS Rekognition

Age 30-47
Gender Female, 88.9%
Sad 18.3%
Happy 1.2%
Angry 6.2%
Calm 64.4%
Surprised 2.2%
Confused 3.7%
Disgusted 4%

AWS Rekognition

Age 35-52
Gender Female, 96.3%
Happy 0.3%
Disgusted 2.4%
Confused 4.1%
Calm 11.2%
Angry 12.2%
Sad 67.9%
Surprised 1.9%

AWS Rekognition

Age 26-43
Gender Female, 89.6%
Angry 1.4%
Calm 37%
Sad 54.1%
Happy 1.1%
Confused 2.4%
Surprised 3.1%
Disgusted 0.9%

AWS Rekognition

Age 57-77
Gender Female, 94.4%
Confused 0.7%
Sad 5.6%
Calm 84.8%
Surprised 1.8%
Disgusted 4.1%
Angry 1.8%
Happy 1.1%

AWS Rekognition

Age 26-43
Gender Male, 57.9%
Happy 1.8%
Sad 15.3%
Confused 7.5%
Angry 20%
Surprised 4.8%
Calm 32.1%
Disgusted 18.6%

AWS Rekognition

Age 26-43
Gender Male, 95%
Confused 4.1%
Happy 0.8%
Surprised 13.5%
Angry 2.7%
Sad 8.2%
Calm 67.7%
Disgusted 2.9%

AWS Rekognition

Age 57-77
Gender Male, 95.5%
Disgusted 10.9%
Sad 2.2%
Calm 76.6%
Surprised 2.8%
Happy 1.1%
Confused 3.4%
Angry 2.9%

AWS Rekognition

Age 26-43
Gender Female, 99.2%
Calm 63.4%
Angry 2.4%
Disgusted 25.1%
Sad 2.9%
Surprised 1.9%
Confused 1.9%
Happy 2.4%

Microsoft Cognitive Services

Age 64
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people posing for a photo 94.3%
a group of people posing for the camera 94.2%
a group of people standing on a stage 91.2%