Human Generated Data

Title

Untitled (portrait of woman with three girls on living room couch, Phildelphia)

Date

c. 1940, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12212

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of woman with three girls on living room couch, Phildelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.6
Human 99.6
Furniture 99.5
Person 99.3
Person 98.5
Clothing 97.7
Apparel 97.7
Person 96.4
People 94.9
Couch 93.7
Family 87.3
Female 86.8
Person 81.9
Room 74.4
Living Room 74.4
Indoors 74.4
Woman 69.6
Footwear 68.3
Shoe 68.3
Girl 67.5
Shoe 66.8
Flooring 65.6
Shorts 59.9

Clarifai
created on 2019-11-16

people 99.8
child 98.6
woman 98.1
portrait 97.4
group 97.3
adult 97.1
two 96.8
family 95.5
girl 93.4
man 92.4
room 91.4
offspring 91.3
furniture 90.1
street 89.7
indoors 89.7
music 89.6
son 89.6
wear 89.4
actress 88.4
one 88.3

Imagga
created on 2019-11-16

kin 60.9
mother 31.4
people 26.2
adult 26
portrait 25.2
couple 23.5
man 22.2
parent 22.2
dress 21.7
home 21.5
male 20
attractive 19.6
family 19.6
happy 19.4
couch 19.3
room 19.2
love 18.9
sitting 18.9
interior 18.6
happiness 18
person 17.5
smiling 17.4
fashion 17.3
child 16.4
lifestyle 15.9
together 15.8
sexy 15.3
two 15.2
women 15
pretty 14.7
old 14.6
chair 14.2
model 14
father 13.2
indoors 13.2
hair 12.7
posing 12.4
daughter 12.4
lady 12.2
smile 12.1
indoor 11.9
style 11.9
casual 11.9
vintage 11.6
romantic 11.6
cheerful 11.4
elegant 11.1
sofa 10.6
looking 10.4
clothing 10.3
camera 10.2
cute 10
holding 9.9
retro 9.8
fun 9.7
relationship 9.4
youth 9.4
elegance 9.2
face 9.2
house 9.2
aged 9.1
romance 8.9
handsome 8.9
hugging 8.8
antique 8.8
brunette 8.7
groom 8.7
ancient 8.6
loving 8.6
son 8.5
passion 8.5
domestic 8.3
children 8.2
sensuality 8.2
brother 8.1
standing 7.8
dad 7.8
men 7.7
luxury 7.7
bride 7.7
married 7.7
adults 7.6
human 7.5
senior 7.5
one 7.5
life 7.4
playing 7.3
girls 7.3
sensual 7.3
color 7.2
kid 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 99.4
clothing 97.4
smile 95.9
sitting 94.6
human face 91.4
text 91.2
woman 87.7
furniture 80.5
posing 63.4
dress 58.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Female, 99.4%
Disgusted 0.4%
Fear 0%
Surprised 0.2%
Angry 0.6%
Calm 97.9%
Happy 0.3%
Confused 0.2%
Sad 0.4%

AWS Rekognition

Age 2-8
Gender Female, 55%
Angry 45.1%
Fear 45.3%
Disgusted 45.1%
Sad 46%
Confused 45.1%
Calm 48%
Happy 50.4%
Surprised 45.2%

AWS Rekognition

Age 3-11
Gender Female, 54.7%
Disgusted 45%
Angry 45.2%
Confused 45%
Calm 54.6%
Sad 45.2%
Happy 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 2-8
Gender Female, 54.4%
Happy 45%
Angry 45%
Disgusted 45%
Surprised 45%
Calm 54.2%
Sad 45.8%
Fear 45%
Confused 45%

Microsoft Cognitive Services

Age 47
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Couch 93.7%
Shoe 68.3%

Captions

Microsoft

a group of people sitting on a bench posing for the camera 83%
a group of people sitting posing for the camera 82.9%
a man and a woman sitting on a bench posing for the camera 68.4%

Text analysis

Amazon

6721

Google

6721
6721