Human Generated Data

Title

Untitled (portrait of woman with three girls on living room couch, Phildelphia)

Date

c. 1940, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12213

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of woman with three girls on living room couch, Phildelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.5
Person 99.5
Person 99.4
Person 99.2
Furniture 98.9
Couch 96.2
Clothing 95.1
Apparel 95.1
People 93.2
Person 92.1
Room 91.8
Living Room 91.8
Indoors 91.8
Family 79.7
Cabinet 59.9
Flooring 58.1
Female 57.1

Clarifai
created on 2019-11-16

people 99.8
woman 98.9
adult 98.2
group 98
portrait 96.2
man 94.1
two 93.6
child 93.3
family 92.3
actress 92.3
furniture 91
girl 90.1
music 89.3
wear 89.2
monochrome 89.2
room 89
seat 87.2
group together 87.1
one 85.9
street 85.8

Imagga
created on 2019-11-16

kin 54.9
couple 32.2
man 31.6
adult 29.1
people 27.9
portrait 26.5
male 26.2
home 25.5
love 25.2
room 24.7
mother 22.9
together 22.8
happiness 21.9
happy 21.3
couch 21.3
person 20.1
sitting 19.8
groom 19.7
family 18.7
indoor 18.3
fashion 18.1
smiling 18.1
dress 18.1
lifestyle 18.1
interior 17.7
sexy 17.7
attractive 17.5
sofa 17.3
two 16.1
cheerful 15.4
pretty 15.4
romance 15.2
women 15
smile 14.3
relationship 14.1
father 14
parent 14
child 13.9
casual 12.7
elegance 12.6
girlfriend 12.5
married 12.5
loving 12.4
holding 12.4
chair 12.4
romantic 11.6
fun 11.2
looking 11.2
style 11.1
hair 11.1
model 10.9
hugging 10.7
husband 10.7
posing 10.7
face 10.7
boyfriend 10.6
lady 10.6
indoors 10.5
old 10.5
boy 10.4
togetherness 10.4
enjoyment 10.3
men 10.3
youth 10.2
cute 10
vintage 9.9
clothing 9.7
brother 9.7
affectionate 9.7
window 9.4
children 9.1
relaxing 9.1
son 9.1
living room 8.8
brunette 8.7
standing 8.7
bride 8.6
elegant 8.6
living 8.5
dark 8.4
human 8.2
daughter 8.2
sensual 8.2
sensuality 8.2
suit 8.1
handsome 8
kid 8
intimacy 7.9
color 7.8
domestic 7.8
luxury 7.7
30s 7.7
expression 7.7
comfortable 7.6
wife 7.6
black 7.5
house 7.5
dad 7.4
wedding 7.4
girls 7.3
group 7.3
celebration 7.2
holiday 7.2
antique 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 98.9
clothing 96.7
smile 96.6
human face 94.9
text 87.7
woman 87.6
family 79.5
furniture 78.6
couch 61.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Female, 99.5%
Fear 0.2%
Calm 94.5%
Angry 0.8%
Disgusted 1.1%
Confused 0.4%
Surprised 0.5%
Sad 0.4%
Happy 2.1%

AWS Rekognition

Age 3-9
Gender Female, 53.1%
Disgusted 45%
Fear 45%
Confused 45%
Angry 45%
Calm 54.7%
Surprised 45%
Sad 45.2%
Happy 45%

AWS Rekognition

Age 5-15
Gender Female, 55%
Sad 45.3%
Angry 45.1%
Happy 51.1%
Calm 48.1%
Fear 45.1%
Disgusted 45.2%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 2-8
Gender Female, 53.4%
Angry 45%
Happy 45%
Disgusted 45%
Surprised 45%
Fear 45%
Sad 55%
Confused 45%
Calm 45%

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Couch 96.2%

Captions

Microsoft

a person sitting on a bench posing for the camera 83.9%
a person sitting on a bench 79.9%
a man and a woman sitting on a bench 54.2%

Text analysis

Amazon

622

Google

2
612 2
612