Human Generated Data

Title

Untitled (portrait of three girls on living room couch, Philadelphia)
Date

c. 1940, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12217
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of three girls on living room couch, Philadelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12217

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Furniture 99.7
Human 99.7
Person 99.7
Person 99.3
Person 98.3
Indoors 96.9
Living Room 96.9
Room 96.9
Couch 95.2
Apparel 91
Clothing 91
Sitting 81.5
Shorts 78.2
Female 76.4
People 69.1
Girl 59.6
Woman 59
Armchair 57.9

Clarifai
created on 2019-11-16

people 99.5
child 98.2
family 97.5
group 97.5
portrait 97
woman 95.8
adult 95.4
two 93.3
girl 92.4
offspring 91.4
man 91.2
three 89.8
room 89.4
love 89.2
baby 88.4
son 88.3
four 86
couple 85.3
sit 82.4
furniture 82.1

Imagga
created on 2019-11-16

kin 100
mother 42.2
couple 35.7
happy 32.6
love 30.8
family 30.2
male 29.5
portrait 29.1
parent 28.7
adult 28.5
people 28.4
happiness 26.6
man 26.2
smiling 24.6
together 24.5
child 23.8
women 20.6
father 20.3
lifestyle 20.2
person 20.1
dress 19
attractive 18.9
two 17.8
home 17.5
husband 17.2
smile 16.4
sitting 16.3
wife 16.1
cute 15.8
fun 15.7
holding 15.7
boy 15.6
daughter 15.6
lady 15.4
girls 14.6
relationship 14
brunette 13.9
bride 13.4
married 13.4
loving 13.4
cheerful 13
fashion 12.8
face 12.8
pretty 12.6
romance 12.5
posing 12.4
togetherness 12.3
casual 11.9
day 11.8
couch 11.6
handsome 11.6
romantic 11.6
marriage 11.4
human 11.2
sexy 11.2
outdoors 11.2
kid 10.6
world 10.6
indoors 10.5
dad 10.3
youth 10.2
wedding 10.1
room 10
joy 10
black 9.6
men 9.4
elegance 9.2
studio 9.1
group 8.9
interior 8.8
looking 8.8
hug 8.7
model 8.6
culture 8.5
dark 8.3
park 8.2
children 8.2
sensuality 8.2
groom 8.2
hair 7.9
standing 7.8
affection 7.7
30s 7.7
expression 7.7
son 7.7
sofa 7.7
sibling 7.6
style 7.4
teen 7.3
20s 7.3
teenager 7.3

Google
created on 2019-11-16

Photograph 96.7
People 94.1
Picture frame 90.4
Snapshot 86.9
Photographic paper 76
Photography 73.8
Black-and-white 68.3
Room 65.7
Family 63.8
Art 58.1
Monochrome 54.4
Vintage clothing 52.1
Style 51

Microsoft
created on 2019-11-16

smile 98.1
clothing 97.9
human face 96.8
indoor 93.1
woman 92.7
text 92.5
person 85.8
dress 85.6
old 55.7
posing 37.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 85.7%
Fear 0.1%
Happy 0.1%
Calm 91.7%
Surprised 0.1%
Disgusted 0.2%
Angry 1.7%
Sad 5.9%
Confused 0.2%

AWS Rekognition

Age 5-15
Gender Female, 99.8%
Happy 96.5%
Sad 0.5%
Disgusted 0.3%
Fear 0.2%
Calm 1.8%
Angry 0.2%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 2-8
Gender Female, 93.9%
Surprised 0%
Sad 48.7%
Disgusted 0%
Calm 51.1%
Fear 0.1%
Angry 0%
Happy 0%
Confused 0%

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Couch 95.2%

Categories

Imagga

people portraits 93.4%
paintings art 6.3%

Text analysis

Google

72
72