Human Generated Data

Title

Untitled (portrait of three girls on living room couch, Philadelphia)
Date

c. 1940, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12216
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of three girls on living room couch, Philadelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12216

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Furniture 99.5
Person 99.5
Human 99.5
Person 99.3
Person 98.8
Couch 98.2
Room 94.8
Indoors 94.8
Living Room 94.8
Woman 91.9
Child 91.9
Teen 91.9
Blonde 91.9
Girl 91.9
Kid 91.9
Female 91.9
Sitting 90.6
Apparel 81.5
Clothing 81.5
Skin 77.1
Shorts 75.8
People 61
Fireplace 56

Clarifai
created on 2019-11-16

people 99.7
child 99.2
family 99
group 98.4
portrait 97.3
woman 96.3
adult 96
offspring 95.9
baby 93.5
two 93.4
room 93
son 92.3
girl 92.1
television 92
man 91.6
love 90.4
four 89.8
sit 89.5
three 89.1
furniture 87.3

Imagga
created on 2019-11-16

kin 100
mother 34.7
people 32.9
portrait 31.7
couple 31.4
love 30.8
adult 30.4
happy 30.1
attractive 25.9
happiness 25.9
parent 24.8
male 24.3
man 24.2
sexy 24.1
dress 22.6
person 21.5
fashion 21.1
family 20.5
model 20.2
wife 19.9
pretty 18.9
smiling 18.8
lady 18.7
smile 18.5
together 18.4
bride 18.2
women 18.2
lifestyle 18.1
body 17.6
hair 16.6
face 16.3
two 16.1
cute 15.8
husband 15.5
married 15.3
child 15.1
world 14.9
wedding 14.7
romance 14.3
elegance 14.3
fun 14.2
posing 14.2
brunette 13.9
sensuality 13.6
human 12.7
black 12.6
marriage 12.3
erotic 12.3
sibling 12.3
relationship 12.2
boy 12.2
studio 12.2
sitting 12
home 12
one 11.9
father 11.9
blond 11.9
skin 11.8
sensual 11.8
cheerful 11.4
passion 11.3
groom 11.2
looking 11.2
youth 11.1
casual 11
day 11
girls 10.9
joy 10.9
dark 10.9
handsome 10.7
romantic 10.7
couch 10.6
style 10.4
bouquet 10.4
pleasure 10.4
daughter 10.3
room 10
hands 9.6
loving 9.5
men 9.4
holding 9.1
gorgeous 9.1
outdoors 9
hug 8.7
eyes 8.6
elegant 8.6
lying 8.5
lips 8.3
full 8.2
interior 8
flowers 7.8
summer 7.7
desire 7.7
expression 7.7
old 7.7
sofa 7.7
togetherness 7.6

Google
created on 2019-11-16

Photograph 96.6
People 94.7
Picture frame 91.4
Snapshot 87
Room 74.4
Photographic paper 73.1
Photography 72.5
Family 64.9
Art 62.5
Black-and-white 56.4

Microsoft
created on 2019-11-16

clothing 97.2
human face 96.3
smile 95.9
woman 87.9
person 86.1
text 78.5
dress 60.4
family 53.8
baby 53.4
posing 53.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Female, 88.2%
Fear 0.1%
Sad 11.5%
Happy 0%
Disgusted 0.2%
Calm 87.5%
Confused 0.2%
Angry 0.4%
Surprised 0.1%

AWS Rekognition

Age 4-14
Gender Female, 54.3%
Fear 45%
Calm 54.5%
Sad 45.4%
Surprised 45%
Disgusted 45%
Angry 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 16-28
Gender Female, 99.6%
Angry 2.3%
Fear 1.8%
Confused 3.7%
Calm 21.5%
Sad 3.5%
Disgusted 2.8%
Surprised 2%
Happy 62.3%

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Couch 98.2%

Categories

Imagga

people portraits 75%
paintings art 24%

Text analysis

Amazon

tes

Google

TETAAA
TETAAA