Human Generated Data

Title

Untitled (portrait of mother seated with young daughter with arms around each other)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12824

Human Generated Data

Title

Untitled (portrait of mother seated with young daughter with arms around each other)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 98.9
Human 98.9
Person 95.7
Face 92.3
Female 91.4
Leisure Activities 88.6
Performer 87.1
Dance Pose 84.4
Girl 76.2
Woman 74.4
People 73.5
Dance 71.9
Photography 68.8
Photo 68.8
Portrait 68.8
Poster 63.4
Advertisement 63.4
Apparel 63.3
Clothing 63.3
Hair 62.7
Finger 62
Child 61.1
Kid 61.1
Teen 59.4
Dress 55.9

Clarifai
created on 2019-11-16

people 99.8
portrait 99.5
two 99.2
woman 98.9
adult 98.2
love 97
wear 95.5
girl 95.4
wedding 95
man 94.2
child 93.9
retro 93.5
actress 93.1
couple 92.7
monochrome 92.5
son 92.5
affection 91.9
dress 90.8
music 90.6
dancer 88.7

Imagga
created on 2019-11-16

adult 35.8
attractive 35
couple 34.9
person 33.3
dancer 33.1
love 30.8
sexy 30.6
man 29.6
portrait 28.5
black 27.4
male 27.4
people 26.8
fashion 26.4
performer 25.9
model 24.9
happy 21.3
two 21.2
pretty 21
dress 20.8
dark 20.1
brunette 20.1
adolescent 19.6
dad 19.4
entertainer 18.9
happiness 18.8
body 18.4
sensual 18.2
passion 17.9
romance 17.9
face 17.8
hair 17.5
sensuality 17.3
lady 17.1
human 16.5
married 16.3
parent 16
studio 16
relationship 15.9
lifestyle 15.9
together 15.8
father 15.5
juvenile 15.3
skin 14.6
bride 14.5
youth 14.5
smiling 14.5
girlfriend 14.5
wedding 13.8
gorgeous 13.6
boyfriend 13.5
women 13.5
one 13.5
romantic 13.4
groom 13.1
sexual 12.5
erotic 12.5
boy 12.2
husband 12
joy 11.7
posing 11.6
loving 11.5
lingerie 11.4
togetherness 11.3
looking 11.2
expression 11.1
cute 10.8
lovely 10.7
look 10.5
wife 10.4
sitting 10.3
relaxation 10.1
smile 10
passionate 9.8
family 9.8
hugging 9.8
fun 9.7
hug 9.7
home 9.6
seductive 9.6
bouquet 9.4
child 9.3
lips 9.3
elegance 9.2
hand 9.1
make 9.1
world 9
hair spray 9
style 8.9
healthy 8.8
kiss 8.8
men 8.6
heterosexual 7.9
standing 7.8
bra 7.8
embracing 7.8
sex 7.8
emotional 7.8
lovers 7.8
underwear 7.7
elegant 7.7
toiletry 7.7
date 7.7
serious 7.6
bed 7.6
mother 7.5
emotion 7.4
20s 7.3
pose 7.3

Google
created on 2019-11-16

Photograph 97.1
Photographic paper 88.4
Snapshot 87.1
Picture frame 81.5
Photography 79.1
Black-and-white 74.4
Vintage clothing 73.6
Retro style 71.2
Room 65.7
Child 64.5
Stock photography 64
Mother 62.8
Portrait 62.5
Gesture 58.5
Daughter 58.1
Smile 54
Art 50.2

Microsoft
created on 2019-11-16

person 99.3
wall 99.3
human face 97.2
woman 97.1
indoor 96.7
text 96.4
smile 93.7
clothing 91.9
baby 86.8
toddler 85.4
girl 85.1
black and white 75.8
posing 62.5
picture frame 14.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 96.4%
Disgusted 0.7%
Fear 3.5%
Surprised 14.6%
Angry 1.3%
Calm 3.5%
Happy 67.5%
Confused 1.9%
Sad 6.9%

AWS Rekognition

Age 26-40
Gender Female, 99.8%
Happy 65.3%
Angry 1.4%
Disgusted 0.5%
Sad 0.5%
Surprised 0.4%
Calm 30.8%
Fear 0.1%
Confused 0.9%

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a woman standing in front of a mirror posing for the camera 84.2%
a smiling woman standing in front of a mirror posing for the camera 72.9%
woman standing in front of a mirror posing for the camera 72.8%