Human Generated Data

Title

Untitled (head shot of child facing front with shoulder length hair)

Date

1866-1899

People

Artist: J. Schloss, American active mid-19th to early-20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4041

Human Generated Data

Title

Untitled (head shot of child facing front with shoulder length hair)

People

Artist: J. Schloss, American active mid-19th to early-20th century

Date

1866-1899

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Clothing 96.4
Apparel 96.4
Bonnet 93.1
Hat 93.1
Human 89
Face 89
Art 78.8
Head 72.2
Person 64.3
Photography 60.5
Photo 60.5
Portrait 60.5
Drawing 56.5
Canvas 55.9

Clarifai
created on 2019-11-10

people 98.4
portrait 96.3
retro 95.9
one 94.8
woman 93.5
adult 93.2
paper 90.9
wear 90.5
girl 90.4
art 90
blank 89.1
vintage 82.6
child 80.7
facial expression 79.5
empty 78.3
nostalgia 76.2
desktop 75.8
card 75.6
note 73.4
old 71.6

Imagga
created on 2019-11-10

doll 79.3
child 68.2
plaything 61.7
portrait 37.5
blond 32.6
cute 32.3
face 32
person 31.3
people 25.7
happy 25.1
pretty 23.1
little 23
eyes 22.4
attractive 21
smiling 21
hair 20.6
model 20.2
adult 20.1
childhood 19.7
smile 19.2
skin 18.7
happiness 18
expression 17.1
baby 16.4
cheerful 16.3
kid 16
adorable 15.7
sexy 15.3
looking 15.2
fashion 15.1
love 14.2
lady 13.8
toddler 13.4
holding 12.4
look 12.3
boy 12.2
studio 12.2
human 12
body 12
innocent 11.9
two 11.9
lovely 11.6
mother 11.4
hairstyle 11.4
fun 11.2
home 11.2
lips 11.1
makeup 11
joy 10.9
family 10.7
head 10.1
healthy 10.1
dress 9.9
care 9.9
one 9.7
erotic 9.5
youth 9.4
clean 9.2
girls 9.1
copy space 9
women 8.7
hands 8.7
bath 8.5
clothing 8.5
black 8.4
daughter 8.4
health 8.3
camera 8.3
teenager 8.2
sensual 8.2
sensuality 8.2
style 8.2
posing 8
lifestyle 8
together 7.9
sitting 7.7
naked 7.7
innocence 7.7
hand 7.6
playful 7.6
pink 7.5
feminine 7.5
emotion 7.4
teen 7.4
joyful 7.4
male 7.3
gorgeous 7.3
sweet 7.1
indoors 7

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

human face 99.4
person 98.4
clothing 93
drawing 90.1
sketch 88.6
portrait 85.9
text 78.8
woman 78.8
painting 76.7
white 65.3
girl 58.5
smile 58.1
dessert 35.8
envelope 32.5
picture frame 10.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Female, 85%
Surprised 0.1%
Happy 0.2%
Angry 0.3%
Disgusted 0.1%
Calm 99%
Sad 0.3%
Fear 0%
Confused 0.1%

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 64.3%

Captions

Microsoft

a black and white photo of a box 45.2%
a close up of a box 45.1%
a white box 41.6%