Human Generated Data

Title

Untitled (girl with doll)

Date

1880s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2169

Human Generated Data

Title

Untitled (girl with doll)

People

Artist: Unidentified Artist,

Date

1880s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 96.8
Person 96.1
Person 92.6
Face 92.3
Furniture 88.8
Apparel 79.9
Clothing 79.9
Drawing 75.4
Art 75.4
Floor 74.6
Photo 73.6
Portrait 73.6
Photography 73.6
Baby 72.2
Flooring 66.8
Girl 64.6
Female 64.6
Painting 60.2
Kid 58.1
Child 58.1
Chair 57.6
Sitting 57
Door 56.8
Sketch 55.4

Imagga
created on 2021-12-15

child 83.2
doll 48
plaything 39.5
portrait 35
person 33
happy 32.6
people 31.3
little 29.2
childhood 28.7
cute 28
happiness 26.7
kid 26.6
smiling 23.2
pretty 23.1
smile 21.4
love 21.3
cheerful 21.1
innocent 21
dress 20.8
adult 20.7
face 19.9
blond 19.9
joy 17.5
innocence 17.3
human 17.3
fun 17.2
toddler 17.2
family 16.9
looking 16.8
baby 16.7
adorable 16.6
one 16.4
hair 15.9
home 15.2
care 14.8
attractive 14
angel 13.7
fashion 13.6
sweet 13.4
boy 13
children 12.8
lifestyle 12.3
lady 12.2
two 11.9
mother 11.3
eyes 11.2
skin 11
day 11
elegance 10.9
sensuality 10.9
model 10.9
healthy 10.7
infant 10.6
clothing 10.6
bride 10.6
sexy 10.4
health 10.4
expression 10.2
youth 10.2
wedding 10.1
nice 10.1
girls 10
parent 10
old 9.8
together 9.6
couple 9.6
marriage 9.5
bath 9.5
joyful 9.2
holding 9.1
lovely 8.9
male 8.7
play 8.6
sitting 8.6
fresh 8.5
kids 8.5
studio 8.4
leisure 8.3
daughter 8.2
gorgeous 8.2
women 7.9
indoors 7.9
holiday 7.9
look 7.9
youthful 7.8
brunette 7.8
costume 7.8
color 7.8
wings 7.7
domestic 7.7
hand 7.6
charming 7.6
pink 7.5
clean 7.5
man 7.4
camera 7.4
alone 7.3
valentine 7.3
life 7.3
copy space 7.2
bathtub 7.2
spa 7.2

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

toddler 99
wall 98.7
human face 98.1
person 98
clothing 97.8
baby 97.5
child 93.6
text 90.7
girl 85.4
gallery 68.6
smile 54.3
posing 41.6
picture frame 24

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 98.8%
Calm 84.9%
Sad 8.7%
Fear 2.3%
Surprised 1.6%
Angry 0.9%
Confused 0.7%
Happy 0.6%
Disgusted 0.3%

AWS Rekognition

Age 14-26
Gender Female, 77.3%
Calm 60.7%
Angry 30.3%
Surprised 2.8%
Confused 2.2%
Sad 1.7%
Happy 1.1%
Disgusted 1%
Fear 0.2%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%
Painting 60.2%

Captions

Microsoft

a little girl posing for a photo 80.3%
a little girl posing for a photo in front of a window 78%
a little girl standing in front of a window 77.9%