Human Generated Data

Title

Untitled (portrait of a girl and doll)

Date

1860s

People

Artist: Jordan & Co., American active 1860s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2690

Human Generated Data

Title

Untitled (portrait of a girl and doll)

People

Artist: Jordan & Co., American active 1860s

Date

1860s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 94.7
Person 94.7
Apparel 88.8
Clothing 88.8
Furniture 84.9
Person 75.8
People 64.7
Advertisement 61.8
Poster 61.8
Cushion 55.9

Imagga
created on 2021-12-14

child 38.9
person 28.7
portrait 23.9
kid 23
people 22.9
happy 21.9
cute 20.8
adult 20.1
face 19.2
attractive 18.9
sexy 17.7
childhood 17
doll 16.9
hair 16.6
boy 16.5
pretty 16.1
little 15.9
fashion 15.8
model 15.6
youth 15.3
family 15.1
smile 15
happiness 14.9
one 14.2
plaything 14
male 14
casual 13.6
dress 13.6
lady 13
black 12.8
fun 12.7
mother 12.4
blond 12.3
man 12.1
clothing 11.9
smiling 11.6
brother 11.4
cheerful 11.4
home 11.2
vintage 10.8
human 10.5
looking 10.4
style 10.4
expression 10.2
lifestyle 10.1
children 10
holding 9.9
posing 9.8
old 9.8
interior 9.7
indoors 9.7
brunette 9.6
play 9.5
gift 9.5
sitting 9.4
sibling 9.2
makeup 9.2
parent 9.1
girls 9.1
playing 9.1
gorgeous 9.1
elegant 8.6
studio 8.4
20s 8.2
indoor 8.2
sensual 8.2
stylish 8.1
daughter 8.1
look 7.9
standing 7.8
hands 7.8
world 7.8
couch 7.7
glamor 7.7
fashionable 7.6
healthy 7.6
house 7.5
retro 7.4
decoration 7.3
make 7.3
pose 7.3
holiday 7.2
love 7.1

Google
created on 2021-12-14

Outerwear 95.3
Tartan 82.7
Sleeve 79.6
Vintage clothing 79.2
People 77.8
One-piece garment 73.2
Pattern 72.6
Classic 72
Plaid 71.3
Toddler 69.9
Chair 66.7
Room 66.1
Baby 65.9
Art 64.9
Stock photography 64.4
History 61.9
Child 61.5
Retro style 60.9
Paper product 58.3
Illustration 57

Microsoft
created on 2021-12-14

text 98.8
child 92.4
person 90.6
indoor 88
clothing 85.1
dress 77.8
old 66.8
toddler 65.6
skirt 62.6
room 44.3
picture frame 14.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-27
Gender Male, 98.1%
Calm 90.5%
Sad 6.5%
Confused 1.3%
Angry 0.8%
Surprised 0.4%
Happy 0.3%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 3-11
Gender Female, 96.3%
Surprised 27.4%
Angry 25.8%
Fear 15.1%
Confused 14.3%
Sad 12.4%
Calm 3.2%
Disgusted 1.2%
Happy 0.6%

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.7%
Poster 61.8%

Captions

Microsoft

a vintage photo of a little girl posing for a picture 81%
a vintage photo of a little girl posing for the camera 76.3%
a vintage photo of a little girl posing for a photo 75.7%

Text analysis

Google

a
圖 哥圖 a回i
i