Human Generated Data

Title

Untitled (child with striped stockings and lace collar, seated, full-length)
Date

c.1856 - c.1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3859

Human Generated Data

Title

Untitled (child with striped stockings and lace collar, seated, full-length)

People

Artist: Unidentified Artist,

Date

c.1856 - c.1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3859

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Clothing 99.2
Apparel 99.2
Person 96.2
Human 96.2
Art 95.4
Bonnet 85.2
Hat 85.2
Painting 74.8

Clarifai
created on 2021-04-03

portrait 99.6
people 99.5
child 99.1
art 99
one 99
wear 98.1
son 96.9
baby 95.3
lid 94.7
painting 94.4
costume 91
girl 90.9
woman 90.2
adult 88.4
veil 87.4
man 85.2
boy 85.1
dress 84.8
two 83.6
music 82.9

Imagga
created on 2021-04-03

person 26.6
black 25.8
portrait 24.6
people 21.2
kin 20.9
adult 20.7
man 19.6
brother 18.8
fashion 18.1
child 17.8
face 17.8
hair 17.4
attractive 16.1
male 16
dark 15.9
world 15.7
model 15.6
comedian 14.5
sexy 14.5
body 13.6
human 13.5
old 13.2
antique 13
makeup 12.8
dress 12.7
performer 12.6
vintage 11.6
lady 11.4
brunette 11.3
style 11.1
make 10.9
cute 10.8
art 10.6
pretty 10.5
boy 10.4
sibling 10.2
lips 10.2
religion 9.9
posing 9.8
one 9.7
hands 9.6
statue 9.5
jacket 9.5
love 9.5
hand 9.1
family 8.9
entertainer 8.8
sepia 8.7
lifestyle 8.7
blond 8.7
ancient 8.7
eyes 8.6
sitting 8.6
culture 8.6
decoration 8.3
retro 8.2
happy 8.1
sculpture 8
clothing 8
couple 7.8
smile 7.8
happiness 7.8
expression 7.7
grunge 7.7
head 7.6
alone 7.3
mother 7.3
sensuality 7.3
women 7.1

Google
created on 2021-04-03

Sleeve 87.2
Headgear 82
Tints and shades 76
Vintage clothing 75.4
Art 71.2
Stock photography 64.7
History 63.6
Room 60.5
Paper product 59.6
Classic 58.3
Retro style 57.8
Rectangle 56.8
Sitting 56.2
Visual arts 54.8
Portrait 54.4
Toddler 53.2
Pattern 51.1
Antique 51.1

Microsoft
created on 2021-04-03

human face 98.7
text 97.9
clothing 97
portrait 86.8
toddler 86.2
person 85.4
baby 83.1
child 66.8
picture frame 14.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-21
Gender Female, 97%
Sad 77.8%
Calm 9.3%
Angry 6.9%
Fear 3%
Confused 2.1%
Surprised 0.5%
Happy 0.4%
Disgusted 0.2%

Microsoft Cognitive Services

Age 10
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 96.2%
Painting 74.8%

Captions

Microsoft
created on 2021-04-03

an old photo of a person 65%
a person standing in front of a door 54.3%
old photo of a person 54.2%