Human Generated Data

Title

Untitled (portrait of toddler in white sweater)

Date

1960s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.622

Human Generated Data

Title

Untitled (portrait of toddler in white sweater)

People

Artist: Bachrach Studios, founded 1868

Date

1960s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 98.7
Clothing 98.7
Human 88.5
Person 88.5
Sleeve 79.9
Fashion 65.3
Long Sleeve 60.8
Finger 57.1
Furniture 55.8

Imagga
created on 2022-02-26

child 100
kid 48.8
childhood 46.7
little 44.2
doll 41.7
cute 38.1
person 37.3
toddler 37.3
plaything 34.2
happy 32
portrait 31.1
fun 28.5
baby 28.3
clothing 27.9
face 27
one 26.2
happiness 25.9
garment 24.9
cheerful 24.4
people 24
smiling 23.2
joy 22.6
expression 22.2
youth 22.2
boy 21.8
adorable 21.3
play 20.7
smile 20.7
eyes 20.7
innocence 20.2
children 20.1
sitting 19.8
daughter 18.3
blond 17.9
girls 17.4
park 17.3
human 17.3
outdoor 16.9
playing 16.4
diaper 16.4
outdoors 15.7
outside 15.4
looking 15.2
hair 15.1
juvenile 15
towel 15
sweater 14.6
pretty 14
care 14
toy 13.8
preschooler 13.7
infant 13.5
sweet 13.5
look 13.2
cardigan 12.9
kids 12.3
summer 12.2
covering 12
grass 11.9
bath towel 11.7
son 11.7
playful 11.4
consumer goods 11.1
innocent 11.1
life 11
bench 10.8
healthy 10.7
preschool 10.7
attractive 10.5
love 10.3
pink 10.1
dress 10
hands 9.6
laughing 9.5
bath linen 9.4
positive 9.2
joyful 9.2
male 8.9
newborn 8.8
lifestyle 8.7
education 8.7
offspring 8.5
braid 8.3
tree 7.7
facial 7.7
enjoying 7.6
holding 7.4
game 7.1
family 7.1
autumn 7

Google
created on 2022-02-26

Cheek 97.9
Eye 93.7
Sleeve 87.2
Art 83.9
Toddler 79.6
Painting 79.5
Vintage clothing 73
Flash photography 70.9
Bangs 69.3
Plant 69.1
Visual arts 66.9
Sitting 63.9
Portrait 62.7
Child 61.5
Fur 60.8
Portrait photography 60.5
Paint 59.8
Room 58.3
Watercolor paint 57.8
Illustration 56.6

Microsoft
created on 2022-02-26

person 99.5
indoor 96
human face 95.2
clothing 94.2
baby 93.2
little 92.1
boy 91.2
text 79.9
child 63.1
toddler 33.5
dessert 20.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 96.5%
Sad 55.8%
Calm 24.1%
Confused 13.2%
Fear 1.9%
Disgusted 1.8%
Angry 1.1%
Happy 1.1%
Surprised 1%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 88.5%

Captions

Microsoft

a little boy that is holding a stuffed animal 44.1%
a little boy holding a stuffed animal 44%
a little boy that is holding a stuffed toy 40.3%