Human Generated Data

Title

Helen Sears (holding doll)
Date

1891
People

Artist: Sarah Choate Sears, American 1858 - 1935
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Montgomery S. Bradley and Cameron Bradley, P1984.46

Human Generated Data

Title

Helen Sears (holding doll)

People

Artist: Sarah Choate Sears, American 1858 - 1935

Date

1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Montgomery S. Bradley and Cameron Bradley, P1984.46

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 96
Person 93.5
Newborn 91.7
Baby 91.7
Clothing 87.4
Apparel 87.4
Painting 86.3
Art 86.3
Hat 81.5
Bonnet 81.5
People 60.5
Portrait 59.9
Photo 59.9
Face 59.9
Photography 59.9

Clarifai
created on 2023-10-26

baby 99.8
portrait 99.7
child 99.7
people 99.7
one 97.9
son 97.2
two 96.1
sepia 92.5
monochrome 92.2
wear 92
family 89.9
offspring 89.7
girl 88.4
nostalgia 87.8
sit 86.8
facial expression 86.2
princess 86
retro 84.6
art 82.6
affection 82.4

Imagga
created on 2022-01-23

child 76.4
mother 60.8
parent 52.3
family 48.1
happy 33.2
people 31.3
love 30
father 29.7
male 28.8
childhood 28.7
kid 28.4
son 27.7
home 27.1
baby 26.9
happiness 26.7
daughter 26.6
boy 26.1
portrait 25.9
cute 25.1
little 24.7
children 24.6
together 24.5
adult 23.9
smile 23.5
smiling 21.7
person 20.8
fun 18.7
grandma 18.5
face 18.5
joy 18.4
couple 18.3
man 18.2
dad 17.5
youth 16.2
senior 15.9
care 15.6
cheerful 15.5
husband 15.4
old 15.3
brother 15.2
sibling 14.9
sitting 14.6
innocence 14.4
toddler 14.3
blond 14.2
lifestyle 13.7
loving 13.4
wife 13.3
playing 12.8
infant 12.5
togetherness 12.3
play 12.1
adorable 12
girls 11.9
innocent 11.5
relationship 11.2
casual 11
parenthood 10.8
indoors 10.5
elderly 10.5
pretty 10.5
looking 10.4
hair 10.3
parents 9.8
human 9.8
interior 9.7
one 9.7
affection 9.7
married 9.6
two 9.3
room 9.2
offspring 9.1
aged 9.1
black 9
grandfather 9
grandmother 8.8
retired 8.7
mom 8.7
hug 8.7
sofa 8.6
life 8.6
expression 8.5
kids 8.5
leisure 8.3
park 8.2
sweet 7.9
caring 7.9
motherhood 7.8
antique 7.8
newborn 7.8
affectionate 7.7
men 7.7
world 7.6
healthy 7.6
clothing 7.5
holding 7.4

Google
created on 2022-01-23

Hair 98.4
Face 98.4
Cheek 97.9
Head 97.2
Hairstyle 95.1
Human body 88.6
Dress 87.2
Iris 84.3
Toddler 80.7
Baby 79.8
Vintage clothing 76.8
Art 75.8
Monochrome 68.8
Child 67
Sitting 65.8
Stock photography 62.6
Portrait 61.8
Monochrome photography 60.9
Classic 60.3
Baby & toddler clothing 60.2

Microsoft
created on 2022-01-23

baby 99.1
toddler 98.8
human face 97.5
person 96.8
text 96.8
child 92.4
clothing 92
black 72.8
portrait 69.8
old 55.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Female, 99.9%
Calm 59.8%
Surprised 24.4%
Fear 9.2%
Angry 2.1%
Sad 2%
Disgusted 1.2%
Happy 0.7%
Confused 0.6%

AWS Rekognition

Age 2-10
Gender Female, 99.6%
Surprised 40.1%
Calm 26.5%
Sad 22.7%
Fear 5.2%
Disgusted 1.9%
Happy 1.4%
Confused 1.3%
Angry 0.9%

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.5%
Painting 86.3%

Captions

Microsoft
created on 2022-01-23

a vintage photo of a person 94.3%
a vintage photo of a person 92.4%
a vintage photo of a boy 80.7%