Human Generated Data

Title

Helen Sears (with nanny and stuffed rabbit)
Date

1892-1894
People

Artist: Sarah Choate Sears, American 1858 - 1935
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Montgomery S. Bradley and Cameron Bradley, P1984.41

Human Generated Data

Title

Helen Sears (with nanny and stuffed rabbit)

People

Artist: Sarah Choate Sears, American 1858 - 1935

Date

1892-1894

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.8
Human 98.8
Art 98.2
Painting 98.2
Person 97.2
Female 95.7
Kid 94.4
Teen 94.4
Woman 94.4
Blonde 94.4
Girl 94.4
Child 94.4
Clothing 87.3
Apparel 87.3
Face 72.9
People 70.1
Photography 60.1
Portrait 60.1
Photo 60.1

Imagga
created on 2022-01-23

family 67.6
child 57.3
mother 45.4
happy 41.4
father 41.3
male 40.5
brother 38.3
love 34.7
parent 34.6
kid 34.6
people 34
happiness 32.9
together 32.4
man 32.3
sibling 29.9
son 29.2
boy 28.7
portrait 27.2
home 27.1
smiling 26.8
grandfather 25.9
smile 25.7
couple 25.3
casual 24.6
cute 24.4
daughter 24
dad 23.9
children 23.7
fun 22.5
adult 21.4
baby 20.2
senior 19.7
lifestyle 19.5
husband 19.1
childhood 18.8
old 18.8
two 18.6
little 18.6
kin 18.2
person 18
grandma 17.5
wife 17.1
grandmother 16.6
playing 16.4
loving 16.2
cheerful 15.4
joy 15
blond 14.6
couch 14.5
married 14.4
kids 14.1
handsome 13.4
togetherness 13.2
holding 13.2
relationship 13.1
grandchild 12.8
face 12.8
parents 12.7
retired 12.6
elderly 12.4
indoors 12.3
laughing 12.3
play 12.1
men 12
adorable 12
life 11.9
generations 11.8
grandparent 11.8
parenthood 11.7
sitting 11.2
women 11.1
leisure 10.8
mom 10.7
affectionate 10.6
friendship 10.3
granddaughter 9.9
attractive 9.8
bonding 9.8
hug 9.7
toddler 9.6
relaxed 9.4
offspring 9.2
girls 9.1
video 8.7
mature 8.4
active 8.1
interior 8
black 7.8
boys 7.8
infant 7.7
retirement 7.7
laugh 7.7
youth 7.7
sofa 7.7
enjoying 7.6
house 7.5
friends 7.5
domestic 7.4
aged 7.2
game 7.1

Google
created on 2022-01-23

Face 98.3
Sleeve 84.3
Tints and shades 76
Vintage clothing 75.8
Art 75.4
Classic 68.8
Sitting 66.5
Stock photography 64.5
History 61.6
Child 61.5
Portrait 61.5
Monochrome 61.5
Painting 61.1
Room 60.8
Visual arts 58.2
Retro style 57.8
Family 51
Antique 51

Microsoft
created on 2022-01-23

human face 99.3
clothing 98.4
wall 97.6
text 97.3
baby 95.4
person 94.1
toddler 92.8
smile 91.7
old 83
black 82.5
woman 72.1
portrait 53.6
posing 49.9
vintage 36.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Female, 100%
Calm 99.7%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 0-4
Gender Male, 96%
Angry 88.9%
Calm 5.4%
Confused 2.5%
Sad 1.1%
Fear 0.6%
Surprised 0.6%
Happy 0.5%
Disgusted 0.2%

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 98.2%

Captions

Microsoft

a vintage photo of a girl 93%
a vintage photo of a woman 92.9%
a vintage photo of a little girl posing for a picture 83.3%