Human Generated Data

Title

Untitled (woman seated in ornate chair with boy in sailor suit labeled Maria Smith, Milo Smith)

Date

1890-1910

People

Artist: Amond J. Schillare, American 1856 - 1917

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4056

Human Generated Data

Title

Untitled (woman seated in ornate chair with boy in sailor suit labeled Maria Smith, Milo Smith)

People

Artist: Amond J. Schillare, American 1856 - 1917

Date

1890-1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Human 98
Person 98
Person 97.9
Apparel 93.2
Clothing 93.2
Advertisement 88.4
Face 87.2
Poster 86.1
Furniture 79.7
Collage 73
Chair 71.1
Photo 69.7
Photography 69.7
Portrait 69.7
Text 63.6
Art 62.9
People 60.1
Paper 56.8
Flyer 56.8
Brochure 56.8

Clarifai
created on 2019-11-10

people 98.6
child 97.9
portrait 96
retro 95.2
two 89
art 87.3
woman 87.1
baby 86.7
paper 86.4
son 86.1
nostalgia 85.4
one 83.7
love 83.5
girl 83.2
desktop 82.6
adult 81.8
man 81.7
cute 80.7
wear 76.9
facial expression 76.4

Imagga
created on 2019-11-10

kin 62.1
child 49.1
people 30.1
adult 27.8
portrait 26.5
family 25.8
male 25.1
person 25
cute 23
face 22
home 21.5
mother 21.3
love 20.5
baby 20
parent 19.5
man 19.5
happy 19.4
couple 18.3
old 16.7
lifestyle 16.6
boy 16.5
father 16.3
looking 15.2
kid 15.1
grandma 15
model 14.8
smiling 14.5
human 14.2
happiness 14.1
senior 14.1
mature 14
lady 13.8
hair 13.5
women 13.4
one 13.4
black 12.6
dad 12.6
pretty 12.6
attractive 12.6
couch 12.6
husband 12.4
together 12.3
smile 12.1
fashion 12.1
sexy 12
fun 12
casual 11.9
little 11.5
studio 11.4
blond 10.6
wife 10.4
sitting 10.3
men 10.3
head 10.1
cheerful 9.8
sofa 9.6
elderly 9.6
expression 9.4
relationship 9.4
youth 9.4
joy 9.2
indoor 9.1
hand 9.1
modern 9.1
vintage 9.1
holding 9.1
antique 8.8
indoors 8.8
two 8.5
skin 8.5
relaxed 8.5
sibling 8.4
adorable 8.3
daughter 8.3
room 8.2
life 8.2
domestic 8.1
dress 8.1
childhood 8.1
lovely 8
interior 8
grandmother 7.8
sepia 7.8
older 7.8
retired 7.8
retirement 7.7
loving 7.6
clothing 7.5
dark 7.5
children 7.3
sensuality 7.3
body 7.2
handsome 7.1
son 7

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

baby 99
human face 98.5
person 98.2
clothing 98.1
text 98
toddler 97.6
smile 82.5
child 81.5
boy 68.3
picture frame 55.3
posing 46

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 59.4%
Sad 1.1%
Fear 0%
Disgusted 0%
Surprised 0%
Happy 0.1%
Calm 98.8%
Angry 0%
Confused 0%

AWS Rekognition

Age 38-56
Gender Female, 96.3%
Surprised 0%
Calm 99.2%
Disgusted 0.1%
Fear 0%
Happy 0%
Confused 0.1%
Angry 0.1%
Sad 0.4%

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%

Captions

Microsoft

a person posing for a photo 78.8%
a man and a woman posing for a photo 44.8%
a man and woman posing for a photo 38.2%

Text analysis

Amazon

SA-JSCHILLARE2
ORTKAMPTON
.

Google

NORNAKPTON
MA
A-J-SCHILLARE NORNAKPTON MA
A-J-SCHILLARE