Human Generated Data

Title

Untitled (full length portrait of child standing labeled Marjory Smith at 18 months old)
Date

1866-1899
People

Artist: J. H. Reynolds, American active mid-19th to early-20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4064

Human Generated Data

Title

Untitled (full length portrait of child standing labeled Marjory Smith at 18 months old)

People

Artist: J. H. Reynolds, American active mid-19th to early-20th century

Date

1866-1899

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4064

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Human 97
Person 95.9
Clothing 94.8
Apparel 94.8
Face 94.3
Furniture 93.8
Chair 93.8
Dress 88.3
Female 81.8
Girl 74.6
Photography 73.6
Photo 73.6
Portrait 73.6
Kid 72.6
Child 72.6
Sitting 72
Baby 70
People 65.9
Smile 59.1
Indoors 58.9
Room 58.9
Floor 58.1
Teen 55.8
Woman 55.7
Blonde 55.7
Door 55.1

Clarifai
created on 2019-11-10

people 99.8
one 97.9
child 96.7
portrait 96.2
adult 96.1
wear 94.9
woman 90.6
administration 88.7
man 85.9
music 83.2
indoors 82.4
leader 82
art 81.3
education 81.2
dress 81
retro 80.2
facial expression 79.1
painting 78.6
chair 78.4
nostalgia 77.7

Imagga
created on 2019-11-10

child 71.3
portrait 25.9
happy 22.6
people 20.6
person 19.6
couple 19.2
man 18.8
male 18.4
love 18.1
kin 17.5
happiness 16.5
face 16.3
adult 16.3
family 16
senior 15.9
mother 15.8
smiling 15.2
park 14.8
home 14.4
statue 14.3
old 13.9
youth 13.6
bride 13.5
kid 13.3
smile 12.8
girls 12.8
parent 12.4
grandma 12.2
human 12
wedding 12
two 11.9
sibling 11.6
outdoor 11.5
outdoors 11.2
lifestyle 10.8
married 10.5
together 10.5
black 10.2
cute 10
dress 9.9
childhood 9.9
fun 9.7
sculpture 9.6
loving 9.5
hair 9.5
women 9.5
outside 9.4
little 8.8
looking 8.8
antique 8.7
retirement 8.6
world 8.5
mature 8.4
children 8.2
clothing 8.1
history 8.1
day 7.8
boy 7.8
father 7.8
sepia 7.8
retired 7.8
affectionate 7.7
sitting 7.7
pretty 7.7
culture 7.7
grandfather 7.7
enjoying 7.6
laughing 7.6
bouquet 7.5
joy 7.5
groom 7.5
help 7.4
care 7.4
cheerful 7.3
aged 7.2
dad 7.2
juvenile 7.2
religion 7.2
blond 7.1
summer 7.1
gown 7

Google
created on 2019-11-10

Photograph 97.4
Snapshot 87.5
Standing 81.9
Picture frame 79.4
Child 77.6
Vintage clothing 76.9
Photography 73.8
Stock photography 67.6
Room 65.7
Portrait 60.4
Black-and-white 56.4

Microsoft
created on 2019-11-10

toddler 97.9
text 97.6
baby 97.1
child 96.4
clothing 95.5
person 94.8
human face 92.9
smile 79.4
old 72.9
boy 64
girl 54.3
picture frame 48.2
posing 43.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-5
Gender Female, 80.9%
Angry 0%
Happy 99.6%
Fear 0%
Calm 0.1%
Sad 0%
Surprised 0.2%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.9%
Chair 93.8%

Categories

Imagga

people portraits 76.5%
paintings art 22.9%

Captions

Microsoft
created on 2019-11-10

a vintage photo of a person 85.1%
a vintage photo of a girl 72.9%
an old photo of a person 72.8%

Text analysis

Amazon

Tnoe
ir Tnoe
ir
s

Google

GRANGE
GRANGE