Human Generated Data

Title

Untitled (unidentified infant seated)
Date

1866-1899
People

Artist: Perry and Varney, American active mid-19th to early-20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4062

Human Generated Data

Title

Untitled (unidentified infant seated)

People

Artist: Perry and Varney, American active mid-19th to early-20th century

Date

1866-1899

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Face 99.1
Human 99.1
Baby 96
Smile 93.9
Newborn 93.1
Person 86.6
Photo 80.2
Portrait 80.2
Photography 80.2
Art 72.5
Sitting 56.4

Clarifai
created on 2019-11-10

people 99.7
child 97.5
portrait 95.7
art 94.9
baby 94.4
retro 92.7
one 91.7
vintage 88.4
wear 87.8
desktop 86.6
adult 86.2
old 85.5
woman 85
antique 82.4
girl 81.5
painting 78.4
picture frame 77.5
nostalgia 75.9
print 74.5
man 73.9

Imagga
created on 2019-11-10

child 49.3
portrait 27.8
person 26.8
bride 26.1
dress 25.3
people 25.1
happy 24.4
happiness 23.5
love 22.1
wedding 22.1
smile 19.9
baby 19.5
cute 19.4
doll 19.3
couple 19.2
plaything 18.7
face 18.5
smiling 18.1
childhood 16.1
kid 15.9
fashion 15.8
innocent 15
human 15
cheerful 14.6
married 14.4
celebration 14.4
hair 14.3
family 14.2
adult 14.2
little 14.1
pretty 14
blond 13.9
male 13.7
home 13.6
two 13.5
one 13.4
toddler 13.4
marriage 13.3
attractive 13.3
bouquet 12.6
day 12.6
old 12.5
innocence 12.5
studio 12.2
man 12.1
women 11.9
gown 11.7
romance 11.6
groom 11.5
holiday 11.5
mother 11.4
sitting 11.2
infant 10.6
clothing 10.6
fun 10.5
boy 10.4
black 10.2
costume 10.1
veil 9.8
chemise 9.7
flowers 9.6
wife 9.5
joy 9.2
matrimony 8.9
bridal 8.8
eyes 8.6
husband 8.6
joyful 8.3
girls 8.2
new 8.1
sculpture 8.1
sexy 8
together 7.9
look 7.9
daughter 7.9
wed 7.9
parent 7.7
youth 7.7
senior 7.5
vintage 7.4
camera 7.4
adorable 7.4
retro 7.4
children 7.3
grandma 7.2
antique 7.2
looking 7.2
body 7.2
romantic 7.1
sweet 7.1
indoors 7

Google
created on 2019-11-10

Photograph 96.8
Picture frame 70.5
Photography 67.8
Stock photography 64
Vintage clothing 54.7

Microsoft
created on 2019-11-10

text 99.8
baby 99.7
toddler 99.4
human face 98.4
child 97.4
person 96.8
clothing 96.1
smile 85.3
boy 79.1
old 57.6
picture frame 29.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 78.7%
Calm 0%
Sad 0%
Disgusted 0%
Happy 100%
Fear 0%
Surprised 0%
Angry 0%
Confused 0%

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 86.6%

Captions

Microsoft

an old photo of a person 42.5%
old photo of a person 37.6%

Text analysis

Amazon

Cottage
Grove
SUPERIOR
Demstamey
3800
SUPERIOR FINISH. Demstamey Cottage CHICAGO. Grove Ave..
FINISH.
CHICAGO.
Ave..

Google

3800
FINISH
Peaslamy 3800 SUPERIOR FINISH Cottage Grove Ave., CHICACO
Cottage
Grove
CHICACO
Peaslamy
Ave.,
SUPERIOR