Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1253.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1253.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Clothing 99.2
Apparel 99.2
Sitting 96.9
Human 96.9
Person 95.6
Fashion 88.8
Evening Dress 88.8
Robe 88.8
Gown 88.8
Female 83.3
Face 68.2
Wedding 68
Wedding Gown 68
Photography 67
Photo 67
Portrait 65.9
Girl 63.4
Furniture 61.4
Woman 61.2
Finger 60.5
Sleeve 59.3
Blonde 56.2
Child 56.2
Teen 56.2
Kid 56.2
People 55.8
Sphere 55.5

Clarifai
created on 2019-06-07

people 99.7
adult 98.5
one 98.2
wear 97.2
man 94.5
two 92.4
portrait 88.6
retro 88
woman 86.9
sit 86.8
outdoors 80.8
sepia 73.7
group 71.2
administration 70
music 68.2
facial expression 67.9
leader 66.9
interaction 66.5
war 64.9
no person 63.8

Imagga
created on 2019-06-07

child 60.4
statue 29.6
portrait 25.3
person 23.2
adult 20.8
face 20.6
people 19.5
sculpture 18.2
love 17.4
happiness 17.2
outdoors 17.2
happy 16.9
lifestyle 15.9
mother 15.5
attractive 15.4
pretty 14.7
park bench 13.8
outdoor 13.8
sexy 13.7
dress 13.6
man 13.4
bride 13.4
art 13.2
smiling 13
wedding 12.9
world 12.7
hair 12.7
romantic 12.5
couple 12.2
lady 12.2
fashion 12.1
sitting 12
bench 11.9
model 11.7
sand 11.3
old 11.2
summer 10.9
cemetery 10.9
blond 10.8
smile 10.7
sepia 10.7
cheerful 10.6
looking 10.4
soil 10.3
women 10.3
youth 10.2
day 10.2
two 10.2
male 10
park 9.9
bouquet 9.7
married 9.6
decoration 9.5
juvenile 9.5
eyes 9.5
seat 9.4
monument 9.3
cute 9.3
joy 9.2
religion 9
history 8.9
antique 8.8
look 8.8
stone 8.7
ancient 8.7
luxury 8.6
head 8.4
leisure 8.3
vintage 8.3
fun 8.2
alone 8.2
one 8.2
relaxing 8.2
detail 8.1
romance 8
family 8
parent 8
celebration 8
black 7.8
outside 7.7
culture 7.7
relaxation 7.5
earth 7.5
tourism 7.4
home 7.2
travel 7
sea 7
architecture 7
furniture 7
together 7

Google
created on 2019-06-07

Photograph 96.7
Sitting 87.7
Snapshot 82
Retro style 68
Stock photography 65.4
Vintage clothing 64
Photography 62.4
Gentleman 54.5
Smile 54

Microsoft
created on 2019-06-07

person 97.9
clothing 96.2
human face 95.1
old 92.1
outdoor 90.3
building 89.2
posing 76.3
sculpture 64.2
smile 62.3
vintage 26
stone 3.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 61.5%
Confused 3.1%
Happy 1.1%
Sad 7.3%
Surprised 0.5%
Calm 86%
Disgusted 0.6%
Angry 1.4%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.6%
Wedding Gown 68%

Categories

Imagga

paintings art 91.1%
pets animals 6.2%
people portraits 2.3%

Captions

Microsoft
created on 2019-06-07

a vintage photo of a man 88.1%
an old photo of a man 88%
a man standing in front of a building 84.5%

Text analysis

Amazon

2
o 2 2
o