Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1249.3

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1249.3

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.1
Person 99.1
Person 98.9
Clothing 94
Apparel 94
Face 84.9
People 81.6
Home Decor 80.6
Female 79.1
Smile 72.8
Girl 71.3
Furniture 69
Sleeve 66.4
Linen 60.6
Plant 60.2
Tree 58.9
Woman 55.5

Clarifai
created on 2019-06-07

people 99.9
adult 97.8
group 97.7
two 96.8
woman 95.5
facial expression 92.6
child 91.5
man 91.4
several 91.3
wear 90.8
three 90.7
group together 85.8
portrait 85
administration 84.3
leader 83.6
offspring 82.7
actress 82.1
four 81.9
canine 80.3
many 78.4

Imagga
created on 2019-06-07

statue 40.1
cemetery 37.9
sculpture 36.2
religion 25.1
stone 23.5
kin 23.4
ancient 21.6
old 21.6
groom 21.3
art 20.8
history 20.6
architecture 20.3
culture 19.7
monument 19.6
mother 19.6
face 16.3
portrait 16.2
dress 15.4
marble 14.7
people 14.5
travel 14.1
parent 14.1
religious 14.1
tourism 14
person 13.9
bride 13.6
antique 13.1
historic 12.8
building 12.7
decoration 12.5
god 12.4
ruler 12.4
temple 12.3
memorial 12.1
child 12
traditional 11.7
sibling 11.6
historical 11.3
wedding 11
man 10.8
family 10.7
outdoors 10.5
celebration 10.4
adult 10.4
women 10.3
head 10.1
outdoor 9.9
landmark 9.9
vintage 9.9
roman 9.9
detail 9.7
love 9.5
famous 9.3
city 9.2
girls 9.1
park 9.1
catholic 8.8
sepia 8.8
heritage 8.7
day 8.6
happiness 8.6
father 8.2
closeup 8.1
male 8
costume 7.9
couple 7.8
golden 7.7
column 7.7
bouquet 7.7
grandfather 7.6
cross 7.5
romantic 7.1
grave 7.1
look 7

Google
created on 2019-06-07

Photograph 97.5
People 96.9
Snapshot 87.1
Vintage clothing 81.8
Classic 72
Retro style 69.7
Family 69.2
Photography 67.8
Adaptation 67
Stock photography 62.1
Smile 54

Microsoft
created on 2019-06-07

human face 99
grass 98.8
outdoor 98.6
person 98.3
clothing 96.5
smile 94
old 91.2
posing 87.5
toddler 81.1
boy 79.5
child 73.6
baby 69.7
black 69.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-25
Gender Female, 54.4%
Surprised 4%
Angry 13.1%
Happy 4.9%
Confused 8.4%
Disgusted 7.8%
Calm 22.7%
Sad 39.2%

AWS Rekognition

Age 45-63
Gender Female, 99.5%
Angry 0%
Disgusted 0%
Calm 0%
Confused 0%
Happy 99.9%
Sad 0%
Surprised 0%

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Categories

Imagga

paintings art 95.8%
people portraits 3.8%

Text analysis

Amazon

G8