Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1255.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1255.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Clothing 98.6
Apparel 98.6
Human 95.3
Person 95.3
Sleeve 90.8
Handrail 89.1
Banister 89.1
Porch 87.2
Long Sleeve 86.1
Railing 72.6
Home Decor 71.9
Robe 69
Fashion 69
Evening Dress 69
Gown 69
Female 64.8
Wood 64.7
Fence 61.1
Woman 55.6

Clarifai
created on 2019-06-07

people 99.7
adult 99
one 98.2
portrait 97.8
woman 96.5
wear 95.6
man 92.2
facial expression 88.1
retro 83.8
street 83.2
two 82.6
fashion 81.2
window 80.9
model 79.3
furniture 77.3
door 76.8
vintage 75.4
administration 75.4
music 75.2
girl 74.5

Imagga
created on 2019-06-07

picket fence 100
fence 100
barrier 82.2
obstruction 55.2
structure 29.3
statue 22.6
architecture 21.9
old 20.9
history 18.8
stone 17.8
sculpture 17.6
ancient 17.3
portrait 16.8
marble 14.9
travel 14.1
person 13.7
people 13.4
art 13.1
antique 13.1
historic 12.8
culture 12.8
building 12.7
dress 12.6
landmark 12.6
religion 12.5
city 12.5
tourism 12.4
historical 12.2
monument 12.1
face 12.1
fashion 12.1
sexy 12
attractive 11.9
vintage 10.8
wall 10.3
column 10.2
black 10.2
head 10.1
smile 10
cemetery 9.8
classical 9.6
hair 9.5
decoration 9.4
famous 9.3
house 9.2
pretty 9.1
adult 9.1
happy 8.8
old fashioned 8.6
grunge 8.5
tourist 8.2
style 8.2
man 8.1
detail 8
male 7.8
model 7.8
luxury 7.7
bride 7.7
outdoor 7.6
relax 7.6
relaxation 7.5
human 7.5
one 7.5
close 7.4
church 7.4
retro 7.4
wedding 7.4
looking 7.2
love 7.1
look 7

Google
created on 2019-06-07

Photograph 97
Vintage clothing 88.9
Snapshot 85.4
Retro style 84.5
Room 65.7
House 63.1
Classic 56.7
Family 55.7

Microsoft
created on 2019-06-07

building 99
human face 98.5
clothing 95.2
smile 93.1
outdoor 92.2
person 91.5
black 82
posing 75
white 73
woman 63.2
old 62.9
porch 35.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 98.2%
Angry 2.4%
Happy 19.6%
Sad 7.3%
Calm 62.1%
Confused 4%
Disgusted 1.7%
Surprised 3%

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.3%

Categories

Imagga

paintings art 81.9%
people portraits 17%