Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1252

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.4
Person 99.4
Person 98.6
Person 97.4
Person 96.6
Person 81
Outdoors 75.6
Text 71.5
Soil 70.8
Advertisement 70.7
Poster 69.3
Wildlife 66.5
Elk 66.5
Animal 66.5
Deer 66.5
Mammal 66.5
Nature 63.5
Land 63.5
Art 60.5
Collage 59.1
Plant 57.9
Tree 57.9

Clarifai
created on 2019-06-07

art 97.5
people 96.4
nature 95.1
picture frame 94
retro 94
old 93.9
painting 93.8
landscape 92.7
desktop 92.5
illustration 91.5
no person 90.6
paper 89.4
album 89
blank 88.1
man 87.8
vintage 87.7
empty 86.9
print 86.9
sky 86.6
antique 86.3

Imagga
created on 2019-06-07

book jacket 28.5
envelope 28.4
grunge 26.4
sketch 25.9
vintage 25.6
old 24.4
drawing 23.9
silhouette 23.2
jacket 23.2
retro 22.9
container 17.4
dirty 17.2
representation 17
wrapping 16.9
texture 16
design 15.9
letter 15.6
man 15.5
aged 15.4
card 15.3
paper 14.9
antique 14.7
graphic 13.9
pattern 13.7
symbol 13.5
art 13.2
ancient 13
graffito 12.9
stamp 12.8
covering 12.7
decoration 12.7
sport 12.6
poster 12.3
postmark 11.8
paint 11.8
book 11.5
mail 11.5
message 11
philately 10.9
postage 10.8
people 10.6
fun 10.5
play 10.3
competition 10.1
postal 9.8
frame 9.6
text 9.6
creation 9.6
sky 9.6
color 9.5
winter 9.4
travel 9.2
active 9
activity 9
snow 8.9
product 8.8
old fashioned 8.6
hobby 8.5
grungy 8.5
collection 8.1
material 8
game 8
web site 7.9
business 7.9
circa 7.9
holiday 7.9
comic book 7.8
black 7.8
money 7.7
damaged 7.6
sign 7.5
decorative 7.5
border 7.2
history 7.2
structure 7.1

Google
created on 2019-06-07

Photograph 96.2
Text 93.6
Snapshot 84.3
Stock photography 71.8
Paper 71.7
Room 71.4
Paper product 69.4
Tree 68.7
Photography 67.8
Art 67.7
Adaptation 67
History 62.6
Illustration 57.7
Drawing 57.6
Collection 50

Microsoft
created on 2019-06-07

person 91
man 66.6
mammal 60.8
businesscard 50.8

Face analysis

Amazon

AWS Rekognition

Age 14-23
Gender Female, 50.1%
Sad 49.7%
Disgusted 49.5%
Angry 50%
Happy 49.6%
Confused 49.6%
Calm 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 49.8%
Disgusted 49.7%
Sad 49.6%
Confused 49.5%
Surprised 49.6%
Angry 49.7%
Calm 49.5%

AWS Rekognition

Age 12-22
Gender Female, 50.3%
Surprised 49.6%
Happy 49.5%
Confused 49.6%
Angry 49.6%
Sad 49.7%
Calm 50%
Disgusted 49.6%

AWS Rekognition

Age 14-23
Gender Female, 50.4%
Calm 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.5%
Sad 50.5%
Disgusted 49.5%
Surprised 49.5%

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a picture of a room 50.9%
a room with white walls 33.2%

Text analysis

Amazon

George
Junior
Republic,
George Junior Republic, FreevilleN.
some
coupled
trouble
An
FreevilleN.
Anofficer hoving some trouble
orreot
Anofficer
th
An orreot coupled w th resistance.
pr
hoving
pr soner
resistance.
soner
w
ICA01

Google

George
Junior
officer
An
hoving
some
with
prisoner
N.Y.
coupled
George Junior Republic, Freeville, N.Y. An arreet coupled with resistance. An officer hoving some trouble with prisoner
arreet
Republic,
Freeville,
resistance.
trouble