Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1255.3

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 96.4
Person 96.4
Clothing 96.1
Apparel 96.1
Sitting 85.8
Outdoors 80.7
Face 80.4
Ground 78.6
Nature 75.7
Child 62.1
Kid 62.1
Hat 62
Tire 61.2
Wood 59.5
Female 58.6
Girl 58.6
Countryside 56.8

Clarifai
created on 2019-06-07

people 99
one 98
adult 96.4
portrait 95.2
wear 93.7
woman 87.5
child 87
retro 85.5
sit 84.8
facial expression 81.2
outdoors 81
two 81
girl 80.5
sepia 79.2
nostalgia 75.4
vintage 72.1
music 70.5
summer 67.8
man 66
grass 65.9

Imagga
created on 2019-06-07

sand 60.7
child 52.3
soil 44.8
earth 32.4
people 25.1
portrait 24
adult 21.4
face 21.3
love 20.5
happiness 20.4
happy 20.1
person 19.4
summer 19.3
hair 19
pretty 18.9
groom 18.5
smiling 18.1
dress 17.2
outdoors 17.2
smile 17.1
lifestyle 16.6
bride 16.5
cemetery 16.1
outdoor 16.1
joy 15.9
attractive 15.4
cute 15.1
wedding 14.7
beach 14.5
fashion 14.3
women 14.2
fun 14.2
model 14
man 13.4
field 13.4
park 13.2
male 13
outside 12.8
family 12.5
couple 12.2
lady 12.2
grass 11.9
girls 11.9
childhood 11.6
blond 11.5
cheerful 11.4
youth 11.1
two 11
vacation 10.6
married 10.6
mother 10.6
marriage 10.5
romance 9.8
romantic 9.8
human 9.8
little 9.7
sexy 9.6
eyes 9.5
bouquet 9.4
statue 9.3
head 9.2
leisure 9.1
hand 9.1
gorgeous 9.1
kin 8.9
kid 8.9
look 8.8
sepia 8.7
flowers 8.7
sea 8.6
wife 8.5
countryside 8.2
alone 8.2
playing 8.2
looking 8
life 8
country 7.9
together 7.9
culture 7.7
sculpture 7.7
healthy 7.6
one 7.5
long 7.3
makeup 7.3
decoration 7.2
black 7.2
art 7.2
day 7.1
rural 7.1
autumn 7
costume 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

human face 97.2
smile 94.2
person 94.2
outdoor 94
clothing 93.5
old 84.4
toddler 75.2
child 73.1
black 70.4
posing 63.6
vintage 37.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 90.1%
Sad 70.7%
Confused 3.7%
Disgusted 2.4%
Surprised 1.5%
Calm 15%
Angry 3.8%
Happy 2.9%

Microsoft Cognitive Services

Age 39
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.4%

Captions

Microsoft

a vintage photo of a boy 83.9%
an old photo of a boy 83.6%
a vintage photo of a girl 83.5%

Text analysis

Amazon

926

Google

9f.26
9f.26