Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1255.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1255.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.2
Person 99.2
Person 95.4
Face 94.6
Smile 94.6
Clothing 91.8
Apparel 91.8
Female 90.9
Child 82.8
Woman 82.8
Blonde 82.8
Kid 82.8
Girl 82.8
Teen 82.8
Dress 78.7
Outdoors 78.1
People 77.4
Photography 66.9
Portrait 66.9
Photo 66.9
Pants 63.8

Clarifai
created on 2019-06-07

people 99.9
adult 98.8
two 97.9
wear 96.5
woman 96.1
one 95.2
portrait 94.5
man 92.6
child 91.4
sit 90.9
group 90
facial expression 86.6
music 85.5
tent 84.3
three 82.3
retro 80.7
reclining 79.9
actress 78.5
administration 78
offspring 74.9

Imagga
created on 2019-06-07

child 43.8
kin 43.1
sibling 38.8
portrait 25.2
mother 23
adult 21.3
people 20.1
hair 17.4
dress 17.2
face 17.1
parent 16.8
person 16.2
outdoor 16.1
happiness 15.7
happy 15.7
bride 15.4
world 14.8
girls 14.6
love 14.2
pretty 14
old 13.9
black 13.8
wedding 13.8
outdoors 13.4
cute 12.2
fashion 12.1
joy 11.7
sepia 11.7
lifestyle 11.6
lady 11.4
human 11.2
head 10.9
model 10.9
man 10.8
park 10.7
smile 10.7
family 10.7
married 10.5
statue 10.5
eyes 10.3
senior 10.3
summer 10.3
youth 10.2
romantic 9.8
attractive 9.8
sculpture 9.7
daughter 9.6
couple 9.6
home 9.6
women 9.5
smiling 9.4
romance 8.9
blond 8.8
sexy 8.8
male 8.7
groom 8.6
outside 8.6
culture 8.5
females 8.5
relaxation 8.4
hand 8.4
playing 8.2
looking 8
body 8
look 7.9
art 7.9
ancient 7.8
skin 7.6
marriage 7.6
bouquet 7.5
city 7.5
one 7.5
mature 7.4
care 7.4
retro 7.4
makeup 7.3
aged 7.2
decoration 7.2
posing 7.1
day 7.1

Google
created on 2019-06-07

Photograph 97.6
People 95.7
Snapshot 88.5
Vintage clothing 82.9
Photography 75.7
Retro style 75.5
Stock photography 73.4
Family 65.7
Child 57.3
Classic 56.7
Sibling 52.8

Microsoft
created on 2019-06-07

person 98.3
outdoor 97.6
clothing 97.6
human face 96.7
old 96
smile 95.3
child 87.8
boy 80.3
black 76.8
baby 73.1
toddler 72.3
posing 64.6
white 63.2
vintage 54.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 92.1%
Disgusted 0.1%
Angry 0.2%
Happy 99.5%
Surprised 0.1%
Calm 0%
Confused 0.1%
Sad 0%

AWS Rekognition

Age 26-43
Gender Female, 62.8%
Disgusted 2.6%
Sad 32.5%
Confused 2.6%
Calm 11.6%
Surprised 1.4%
Angry 2.4%
Happy 46.8%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Categories

Imagga

paintings art 87.8%
people portraits 10.7%
pets animals 1.4%

Captions

Microsoft
created on 2019-06-07

a vintage photo of a boy 85.4%
a black and white photo of a boy 78.7%
an old black and white photo of a boy 78.6%