Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1254.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1254.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 95.7
Human 95.7
Face 95.6
Smile 95.6
Clothing 93.8
Apparel 93.8
Plant 91.1
Grass 91.1
Boy 83.8
People 77
Sitting 73.4
Outdoors 73.3
Kid 73
Child 73
Female 69.4
Photo 67.2
Photography 67.2
Portrait 66.8
Girl 64.8
Footwear 57.6
Shoe 57.6

Clarifai
created on 2019-06-07

people 99.2
adult 97.8
two 97.4
wear 96.9
woman 95.3
man 95
group 91
portrait 90
outdoors 89.9
child 89.3
facial expression 88
sit 86.6
love 86.3
one 84.7
retro 83.5
affection 81.1
enjoyment 77.8
three 77.6
interaction 75.7
family 75

Imagga
created on 2019-06-07

child 65.3
sibling 59.1
mother 37.1
portrait 30.4
family 30.3
happy 30.1
parent 28
happiness 25.9
people 24.6
love 22.1
smiling 21
cute 20.8
daughter 20.3
joy 20.1
baby 19.9
adult 19.4
person 19.2
male 19.1
dress 19
kid 18.6
fun 18
childhood 17.9
face 17.8
father 17.4
smile 16.4
together 15.8
man 15.5
youth 15.3
little 15
cheerful 14.6
lifestyle 14.5
toddler 14.3
hair 14.3
pretty 14
couple 14
girls 13.7
fashion 13.6
outdoors 13.4
black 13.2
boy 13
outdoor 13
blond 12.6
bride 12.5
sexy 12.1
women 11.9
children 11.9
dad 11.8
summer 11.6
attractive 11.2
old 11.2
two 11
playing 10.9
married 10.6
marriage 10.5
togetherness 10.4
eyes 10.3
adorable 10.2
son 10.2
wedding 10.1
park 9.9
studio 9.9
romantic 9.8
lady 9.7
sepia 9.7
looking 9.6
home 9.6
world 9.5
play 9.5
sitting 9.5
culture 9.4
head 9.2
leisure 9.1
one 9
romance 8.9
grandma 8.7
affection 8.7
day 8.6
loving 8.6
kids 8.5
relationship 8.4
kin 8.4
holding 8.3
care 8.2
sensuality 8.2
grass 7.9
look 7.9
outside 7.7
innocent 7.7
innocence 7.7
husband 7.6
wife 7.6
laughing 7.6
healthy 7.6
human 7.5
traditional 7.5
joyful 7.4
color 7.2
sweet 7.1
model 7

Google
created on 2019-06-07

Photograph 97.8
People 97.6
Snapshot 89.7
Vintage clothing 87.9
Photography 76.4
Family 74.4
Smile 69.4
Child 67.1
Retro style 60.1
Stock photography 59.4
Sitting 57.5
Black-and-white 56.4
Father 55.6
Sibling 53.4

Microsoft
created on 2019-06-07

grass 97.9
person 97.7
human face 97.6
smile 95.9
clothing 94.4
black 89.9
old 89.7
toddler 88.7
child 85.3
posing 83.1
baby 82.6
boy 81.8
vintage 47.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-27
Gender Female, 52.7%
Calm 7.2%
Sad 58.8%
Surprised 3.9%
Angry 5.5%
Disgusted 6.6%
Confused 5.5%
Happy 12.4%

AWS Rekognition

Age 10-15
Gender Female, 95.6%
Surprised 3.6%
Happy 72.1%
Confused 10.2%
Angry 2.6%
Calm 5%
Sad 3%
Disgusted 3.5%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.7%

Categories

Imagga

pets animals 67.9%
paintings art 29%
people portraits 1.2%

Captions

Microsoft
created on 2019-06-07

a vintage photo of a boy 87.4%
a vintage photo of a woman 87.3%
a vintage photo of a girl 87.2%