Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1253.3

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1253.3

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 99.7
Human 99.7
Person 99.2
Apparel 99.1
Clothing 99.1
Sleeve 88.4
Long Sleeve 76.3
Brick 74.5
Outdoors 73
Face 72.1
Porch 66.4
Girl 65.5
Female 65.5
People 63
Nature 60.5
Hat 59.8
Pants 55.2

Clarifai
created on 2019-06-07

people 99.9
two 96.9
adult 95.5
group 95
wear 93.6
child 91.3
three 90.7
man 90.6
portrait 88.7
administration 87.2
woman 86.8
leader 84.8
facial expression 82.4
retro 81.1
several 78
four 75.3
group together 73.9
family 69.3
sit 69.2
home 67.4

Imagga
created on 2019-06-07

statue 42.2
sculpture 39.7
sibling 37.8
kin 34.2
old 27.2
grandma 25.6
religion 25.1
stone 22.9
ancient 22.5
history 22.4
art 22.3
monument 21.5
architecture 19.5
home 18.4
historic 18.3
marble 16.6
culture 16.2
people 15.6
religious 15
child 15
face 14.9
antique 14.8
grandfather 14.5
person 13.8
world 13.5
head 13.4
temple 13.3
portrait 13
god 12.4
building 12.4
male 12.2
traditional 11.6
historical 11.3
travel 11.3
senior 11.2
decoration 10.9
man 10.9
vintage 10.8
tourism 10.7
happy 10.7
figure 10.5
detail 10.5
famous 10.2
city 10
family 9.8
catholic 9.7
cemetery 9.6
mother 9.6
elderly 9.6
mature 9.3
aged 9.1
adult 9.1
landmark 9
couple 8.7
worship 8.7
carving 8.4
tourist 8.2
closeup 8.1
smiling 8
women 7.9
look 7.9
grave 7.9
happiness 7.8
pray 7.8
retired 7.8
retirement 7.7
spirituality 7.7
house 7.5
outdoors 7.5
church 7.4
lifestyle 7.2
memorial 7.2
black 7.2

Google
created on 2019-06-07

People 97.4
Photograph 97.4
Vintage clothing 89.5
Snapshot 88.5
Standing 84.8
Family 73.5
Photography 67.8
Child 57.3
Retro style 51.3

Microsoft
created on 2019-06-07

person 99.9
human face 99.6
building 99.5
clothing 98.8
old 94.1
outdoor 93.7
smile 93.5
woman 91.5
standing 80.5
black 75.9
boy 75.2
child 72.2
portrait 68.7
photograph 64.6
posing 60.3
vintage clothing 51.4
older 21.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-27
Gender Female, 61.6%
Disgusted 7.9%
Sad 6.6%
Calm 36.5%
Confused 4.7%
Surprised 4.7%
Happy 33.9%
Angry 5.6%

AWS Rekognition

Age 14-23
Gender Female, 52%
Calm 70.5%
Angry 2.9%
Disgusted 2.5%
Sad 17.6%
Confused 1.3%
Surprised 2.6%
Happy 2.7%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

paintings art 99.4%

Text analysis

Amazon

20
120 20
120