Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: District Attorney. Cooking-instructor. Citizen.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1237.3

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: District Attorney. Cooking-instructor. Citizen.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1237.3

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.5
Person 99.5
Person 99
Person 96.1
Clothing 84.4
Apparel 84.4
Sleeve 79.3
Hand 77.3
Art 65.3
Painting 65.3
People 61.5
Long Sleeve 59.6
Porch 59.2

Clarifai
created on 2019-06-07

people 100
adult 99
two 98.8
group 98.6
man 97
wear 96.5
three 96.3
administration 96.3
portrait 94.2
leader 92.6
retro 90.6
woman 90.5
music 88.4
art 88.2
print 87.3
four 84.2
one 83.8
several 78.3
child 78.1
five 74.8

Imagga
created on 2019-06-07

kin 37.3
sibling 27.7
statue 21.9
culture 19.6
sculpture 19.3
art 19.2
portrait 18.8
man 18.1
religion 17.9
ancient 17.3
male 17
old 16.7
face 16.3
person 16.1
people 15.6
head 14.3
vintage 14.1
stone 12.7
history 12.5
architecture 12.5
historical 12.2
world 12.2
monument 12.1
hair 11.9
closeup 11.5
religious 11.2
black 11
love 10.3
money 10.2
church 10.2
mother 9.9
dress 9.9
adult 9.7
god 9.6
antique 9.5
bill 9.5
card 9.3
historic 9.2
tourism 9.1
retro 9
currency 9
bow tie 8.9
decoration 8.8
holy 8.7
spirituality 8.6
golden 8.6
close 8.6
business 8.5
ruler 8.5
dollar 8.3
traditional 8.3
human 8.2
makeup 8.2
one 8.2
costume 8.1
symbol 8.1
happiness 7.8
sepia 7.8
luxury 7.7
skin 7.6
decorative 7.5
aged 7.2
detail 7.2
building 7.1
family 7.1

Google
created on 2019-06-07

Photograph 97.1
Snapshot 88.9
Standing 85.3
Vintage clothing 82
Retro style 71.9
Gentleman 71.9
Photography 62.4
Family 56.6
Art 50.2

Microsoft
created on 2019-06-07

person 99.8
human face 95.9
clothing 95.8
posing 90.5
old 89.2
smile 82.6
woman 82.3
standing 75.8
handwriting 73.9
vintage clothing 64.7
drawing 63.6
retro style 55.8
man 55.2
photograph 50.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 69.6%
Calm 17.9%
Angry 6.1%
Disgusted 5.8%
Sad 14.3%
Confused 5.2%
Surprised 3.9%
Happy 46.9%

AWS Rekognition

Age 6-13
Gender Male, 92.2%
Happy 1%
Sad 4.5%
Angry 1.3%
Disgusted 13.8%
Confused 0.8%
Calm 76.9%
Surprised 1.6%

AWS Rekognition

Age 45-63
Gender Male, 83.4%
Surprised 1.1%
Happy 1%
Calm 94.2%
Disgusted 0.5%
Angry 0.9%
Confused 0.6%
Sad 1.7%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 65.3%

Categories

Imagga

paintings art 98.1%
people portraits 1.3%

Text analysis

Amazon

G/25C

Google

Gesc
Gesc