Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1254.5

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 96.9
Human 96.9
Person 96.4
Apparel 93.4
Clothing 93.4
Dating 71.4
Hand 64.2
Text 61.7
Female 60.6
Art 59.6

Clarifai
created on 2019-06-07

people 100
two 99
adult 98
wear 97.7
child 97.7
portrait 95.9
man 95.5
woman 95.1
group 94.8
three 91
retro 90
son 89
music 88
one 87.9
monochrome 86.6
actor 83.9
actress 83.1
art 79.1
offspring 78.7
boy 77.8

Imagga
created on 2019-06-07

kin 41.6
portrait 31.7
sexy 23.3
person 22.3
people 21.8
face 19.9
fashion 19.6
attractive 19.6
adult 19.4
model 17.9
black 16.9
art 16.2
sculpture 16.2
body 16
statue 15.9
love 15.8
couple 15.7
happy 15
pretty 14.7
sensual 14.5
dress 14.5
brunette 13.9
man 13.6
posing 13.3
old 13.2
party 12.9
decoration 12.9
male 12.9
hair 12.7
style 12.6
religion 12.5
happiness 12.5
romantic 12.5
cute 12.2
youth 11.9
makeup 11.9
women 11.9
sensuality 11.8
head 11.8
lady 11.4
two 11
elegance 10.9
ancient 10.4
world 10.4
relationship 10.3
culture 10.3
sibling 10.2
vintage 9.9
mother 9.8
brother 9.7
look 9.6
costume 9.6
celebration 9.6
erotic 9.5
luxury 9.4
closeup 9.4
historical 9.4
figure 9.3
girls 9.1
lovely 8.9
sepia 8.7
disguise 8.7
boyfriend 8.7
smile 8.6
child 8.5
religious 8.4
performer 8.4
monument 8.4
bride 8.3
color 8.3
traditional 8.3
historic 8.2
human 8.2
make 8.2
history 8
family 8
smiling 8
antique 7.9
together 7.9
clothing 7.8
carnival 7.8
pray 7.8
underwear 7.7
skin 7.7
mask 7.7
girlfriend 7.7
festival 7.7
studio 7.6
stone 7.6
wife 7.6
husband 7.5
passion 7.5
dark 7.5
tourism 7.4
cover 7.4
indoor 7.3
gorgeous 7.2
detail 7.2
stylish 7.2
architecture 7.2

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

person 99.6
clothing 92.9
sketch 91.9
drawing 91.3
human face 90.9
standing 90.8
posing 65.9
portrait 55.4

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 20-38
Gender Female, 85.9%
Surprised 19.2%
Happy 7.1%
Confused 7.2%
Angry 5.5%
Sad 4.5%
Calm 53.3%
Disgusted 3.1%

AWS Rekognition

Age 17-27
Gender Female, 80.4%
Sad 2.6%
Confused 9.8%
Calm 74.8%
Happy 3.5%
Angry 2.7%
Surprised 5.4%
Disgusted 1.2%

Microsoft Cognitive Services

Age 32
Gender Female

Feature analysis

Amazon

Person 96.9%

Captions

Microsoft

a man and a woman posing for a photo 77.6%
a man and woman posing for a photo 72.4%
a man and a woman posing for a picture 72.3%

Text analysis

Amazon

19
d 19
d

Google

9219
9219