Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1249.4

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1249.4

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Apparel 99.6
Clothing 99.6
Human 98.9
Person 98.9
Person 98.1
Hat 96.4
Face 80.5
People 78.4
Sun Hat 73.6
Female 70.4
Hat 63.3
Girl 60.5
Outdoors 57.3
Cowboy Hat 56.7

Clarifai
created on 2019-06-07

people 99.6
adult 98.4
two 97.2
wear 96.1
group 94.9
woman 94.6
man 94.5
portrait 92.9
facial expression 90.9
child 90.4
veil 87
one 86
three 85.5
group together 83.9
retro 83.2
offspring 81.9
four 81
sit 78.7
vehicle 78.4
outfit 77.8

Imagga
created on 2019-06-07

portrait 25.2
male 24.9
man 24.2
adult 23.3
person 22.7
people 21.2
happy 20.7
sibling 18.7
kin 17.7
smiling 17.4
happiness 16.5
clothing 15.8
face 15.6
old 13.9
attractive 13.3
mother 13.2
couple 13.1
smile 12.8
dress 12.6
senior 12.2
fashion 12.1
camera 12
statue 11.9
holding 11.6
women 11.1
casual 11
religion 10.8
uniform 10.6
elderly 10.5
looking 10.4
ancient 10.4
hair 10.3
men 10.3
child 10.2
antique 10
vintage 9.9
pretty 9.8
family 9.8
posing 9.8
business 9.7
home 9.6
standing 9.6
hat 9.5
model 9.3
military uniform 8.8
brunette 8.7
love 8.7
lifestyle 8.7
art 8.6
black 8.4
color 8.3
style 8.2
lady 8.1
history 8.1
sexy 8
sculpture 8
cute 7.9
half length 7.8
sepia 7.8
professional 7.8
holy 7.7
culture 7.7
bride 7.7
god 7.7
health 7.6
hand 7.6
adults 7.6
horizontal 7.5
house 7.5
religious 7.5
one 7.5
closeup 7.4
symbol 7.4
nurse 7.4
wedding 7.4
20s 7.3
cheerful 7.3
group 7.3
buddy 7.2
currency 7.2
day 7.1
indoors 7

Google
created on 2019-06-07

Photograph 95.8
People 95.2
Vintage clothing 77.7
Retro style 68.9
Family 60
History 54.1

Microsoft
created on 2019-06-07

outdoor 99.1
human face 98.7
clothing 98.7
person 96.4
smile 89.3
man 85.9
old 85.9
posing 38

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 65.6%
Angry 3.5%
Disgusted 0.7%
Calm 84.9%
Confused 3.8%
Happy 2%
Sad 3.1%
Surprised 2.1%

AWS Rekognition

Age 23-38
Gender Male, 86.6%
Happy 29.4%
Angry 3.6%
Disgusted 2.5%
Calm 48.2%
Sad 6.2%
Surprised 3%
Confused 7.1%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Hat 96.4%

Categories

Imagga

people portraits 90.8%
paintings art 7.4%
pets animals 1.2%

Captions

Microsoft
created on 2019-06-07

a vintage photo of a person 93.5%
a vintage photo of a boy 79.6%
an old photo of a person 79.5%