Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1256.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1256.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Apparel 99.5
Clothing 99.5
Human 94.8
Person 94.8
Person 93.9
Bird 90.3
Animal 90.3
Fashion 88.4
Gown 88.4
Robe 86.3
Face 73.2
Female 71.5
Person 62.8
Overcoat 62.5
Coat 62.5
Evening Dress 62.3
Girl 61.8
Suit 60.2
Kimono 59.8
Door 56.3
Sleeve 55.9

Clarifai
created on 2019-06-07

people 99.6
adult 98.4
one 97.9
wear 96.5
woman 95.8
portrait 94.9
man 94.2
two 89.7
group 83.5
furniture 83.4
facial expression 79.7
recreation 77.8
outfit 77
retro 76.8
music 76.7
military 76.1
child 75.6
administration 75.2
leader 71.6
lid 66.8

Imagga
created on 2019-06-07

portrait 28.5
people 24
person 22.8
picket fence 22.4
adult 18.9
happy 18.8
child 18.6
pretty 18.2
fence 17.5
fashion 17.3
face 17.1
newspaper 16.7
attractive 16.1
man 15.7
hair 15.1
male 14.8
sexy 14.5
human 14.3
barrier 13.7
dress 13.6
black 13.2
model 13.2
brunette 13.1
product 12.9
smile 12.8
cute 12.2
lady 12.2
one 11.9
love 11.8
happiness 11.8
bride 11.5
smiling 10.9
sepia 10.7
family 10.7
hand 10.6
creation 10.5
looking 10.4
women 10.3
wedding 10.1
head 10.1
girls 10
old 9.8
room 9.7
business 9.7
father 9.7
kin 9.7
look 9.6
couple 9.6
parent 9.2
outdoor 9.2
obstruction 9.2
modern 9.1
vintage 9.1
sensuality 9.1
cheerful 8.9
dad 8.6
culture 8.5
youth 8.5
mother 8.5
two 8.5
skin 8.5
studio 8.4
make 8.2
style 8.2
body 8
ancient 7.8
sculpture 7.8
eyes 7.7
sitting 7.7
wall 7.7
serious 7.6
sibling 7.6
joy 7.5
city 7.5
clothing 7.4
decoration 7.4
groom 7.2
statue 7.1

Google
created on 2019-06-07

Photograph 97.2
Snapshot 85.2
Vintage clothing 80
Photography 67.8
Family 56.6
Black-and-white 56.4
House 53.7
Retro style 53.4

Microsoft
created on 2019-06-07

human face 96.6
person 95.1
clothing 95
smile 91.9
woman 77.5
black 66.7
old 64.6
white 64.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 83.5%
Disgusted 4.2%
Angry 2.4%
Sad 22.1%
Surprised 2.5%
Confused 5.9%
Calm 2.5%
Happy 60.4%

AWS Rekognition

Age 48-68
Gender Female, 74.1%
Happy 96.4%
Angry 0.2%
Disgusted 0.4%
Calm 1.8%
Sad 0.2%
Surprised 0.8%
Confused 0.3%

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.8%
Bird 90.3%

Categories

Imagga

paintings art 70.3%
people portraits 15.7%
food drinks 12.9%