Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1256.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1256.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 99.3
Human 99.3
Person 99.1
Person 97.6
Person 97.2
Person 96.8
Person 96.3
People 95.7
Apparel 92.3
Clothing 92.3
Person 92
Person 90.8
Family 81.9
Outdoors 74.8
Face 73.2
Shorts 72
Helmet 68.6
Smile 60.9
Grass 58.8
Plant 58.8

Clarifai
created on 2019-06-07

people 99.8
child 99.4
group 97.8
group together 97.6
four 95.2
boy 95.1
portrait 95.1
son 95
three 94.9
five 94.1
man 93.7
adult 93.7
several 92.9
wear 91.5
sibling 90.5
offspring 90.5
facial expression 87
family 85.9
two 85.2
woman 85.1

Imagga
created on 2019-06-07

sketch 56.4
drawing 43.6
representation 34
graffito 20.9
people 20.6
grunge 18.7
man 16.8
decoration 16.6
outdoor 14.5
sport 14.3
black 13.8
portrait 13.6
model 13.2
adult 13
person 12.9
women 12.6
play 12.1
fun 12
pretty 11.9
face 11.4
field 10.9
cute 10.8
silhouette 10.8
happy 10.6
child 10.6
brass 10.5
old 10.4
body 10.4
youth 10.2
freedom 10.1
joy 10
male 9.9
active 9.9
attractive 9.8
hand 9.1
dirty 9
summer 9
dance 9
outdoors 9
style 8.9
sexy 8.8
hair 8.7
boy 8.7
run 8.7
art 8.7
men 8.6
fashion 8.3
playing 8.2
girls 8.2
athlete 8.2
ball 8.2
wind instrument 8
posing 8
lifestyle 7.9
kick 7.8
expression 7.7
old fashioned 7.6
relax 7.6
enjoy 7.5
player 7.5
leisure 7.5
vintage 7.4
gorgeous 7.2
paint 7.2
smiling 7.2
color 7.2
activity 7.2
grass 7.1
day 7.1
country 7
sky 7

Google
created on 2019-06-07

People 97.1
Photograph 96.5
Snapshot 85.8
Child 77.6
Photography 70.6
Family 68.7
Tree 68.7
Vintage clothing 68.3
Sitting 60.2

Microsoft
created on 2019-06-07

clothing 98
smile 97
outdoor 96.9
human face 96.1
person 95.7
boy 91.2
baby 87.2
child 82.5
toddler 80.8
posing 77
old 62
team 29

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Male, 78.1%
Confused 1.9%
Angry 1.3%
Calm 1.9%
Disgusted 1.4%
Happy 1.1%
Sad 91.7%
Surprised 0.6%

AWS Rekognition

Age 23-38
Gender Male, 55%
Disgusted 45%
Sad 45%
Happy 54.8%
Surprised 45%
Confused 45%
Calm 45.1%
Angry 45%

AWS Rekognition

Age 20-38
Gender Female, 51.7%
Happy 45.2%
Sad 45.9%
Surprised 45.1%
Disgusted 45.1%
Angry 45.4%
Calm 53.2%
Confused 45.1%

AWS Rekognition

Age 15-25
Gender Male, 66.5%
Sad 3.5%
Disgusted 0.7%
Calm 93.2%
Confused 0.2%
Happy 0.4%
Angry 1.7%
Surprised 0.3%

AWS Rekognition

Age 10-15
Gender Male, 54.7%
Calm 45.4%
Surprised 45.2%
Happy 52.4%
Angry 45.2%
Sad 46.2%
Confused 45.4%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 52.4%
Confused 45%
Angry 45.1%
Calm 45%
Happy 45%
Sad 54.8%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 23-38
Gender Male, 91.4%
Confused 3.3%
Sad 21.1%
Disgusted 1.1%
Calm 67.8%
Happy 1.7%
Surprised 1.4%
Angry 3.6%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Angry 45.5%
Happy 45.2%
Sad 47%
Disgusted 45.2%
Confused 45.6%
Calm 51.1%
Surprised 45.4%

AWS Rekognition

Age 17-27
Gender Male, 52.1%
Angry 46.8%
Happy 45.1%
Sad 50.1%
Surprised 45.3%
Calm 46.7%
Confused 45.7%
Disgusted 45.3%

Microsoft Cognitive Services

Age 16
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 13
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Helmet 68.6%

Categories

Imagga

people portraits 88.7%
cars vehicles 3.4%
pets animals 2%
paintings art 1.7%
beaches seaside 1.2%
food drinks 1.1%

Text analysis

Amazon

30
930 30
930
C

Google

98 30
98
30