Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1256.4

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1256.4

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 99.3
Human 99.3
Person 99.2
Person 99.1
Person 98.1
Person 97.6
Person 97.4
Person 97.3
Person 96.7
Person 96.1
Person 94.7
Military 94.5
Military Uniform 93.9
People 90.1
Armored 82
Army 82
Person 80.1
Clothing 74.5
Apparel 74.5
Troop 72.8
Officer 70.7
Soldier 69.5
Person 69.2
Person 63
Outdoors 58.8

Clarifai
created on 2019-06-07

people 99.8
child 99.4
group together 96.9
wear 96.3
group 96.2
many 96.1
boy 93.1
several 89.9
adult 89.8
portrait 86.4
son 86.4
facial expression 85.4
man 83.9
outfit 83.3
five 83
uniform 80.9
sibling 80.3
education 79.4
retro 79.1
offspring 78.1

Imagga
created on 2019-06-07

kin 68.7
statue 29.1
sculpture 26.2
art 19.8
portrait 18.8
people 18.4
child 17.6
man 16.9
history 16.1
old 15.3
face 14.9
marble 14.7
ancient 14.7
religion 14.3
stone 13.6
architecture 13.3
historical 13.2
culture 12.8
male 12.8
antique 12.7
love 12.6
father 12.6
family 12.5
adult 12.5
decoration 12.4
person 12.4
mother 12.2
travel 12
grandfather 12
happy 11.9
dress 11.7
couple 11.3
monument 11.2
home 11.2
happiness 11
tourism 10.7
lady 10.5
sketch 10.4
celebration 10.4
parent 10.3
sibling 10.1
traditional 10
city 10
romantic 9.8
bride 9.7
sepia 9.7
dad 9.5
religious 9.4
figure 9.3
drawing 9.3
head 9.2
historic 9.2
attractive 9.1
fashion 9
detail 8.9
smiling 8.7
married 8.6
god 8.6
room 8.6
smile 8.5
two 8.5
wedding 8.3
building 8.1
costume 7.6
house 7.5
tourist 7.2
sexy 7.2
holiday 7.2
interior 7.1
summer 7.1
carving 7.1
look 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

clothing 99.2
window 99
person 96.6
human face 96
smile 94.8
text 91.1
old 90.6
posing 89.8
outdoor 88.8
newspaper 84.2
man 79.7
group 74.7
child 69
boy 68
team 50

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 79.8%
Sad 49.2%
Disgusted 6.3%
Calm 25.3%
Confused 3.8%
Happy 5.4%
Angry 4.5%
Surprised 5.5%

AWS Rekognition

Age 16-27
Gender Male, 86.6%
Surprised 2.4%
Happy 77.3%
Confused 1.5%
Angry 1.3%
Calm 13.7%
Sad 2.3%
Disgusted 1.5%

AWS Rekognition

Age 20-38
Gender Male, 74.2%
Calm 81.9%
Disgusted 3.1%
Confused 1.5%
Surprised 2.6%
Happy 4%
Sad 4.7%
Angry 2.2%

AWS Rekognition

Age 15-25
Gender Female, 87.7%
Happy 4.6%
Surprised 9.1%
Calm 56.6%
Disgusted 4.9%
Sad 14.5%
Angry 6.8%
Confused 3.5%

AWS Rekognition

Age 15-25
Gender Female, 83.3%
Angry 13.1%
Surprised 5.5%
Sad 6.9%
Happy 1.4%
Confused 6.9%
Disgusted 20.6%
Calm 45.6%

AWS Rekognition

Age 26-43
Gender Male, 83.4%
Calm 2.3%
Angry 1.8%
Surprised 1.3%
Sad 76.8%
Happy 14.9%
Confused 1.7%
Disgusted 1.1%

AWS Rekognition

Age 15-25
Gender Female, 75.3%
Surprised 4.3%
Disgusted 9.1%
Confused 3%
Angry 4.7%
Sad 10.4%
Calm 65.2%
Happy 3.3%

AWS Rekognition

Age 23-38
Gender Male, 75.4%
Disgusted 0.4%
Happy 95.9%
Surprised 0.5%
Confused 0.7%
Angry 0.3%
Sad 0.9%
Calm 1.3%

AWS Rekognition

Age 35-55
Gender Female, 51.9%
Disgusted 45.3%
Sad 53.4%
Confused 45.1%
Calm 45.5%
Surprised 45.2%
Angry 45.4%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53.6%
Disgusted 4.9%
Confused 5%
Surprised 4.3%
Calm 53.4%
Happy 7.7%
Angry 6.7%
Sad 18.1%

AWS Rekognition

Age 35-52
Gender Female, 51.1%
Calm 45.6%
Angry 45.3%
Happy 45.6%
Disgusted 45.4%
Confused 45.5%
Sad 52.4%
Surprised 45.3%

AWS Rekognition

Age 17-27
Gender Female, 51.3%
Surprised 45.4%
Calm 49.8%
Disgusted 45.6%
Confused 45.2%
Happy 45.3%
Angry 45.5%
Sad 48.2%

AWS Rekognition

Age 35-52
Gender Female, 51.3%
Calm 48.7%
Sad 47.9%
Surprised 45.4%
Angry 45.4%
Happy 46.7%
Disgusted 45.6%
Confused 45.2%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Categories

Imagga

paintings art 99.9%

Text analysis

Amazon

992