Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1253.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1253.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.7
Person 99.7
Person 99.5
Person 99.5
Person 99.2
Person 98.6
People 96.6
Person 94.6
Family 93
Person 89.7
Shorts 62.4
Clothing 62.4
Apparel 62.4

Clarifai
created on 2019-06-07

people 100
group 99.3
child 98.3
adult 98
group together 97.6
many 95.2
man 94.8
several 92.8
sibling 92.8
woman 92.5
five 92.1
four 91.5
wear 91.4
offspring 91.1
portrait 91
retro 88.9
administration 88.7
leader 88
son 84.8
three 84.1

Imagga
created on 2019-06-07

kin 100
family 39.2
child 34.6
happy 33.2
mother 32.6
people 30.1
sibling 29.2
portrait 29.1
senior 29.1
male 28.5
smiling 27.5
home 26.3
man 25.6
together 25.4
happiness 24.3
couple 23.5
lifestyle 22.4
parent 21.8
love 21.3
daughter 20.4
person 20.2
adult 20.1
mature 19.5
fun 19.5
husband 19.1
elderly 18.2
park 18.1
outdoors 16.4
cheerful 16.3
enjoying 16.1
two 16.1
smile 15
old 14.6
retired 14.6
retirement 14.4
women 14.2
wife 14.2
joy 14.2
kid 14.2
baby 14.2
father 13.7
girls 12.8
married 12.5
boy 12.2
face 12.1
camera 12
children 11.9
aged 11.8
two people 11.7
childhood 11.7
affectionate 11.6
cute 11.5
grandma 11.4
relaxed 11.3
casual 11
day 11
dress 10.9
affection 10.6
indoors 10.5
laughing 10.4
togetherness 10.4
relationship 10.3
relaxing 10
leisure 10
outdoor 9.9
vertical 9.6
loving 9.5
sitting 9.5
help 9.3
care 9.1
seniors 8.8
son 8.8
holiday 8.6
pensioner 8.4
blond 8.3
holding 8.3
room 8.2
playing 8.2
romantic 8
little 8
generations 7.9
having fun 7.9
grandmother 7.8
sepia 7.8
men 7.7
outside 7.7
culture 7.7
illness 7.6
statue 7.6
horizontal 7.5
dad 7.4
indoor 7.3
clothing 7.3
decoration 7.2
color 7.2
looking 7.2
to 7.1
medical 7.1
grandfather 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

person 99.8
clothing 99.2
old 98.7
smile 97.3
posing 96.9
human face 89.9
outdoor 89.4
player 85.9
black 83.2
woman 81.4
white 80.4
group 79.6
child 78
vintage 54.9
team 37.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 98.5%
Angry 3.1%
Surprised 1.6%
Disgusted 0.8%
Calm 70%
Happy 10.5%
Confused 1.9%
Sad 12%

AWS Rekognition

Age 35-52
Gender Female, 83%
Disgusted 2.8%
Calm 6.8%
Surprised 2.4%
Confused 3.5%
Happy 22.1%
Sad 57.4%
Angry 5%

AWS Rekognition

Age 4-9
Gender Female, 66.9%
Angry 9.7%
Confused 5.9%
Calm 17.4%
Happy 13.4%
Surprised 5.1%
Sad 42.6%
Disgusted 5.9%

AWS Rekognition

Age 10-15
Gender Female, 80.3%
Disgusted 1.1%
Angry 1.5%
Happy 44.3%
Confused 0.7%
Calm 4.9%
Sad 46.5%
Surprised 0.9%

AWS Rekognition

Age 35-52
Gender Male, 51.6%
Surprised 45.3%
Sad 48.4%
Confused 46.2%
Angry 45.9%
Happy 45.8%
Calm 48%
Disgusted 45.4%

AWS Rekognition

Age 10-15
Gender Female, 53.8%
Confused 45.2%
Angry 45.4%
Calm 45.9%
Happy 45.5%
Sad 52.6%
Disgusted 45.3%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 93.8%
Calm 0.9%
Angry 0.9%
Confused 0.6%
Happy 2.3%
Disgusted 1.4%
Surprised 0.3%

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 70
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

paintings art 99.8%

Text analysis

Amazon

d27