Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1249.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1249.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.7
Person 99.7
Person 99.1
Person 99.1
Person 96.5
People 93.8
Family 73.4
Text 64.7
Art 59.6

Clarifai
created on 2019-06-07

people 100
group 99.6
adult 99.2
child 97.5
two 97.5
man 96.2
three 95.6
woman 94.5
administration 94.3
portrait 94.3
wear 92.9
four 92.5
leader 91.6
offspring 91.3
music 88.9
several 87.3
actor 83.7
medical practitioner 83.6
group together 83.6
family 83.5

Imagga
created on 2019-06-07

kin 72.8
sibling 43
family 42.7
happy 36.4
child 34.9
male 33.2
people 31.2
man 30.9
love 30
mother 29.6
happiness 29
couple 27.9
portrait 27.8
father 27.1
smile 23.5
parent 22.9
daughter 21.8
smiling 21
kid 20.4
adult 20.1
together 19.3
dad 18.1
brother 18.1
person 17.9
senior 17.8
two 17.8
home 17.6
lifestyle 17.3
boy 16.5
husband 16.4
old 16
married 15.3
cute 15.1
attractive 14.7
grandfather 14.7
children 14.6
elderly 14.4
grandmother 13.7
relationship 13.1
cheerful 13
face 12.8
blond 12.7
casual 12.7
black 12.7
joy 12.5
wife 12.3
fun 12
grandma 11.9
women 11.9
girls 11.9
affection 11.6
little 11.5
togetherness 11.3
playing 10.9
son 10.8
childhood 10.8
pretty 10.5
mature 10.2
holding 9.9
care 9.9
human 9.7
sepia 9.7
retired 9.7
indoors 9.7
baby 9.6
marriage 9.5
men 9.4
aged 9.1
romantic 8.9
generations 8.9
bonding 8.8
loving 8.6
adorable 8.3
lovely 8
looking 8
granddaughter 7.9
day 7.8
hug 7.7
30s 7.7
retirement 7.7
head 7.6
kids 7.5
lady 7.3
dress 7.2
sexy 7.2
holiday 7.2
romance 7.1
hair 7.1
handsome 7.1

Google
created on 2019-06-07

Photograph 95.9
People 95.7
Snapshot 83.6
Family 70.2
Vintage clothing 69.4
Retro style 55.3

Microsoft
created on 2019-06-07

person 99.6
human face 99.2
clothing 99.1
smile 92.7
woman 85.2
old 79.3
vintage clothing 75.5
photograph 70.9
posing 70.2
black 68.9
portrait 64.5
retro style 62.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 84.2%
Calm 19.7%
Surprised 1.6%
Happy 12.9%
Angry 9.8%
Sad 14.5%
Confused 5.5%
Disgusted 36.1%

AWS Rekognition

Age 12-22
Gender Female, 99.4%
Disgusted 0.1%
Angry 0.3%
Sad 5.3%
Surprised 0.2%
Confused 0.3%
Calm 92.8%
Happy 0.8%

AWS Rekognition

Age 20-38
Gender Male, 51.4%
Sad 3.8%
Confused 1.1%
Disgusted 0.5%
Surprised 1.2%
Calm 90.8%
Angry 1.3%
Happy 1.4%

AWS Rekognition

Age 19-36
Gender Female, 56.1%
Angry 4.3%
Calm 42.1%
Confused 1.7%
Disgusted 4%
Sad 41.9%
Surprised 2.3%
Happy 3.6%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Text analysis

Amazon

7
47 7
47

Google

G97
G97