Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: This picture may be considered as an "after taking." However, the persons are not the same.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1250.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: This picture may be considered as an "after taking." However, the persons are not the same.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1250.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.7
Person 99.7
Nature 99.7
Outdoors 99.2
Person 97.4
Person 97.3
Person 96.9
Person 96.1
Countryside 93.1
Rural 92.7
Shack 92.7
Hut 92.7
Building 92.7
People 85.5
Shelter 81.9
Porch 72.4
Military 70.4
Military Uniform 70.4
Dugout 68.8
Armored 57.3
Army 57.3

Clarifai
created on 2019-06-07

people 99.9
adult 98.5
group 98.4
administration 95.5
man 94.8
group together 94.7
military 92.5
woman 91.3
leader 91.3
child 90.9
many 90.9
five 89.5
several 89.2
wear 89
war 88.2
three 86.8
four 84.8
two 83.9
home 83.9
portrait 82.2

Imagga
created on 2019-06-07

kin 83.4
man 31.6
people 30.7
male 28.8
adult 25.3
person 24.4
portrait 23.3
child 22.4
couple 21.8
family 21.3
love 20.5
father 19.9
outdoors 19.4
parent 19
happy 18.8
happiness 18
together 17.5
dad 17.3
fun 17.2
mother 16.5
sitting 16.3
face 15.6
smiling 14.5
two 14.4
grandfather 14.3
park 14
outdoor 13.8
beach 12.6
kid 12.4
lifestyle 12.3
hair 11.9
daughter 11.8
married 11.5
cute 11.5
senior 11.2
attractive 11.2
men 11.2
old 11.1
youth 11.1
day 11
summer 10.9
joy 10.9
smile 10.7
loving 10.5
sand 10.5
boy 10.4
home 10.4
outside 10.3
casual 10.2
dress 9.9
little 9.7
bride 9.6
husband 9.5
sit 9.5
guy 9.4
teen 9.2
girls 9.1
pretty 9.1
fashion 9
cheerful 8.9
looking 8.8
women 8.7
work 8.6
elderly 8.6
play 8.6
son 8.6
world 8.4
relationship 8.4
help 8.4
leisure 8.3
grandma 8.3
wedding 8.3
life 8.2
vacation 8.2
romantic 8
grass 7.9
sepia 7.8
sad 7.7
groom 7.7
hand 7.6
head 7.6
togetherness 7.6
bench 7.5
human 7.5
traditional 7.5
mature 7.4
holding 7.4
camera 7.4
emotion 7.4
playing 7.3
children 7.3
aged 7.2
holiday 7.2
childhood 7.2
to 7.1

Google
created on 2019-06-07

Photograph 97.3
People 94.3
Snapshot 87.6
Family 65.7
Photography 62.4
Vintage clothing 60
History 57.6

Microsoft
created on 2019-06-07

sitting 99.2
building 99.1
clothing 98.6
ground 97.9
outdoor 94.9
man 93.3
person 93.2
smile 89.2
old 84.9
footwear 76.9
older 28.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 54.2%
Disgusted 45.1%
Sad 45.2%
Calm 53.5%
Confused 45.6%
Surprised 45.3%
Happy 45.1%
Angry 45.2%

AWS Rekognition

Age 38-59
Gender Male, 50.7%
Surprised 45.2%
Happy 45.1%
Confused 45.3%
Angry 45.6%
Sad 47.6%
Calm 50.9%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Confused 45.1%
Happy 45.1%
Sad 45.4%
Surprised 45.1%
Calm 50.2%
Disgusted 45.2%
Angry 49.1%

AWS Rekognition

Age 19-36
Gender Male, 52.4%
Confused 45.1%
Happy 45%
Sad 45.5%
Surprised 45.1%
Calm 53.7%
Disgusted 45.1%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 52.4%
Calm 46.6%
Disgusted 45.1%
Sad 52.6%
Surprised 45.1%
Angry 45.3%
Happy 45.1%
Confused 45.2%

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

paintings art 85.5%
people portraits 11.5%
streetview architecture 1.9%

Text analysis

Amazon

97:136

Google

99:/36
99:/36