Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: This picture shows a company of what their fellow citizens call "Never works."
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1250.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: This picture shows a company of what their fellow citizens call "Never works."

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1250.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Nature 99.3
Human 99
Person 99
Person 98.9
Person 98.7
Outdoors 98.6
Person 98.4
Person 98.3
Clothing 98.1
Apparel 98.1
Person 97.7
Person 96.4
Countryside 86.4
Building 78.5
Rural 77.7
People 74.2
Shack 68.8
Hut 68.8
Weather 58.7
Sun Hat 57.5
Hat 50.6

Clarifai
created on 2019-06-07

people 100
group 99
adult 98.7
man 96.8
group together 96.5
child 95.7
military 93.7
many 93.2
home 91.7
several 90.9
administration 90.7
wear 90.2
campsite 90.2
war 90.1
two 88.6
soldier 88.2
three 87.4
five 86.3
offspring 84.4
four 83.2

Imagga
created on 2019-06-07

child 26.1
man 23.5
outdoors 22.3
person 22
kin 21.2
people 21.2
male 20.7
outdoor 20.7
mountain 18.9
summer 17.4
travel 16.9
sky 16.6
hiking 16.4
landscape 15.6
active 14.5
grass 14.2
adventure 14.2
adult 13.6
backpack 12.7
sand 12.5
leisure 12.5
walking 12.3
forest 12.2
outside 12
trekking 11.8
world 11.6
park 11.5
vacation 11.5
autumn 11.4
boy 11.3
rock 11.3
fun 11.2
mountains 11.1
love 11.1
two 11
sport 11
beach 11
uniform 10.9
lifestyle 10.8
activity 10.8
parent 10.7
men 10.3
field 10
sunset 9.9
hiker 9.9
rural 9.7
sea 9.4
military uniform 9.3
desert 9.2
exercise 9.1
old 9.1
recreation 9
backpacking 8.9
together 8.8
stone 8.7
couple 8.7
tree 8.7
work 8.6
tourist 8.6
season 8.6
clouds 8.5
rest 8.4
son 8.3
happy 8.2
fall 8.1
equipment 8.1
natural 8
father 8
dad 8
women 7.9
trek 7.9
hike 7.8
dirt 7.6
brother 7.6
healthy 7.6
clothing 7.5
action 7.4
juvenile 7.4
trees 7.1
day 7.1
track 7
scenic 7

Google
created on 2019-06-07

Photograph 97.2
Snapshot 87.6
Stock photography 77.7
Photography 74.8
Adaptation 74.1
Vintage clothing 64.7
Family 60
Black-and-white 56.4

Microsoft
created on 2019-06-07

outdoor 98.5
clothing 97
grass 96.3
person 94.5
human face 87.1
man 78.1
old 65.7
posing 50.5
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 51.5%
Angry 45.1%
Disgusted 45%
Calm 45.8%
Confused 45.1%
Happy 45%
Sad 53.9%
Surprised 45%

AWS Rekognition

Age 9-14
Gender Female, 51.1%
Confused 45%
Sad 45.1%
Disgusted 45.1%
Calm 45%
Happy 45%
Surprised 45%
Angry 54.8%

AWS Rekognition

Age 45-65
Gender Male, 50.5%
Surprised 45.2%
Angry 45.3%
Happy 45.7%
Confused 45.3%
Disgusted 45.2%
Calm 50.4%
Sad 47.8%

AWS Rekognition

Age 26-43
Gender Male, 52.5%
Surprised 45%
Angry 45.8%
Confused 45%
Calm 45.1%
Sad 53.9%
Happy 45%
Disgusted 45.1%

AWS Rekognition

Age 10-15
Gender Female, 53.3%
Calm 49.4%
Disgusted 46.4%
Confused 45.6%
Surprised 46.1%
Happy 45.9%
Sad 46.3%
Angry 45.4%

AWS Rekognition

Age 45-65
Gender Male, 53.8%
Disgusted 45.4%
Angry 46%
Happy 45.6%
Surprised 45.4%
Calm 48.9%
Confused 45.7%
Sad 48%

AWS Rekognition

Age 10-15
Gender Female, 50.6%
Calm 45.6%
Happy 45.2%
Confused 45.3%
Sad 47.4%
Surprised 45.3%
Angry 50.8%
Disgusted 45.4%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Hat 50.6%

Categories

Imagga

paintings art 93.7%
streetview architecture 2.2%
nature landscape 1.9%

Text analysis

Amazon

sa