Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: Average type of citizens.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.273.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: Average type of citizens.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.273.1

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Human 99.9
Person 99.9
Person 99.4
Person 98.8
Tree 98.1
Plant 98.1
Person 98
People 94.1
Person 89.5
Chair 73.7
Furniture 73.7
Clothing 67.6
Apparel 67.6
Conifer 67.5
Fir 66.3
Abies 66.3
Outdoors 64.8
Shorts 64.6
Person 62.7
Family 59.3
Vegetation 56.9
Hunting 55

Imagga
created on 2022-06-25

maypole 33.9
trombone 32.2
brass 29.3
post 26.1
wind instrument 26.1
weapon 22.4
park 22.2
outdoors 21.6
man 21.5
upright 21.2
musical instrument 19.4
swing 19.3
rifle 19.2
outdoor 19.1
people 17.8
happy 16.9
fun 16.5
active 16.2
male 15.6
person 15.6
child 14.9
sky 14.7
playing 14.6
firearm 14.2
forest 13.9
structural member 13.5
grass 13.4
autumn 13.2
play 12.9
sport 12.6
gun 12.6
happiness 12.5
tree 11.8
fall 11.8
adult 11.7
leisure 11.6
pole 11.5
instrument 11.4
bassoon 11.1
recreation 10.8
trees 10.7
walk 10.5
summer 10.3
joy 10
travel 9.9
bow and arrow 9.8
innocent 9.7
hiking 9.6
high 9.5
lifestyle 9.4
landscape 8.9
group 8.9
kid 8.9
natural 8.7
boy 8.7
day 8.6
club 8.5
clouds 8.4
power 8.4
children 8.2
vacation 8.2
uniform 7.9
mechanical device 7.8
black 7.8
plaything 7.7
golf 7.6
adventure 7.6
holding 7.4
environment 7.4
cheerful 7.3
smiling 7.2
ball 7.2
portrait 7.1
family 7.1
women 7.1
mountain 7.1
sax 7
together 7

Google
created on 2022-06-25

Sky 92.1
Plant 90.2
Gesture 85.3
Tree 83.6
Tints and shades 76.9
Hat 75.8
Vintage clothing 74.7
Pole 73.1
Monochrome 65.5
History 64.1
Monochrome photography 62.2
People in nature 61.2
Fun 60.2
Child 59.8
Plantation 56.5
Photographic paper 55.9
Suit 53.7
Leisure 51.7
Paper product 50.8
Room 50.1

Microsoft
created on 2022-06-25

tree 100
outdoor 100
clothing 97
person 95.9
man 75.2
text 74.3
group 73.1
people 70.6
boy 68.7
old 65.6
child 57
footwear 51.3
posing 45.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.4%
Confused 0.3%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Female, 92%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 4.5%
Confused 1.5%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 98.6%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Sad 100%
Calm 9%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Disgusted 0.1%
Happy 0%
Angry 0%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 85.8%
Sad 7.1%
Surprised 6.4%
Fear 6.2%
Confused 3.1%
Angry 0.5%
Disgusted 0.5%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Chair 73.7%

Categories

Imagga

streetview architecture 76.6%
nature landscape 20.5%
paintings art 2.3%

Text analysis

Amazon

989A

Google

27