Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: Writing a letter home.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.233.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: Writing a letter home.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.9
Human 99.9
Person 99.8
Person 99.1
Shoe 79.5
Footwear 79.5
Clothing 79.5
Apparel 79.5
Wood 65
Barrel 59.2
Porch 55.1

Imagga
created on 2022-06-25

statue 35.6
sculpture 35
monument 29
newspaper 28.7
old 25.1
ancient 24.2
architecture 24.2
history 23.3
art 21.7
product 21.3
stone 20.4
religion 19.7
military uniform 18.4
creation 17.7
historical 16.9
person 16.7
historic 16.5
building 16.1
marble 15.7
culture 15.4
uniform 15.1
world 14.7
city 14.1
tourism 14
antique 14
daily 12.9
travel 12.7
grandfather 12.5
vintage 12.4
famous 12.1
carving 12.1
landmark 11.7
traditional 11.6
face 11.4
people 11.2
man 10.8
religious 10.3
decoration 10.3
clothing 10.3
kin 10.1
head 10.1
memorial 10.1
dress 9.9
detail 9.7
column 9.3
grave 9.3
tourist 9.1
portrait 9.1
couple 8.7
spirituality 8.6
god 8.6
church 8.3
family 8
home 8
catholic 7.8
past 7.7
golden 7.7
facade 7.7
temple 7.6
house 7.5
patient 7.5
covering 7.4
adult 7.3
aged 7.2
consumer goods 7.2
male 7.1
love 7.1
happiness 7.1

Google
created on 2022-06-25

Blue-collar worker 73.8
Recreation 70.1
Wood 69.8
Vintage clothing 68.8
Tradesman 65.3
Hat 62.9
Monochrome 60
History 59.5
Machine 58.1
Job 57.3
Sitting 55.8
Room 52.1
Desk 50.6

Microsoft
created on 2022-06-25

person 99.3
clothing 97.2
man 77.9
human face 52.8
old 47.8

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Calm 97%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.7%
Disgusted 0.3%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 12-20
Gender Male, 65%
Sad 99.7%
Calm 28.1%
Surprised 6.4%
Fear 6%
Confused 3%
Disgusted 0.4%
Angry 0.4%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 53.3%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.4%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 79.5%

Captions

Microsoft

a group of people sitting on the ground 80.5%
a group of people around each other 77.7%
a group of people sitting in a chair 74.8%

Text analysis

Amazon

12A
Gg 12A
Gg

Google

98124