Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.273

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.273

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Person 99.7
Human 99.7
Person 98.8
Person 98.8
Person 97.8
Person 96.2
Person 90.6
Face 83.9
People 82.8
Person 81.2
Tree 79
Plant 79
Text 77.5
Person 73.3
Female 72.8
Person 71.5
Portrait 67.2
Photography 67.2
Photo 67.2
Door 67
Poster 65.1
Advertisement 65.1
Military Uniform 64.4
Military 64.4
Girl 60.7
Person 60.6
Tie 59.6
Accessories 59.6
Accessory 59.6
Clothing 59.1
Apparel 59.1

Imagga
created on 2022-06-04

negative 21.8
film 18.7
people 15.6
portrait 15.5
old 15.3
black 14.5
man 14.1
vintage 14.1
newspaper 13.5
photographic paper 12.9
person 12
one 11.9
money 11.9
creation 11.8
head 11.8
product 10.7
face 10.6
art 10.5
device 10.4
grunge 10.2
world 10
male 9.9
currency 9.9
paper 9.8
hair 9.5
adult 9.3
power 9.2
relaxation 9.2
house 9.2
human 9
photographic equipment 9
locker 8.8
looking 8.8
model 8.6
office 8.3
fashion 8.3
mug shot 8
sexy 8
life 7.9
billboard 7.9
business 7.9
pretty 7.7
wall 7.7
fastener 7.7
card 7.6
window 7.6
happy 7.5
letter 7.3
photograph 7.3
alone 7.3
blackboard 7.3
sensuality 7.3
student 7.2
dirty 7.2
cute 7.2
room 7

Google
created on 2022-06-04

Plant 90.2
Black 89.8
Standing 86.4
Tree 81.9
Adaptation 79.2
Vintage clothing 77.8
Tints and shades 77
Art 73.4
History 66.9
Event 64.2
Visual arts 63.3
Room 61.8
Photograph album 60.5
Monochrome photography 60.4
Monochrome 59
Photographic paper 58.1
Paper product 55.4
Retro style 54.7
Chair 53.9
Photo caption 52.9

Microsoft
created on 2022-06-04

text 99.5
clothing 94.1
person 93.7
woman 90
black and white 77.5
posing 59.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Sad 100%
Surprised 6.4%
Fear 5.9%
Confused 3.3%
Calm 1.2%
Angry 0.6%
Disgusted 0.6%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Female, 89%
Sad 100%
Surprised 6.3%
Fear 6.1%
Confused 0.5%
Calm 0.2%
Disgusted 0.1%
Happy 0%
Angry 0%

AWS Rekognition

Age 6-12
Gender Male, 97.3%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Happy 0.3%
Disgusted 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Male, 98.8%
Calm 74.7%
Happy 7.9%
Fear 7.2%
Surprised 7%
Sad 4%
Disgusted 3.9%
Angry 3.2%
Confused 1.4%

AWS Rekognition

Age 25-35
Gender Female, 54.4%
Disgusted 32.3%
Angry 28.6%
Calm 15.2%
Happy 8.4%
Surprised 8.2%
Sad 7.2%
Fear 6.6%
Confused 1.5%

AWS Rekognition

Age 13-21
Gender Male, 93.1%
Sad 100%
Calm 11.9%
Surprised 6.3%
Fear 5.9%
Confused 0.7%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Male, 98.2%
Angry 43.7%
Sad 27.4%
Calm 27%
Surprised 7.1%
Fear 6.4%
Confused 3.5%
Disgusted 2.2%
Happy 0.7%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%
Tie 59.6%

Categories

Imagga

paintings art 99.8%

Captions

Microsoft
created on 2022-06-04

a woman posing for a photo 88.8%
an old photo of a woman 86.8%
a man and a woman posing for a photo 57.4%

Text analysis

Amazon

and
type
his
Average
A
of
guardian
A guardian and his ward.
Average type of citizens.
ward.
citizens.
9996
GS9A

Google

Average type of citizens. A guardian and his ward.
Average
type
of
citizens
.
A
guardian
and
his
ward