Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.235.4

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Clothing 99.9
Apparel 99.9
Overcoat 99.2
Coat 99.2
Person 98.1
Human 98.1
Person 97
Tuxedo 84.5
Face 83.2
Jacket 79.7
Blazer 79.7
People 75.9
Suit 71.5

Imagga
created on 2022-06-25

military uniform 100
uniform 89.1
clothing 68
covering 45
consumer goods 44.4
male 38.4
man 37
people 35.7
happy 34.5
adult 33
senior 32.8
smiling 31.8
portrait 29.8
person 29.7
family 25.8
smile 24.2
couple 23.5
commodity 21.5
child 21.1
old 20.2
elderly 20.1
kin 20
love 19.7
happiness 19.6
mature 19.5
together 18.4
lifestyle 18.1
grandfather 17.6
looking 16
standing 15.6
cheerful 15.4
husband 15.3
retired 14.5
wife 14.2
handsome 13.4
attractive 13.3
boy 13
camera 12.9
home 12.8
casual 12.7
two 12.7
professional 12.7
retirement 12.5
group 12.1
face 12.1
mother 11.9
suit 11.9
business 11.5
park 11.5
job 11.5
lady 11.4
outdoors 11.2
men 11.2
innocent 11.1
women 11.1
sibling 11
father 11
confident 10.9
grandmother 10.8
indoors 10.5
human 10.5
cute 10
joy 10
jacket 10
holding 9.9
studio 9.9
kid 9.7
health 9.7
businessman 9.7
affectionate 9.7
confidence 9.6
parent 9.3
20s 9.2
hand 9.1
office 8.8
60s 8.8
30s 8.7
laughing 8.5
fun 8.2
alone 8.2
one 8.2
medical 7.9
hair 7.9
vertical 7.9
seniors 7.9
work 7.8
day 7.8
forest 7.8
corporate 7.7
married 7.7
loving 7.6
females 7.6
togetherness 7.6
leisure 7.5
guy 7.5
blond 7.3
playing 7.3
success 7.2
aged 7.2
gray 7.2
life 7.1
worker 7.1
model 7

Google
created on 2022-06-25

Face 98.3
Smile 97.8
Outerwear 95.4
Hairstyle 95.1
White 92.2
Coat 91.2
Standing 86.4
Gesture 85.3
Collar 83.7
Suit 83.1
Blazer 77.9
Happy 77.1
Vintage clothing 76.4
Formal wear 72.5
Uniform 70
Child 67.2
Monochrome 65.2
History 64.3
Fun 63.4
Stock photography 62.5

Microsoft
created on 2022-06-25

person 100
old 98.3
smile 97.3
human face 96.5
posing 95.9
man 95.3
clothing 95.1
standing 90
outdoor 89.8
black 87.3
white 83.1
text 79.9
suit 78.1
boy 68.6
photograph 67.6
vintage 65.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 99.7%
Happy 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Calm 0%

AWS Rekognition

Age 16-24
Gender Male, 85.5%
Happy 92.4%
Surprised 6.5%
Fear 6%
Calm 4.4%
Sad 2.2%
Confused 1.5%
Angry 0.3%
Disgusted 0.3%

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Suit 71.5%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 90%
a vintage photo of a man in a suit posing for a picture 89.9%
a vintage photo of a man in a suit posing for the camera 89.8%

Text analysis

Amazon

13
G.J. 13
G.J.

Google

98.13