Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: A guardian and his ward.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.273.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.: A guardian and his ward.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.3
Human 99.3
Tie 94.3
Accessories 94.3
Accessory 94.3
Person 93.1
Game 92.9
Chess 77.5

Imagga
created on 2022-06-25

man 32.3
adult 32.2
person 28.4
couple 27.9
attractive 26.6
people 26.2
male 25.8
love 25.3
sexy 24.1
hair 21.4
happy 21.3
body 19.2
sensual 19.1
world 19
fashion 18.9
portrait 18.8
together 18.4
dark 17.5
erotic 17.3
performer 16.2
pretty 16.1
passion 16
blond 15.9
happiness 15.7
black 15.6
model 15.6
two 15.3
sitting 14.6
lifestyle 14.5
one 13.4
holding 13.2
expression 12.8
human 12.8
style 12.6
singer 12
passionate 11.8
romance 11.6
smiling 11.6
posing 11.6
face 11.4
fun 11.2
skin 11.1
sensuality 10.9
dress 10.9
guy 10.8
lady 10.6
musician 10.5
casual 10.2
emotion 10.1
handsome 9.8
romantic 9.8
hugging 9.8
hug 9.7
girlfriend 9.6
looking 9.6
brunette 9.6
seductive 9.6
hands 9.6
rain 9.4
smile 9.3
toilet tissue 9.2
relaxation 9.2
wet 8.9
teacher 8.9
splashes 8.8
room 8.7
device 8.6
married 8.6
joyful 8.3
lingerie 8.2
professional 8.1
interior 8
entertainer 7.9
husband 7.9
intimacy 7.9
emotions 7.8
men 7.7
wall 7.7
sport 7.6
gesture 7.6
studio 7.6
wife 7.6
enjoy 7.5
tissue 7.4
educator 7.3
clothing 7.3
gorgeous 7.3
family 7.1
indoors 7

Google
created on 2022-06-25

Hairstyle 95.1
Furniture 93
Table 91.4
Chair 87.1
Black-and-white 82.9
Flash photography 80.9
Tints and shades 76.3
Vintage clothing 75.4
Tie 74.2
Curtain 72.1
Monochrome photography 71.7
Monochrome 71.5
Event 70.6
Fun 69.4
Shelf 67.2
Sitting 66.7
Room 65.9
Desk 63.8
Conversation 56.7
Toddler 54.6

Microsoft
created on 2022-06-25

person 99.3
human face 95.3
clothing 94.7
indoor 88.4
young 76.1
black 67.5
text 66.5
smile 60.9
posing 57.2
woman 55.2
black and white 51.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 6%
Confused 3.6%
Calm 0.9%
Disgusted 0.6%
Angry 0.5%
Happy 0.1%

AWS Rekognition

Age 6-16
Gender Male, 98.6%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Happy 0.2%
Confused 0%
Disgusted 0%
Angry 0%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 94.3%

Captions

Microsoft

a boy and a girl posing for a photo 49.8%
a boy and girl posing for a photo 43.2%
a boy and a girl sitting on a table 34.7%

Text analysis

Amazon

9898
524
524 and
and
6.60