Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.235.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.235.2

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.8
Human 99.8
Person 99.5
Person 98.5
Meal 91.4
Food 91.4
Clothing 88.1
Apparel 88.1
People 86.8
Outdoors 80.4
Picnic 74.2
Vacation 74.2
Leisure Activities 74.2
Grass 70.2
Plant 70.2
Face 65.6
Crowd 60.5
Shorts 58.5
Nature 57.1
Female 56.7
Hat 56
Field 55.6

Imagga
created on 2022-06-25

kin 72.4
man 39.6
male 34.8
family 34.7
happy 34.4
park 32.9
people 32.9
together 32.4
love 31.5
couple 31.3
happiness 29
outdoors 27.6
portrait 25.9
adult 23.9
smile 23.5
mother 23.4
smiling 23.1
grandfather 23.1
child 23
outdoor 21.4
senior 20.6
father 20.4
husband 20.3
togetherness 19.8
daughter 18.3
outside 18
joy 17.5
lifestyle 17.3
wife 17.1
sibling 16.9
person 16.6
boy 16.5
military uniform 16.4
clothing 16.2
two 16.1
relationship 15.9
fun 15.7
casual 15.2
mature 13.9
cheerful 13.8
son 13.5
married 13.4
garden 13.4
day 13.3
attractive 13.3
autumn 13.2
parent 12.9
group 12.9
buddy 12.8
uniform 12.6
affection 12.5
elderly 12.4
summer 12.2
sitting 12
old 11.8
leisure 11.6
affectionate 11.6
romance 11.6
romantic 11.6
cute 11.5
women 11.1
children 10.9
face 10.6
dad 10.5
loving 10.5
enjoying 10.4
pair 10.4
rest 10.2
holding 9.9
brother 9.9
childhood 9.8
kid 9.7
life 9.7
grass 9.5
men 9.4
friendship 9.4
girls 9.1
fall 9
handsome 8.9
home 8.8
retired 8.7
play 8.6
laughing 8.5
serene 8.5
relaxed 8.4
countryside 8.2
relaxing 8.2
bond 7.8
mum 7.8
youth 7.7
hand 7.6
marriage 7.6
relax 7.6
females 7.6
enjoy 7.5
friends 7.5
20s 7.3
playing 7.3
aged 7.2
looking 7.2
bench 7.2
grandma 7
season 7

Google
created on 2022-06-25

Plant 91.9
Headgear 83.3
Tree 81.3
Hat 80.4
Vintage clothing 76.3
Monochrome 70.6
Sitting 68.9
History 67.1
Event 67.1
Stock photography 64.1
Crew 61.6
Uniform 60.5
Grass 52.5
Military organization 52.5
Retro style 52.4
Photography 51.9

Microsoft
created on 2022-06-25

outdoor 100
person 99.8
tree 99.4
grass 98.8
clothing 97.8
human face 94.3
old 92.6
black 87.6
smile 85.7
posing 83.3
text 82.1
white 79.3
group 78.3
man 63.2
mammal 54.5
vintage 50.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 96.1%
Surprised 6.3%
Fear 5.9%
Happy 2.9%
Sad 2.2%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 13-21
Gender Female, 100%
Calm 78.4%
Sad 29.6%
Surprised 6.3%
Fear 5.9%
Angry 0.4%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Male, 100%
Calm 44%
Angry 32.4%
Confused 20.1%
Surprised 6.5%
Fear 6.2%
Sad 2.5%
Disgusted 0.8%
Happy 0.3%

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Categories

Imagga

paintings art 61.4%
people portraits 37.3%

Text analysis

Amazon

17

Google

178