Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)
Date

May 1934-June 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4143
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4143

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Baseball Cap 100
Cap 100
Clothing 100
Hat 100
Photography 99.9
Face 99.9
Head 99.9
Portrait 99.9
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Body Part 98.9
Neck 98.9
People 98.8
Finger 98.4
Hand 98.4
Person 96.2
Person 84.3
Person 69.9
Outdoors 56.4
Accessories 56.4
Goggles 56.4
Art 56.2
Collage 56.2
T-Shirt 55.7
Smoke 55.6
Worker 55.6
Coat 55.3
Sun Hat 55.3
Hardhat 55.1
Helmet 55.1

Clarifai
created on 2018-05-10

people 99.8
man 98.7
adult 98
portrait 96.6
group 95.6
facial expression 95.4
woman 95.3
wear 92.7
child 91.9
two 91
bald 90.4
three 90.2
group together 88.8
love 84.3
administration 84.2
four 83.5
son 82.6
family 81.3
monochrome 80.5
indoors 79.9

Imagga
created on 2023-10-06

man 41.7
couple 35.7
people 32.9
happy 30.7
mother 30.5
male 30.2
senior 30
grandfather 29.4
parent 28.6
kin 28.5
adult 27.8
portrait 27.2
love 26
person 24
elderly 23.9
smile 23.5
sibling 23.1
old 19.5
face 19.2
smiling 18.8
together 17.5
retired 17.5
father 17.3
husband 17.3
mature 16.7
dad 16.4
married 16.3
family 16
wife 15.2
handsome 14.3
child 13.8
grandmother 13.7
expression 13.6
happiness 13.3
looking 12.8
women 12.7
grandma 12.4
hair 11.9
affection 11.6
lifestyle 11.6
guy 11.4
marriage 11.4
human 11.2
fun 11.2
men 11.2
casual 11
romance 10.7
romantic 10.7
retirement 10.6
attractive 10.5
home 10.4
relationship 10.3
head 10.1
aged 10
gray 9.9
hand 9.9
affectionate 9.7
look 9.6
black 9.6
eyes 9.5
suit 9
outdoors 9
lady 8.9
laughing 8.5
two 8.5
professional 8.4
pretty 8.4
joy 8.3
girls 8.2
cheerful 8.1
daughter 8.1
businessman 7.9
business 7.9
day 7.8
hat 7.8
model 7.8
loving 7.6
age 7.6
adults 7.6
friends 7.5
holding 7.4
car 7.4
worker 7.2
world 7.2
lovely 7.1
job 7.1
summer 7.1

Google
created on 2018-05-10

white 96.3
photograph 95.8
black 95.7
black and white 93.2
person 93.1
man 92.8
monochrome photography 88
photography 83.2
male 80.4
monochrome 77.1
human 73.7

Microsoft
created on 2018-05-10

person 95.1
old 75.9
posing 35.9
older 27

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 49-57
Gender Male, 99.1%
Sad 99.8%
Calm 23.2%
Surprised 6.5%
Fear 6%
Confused 3.3%
Happy 1.2%
Disgusted 0.7%
Angry 0.5%

AWS Rekognition

Age 48-54
Gender Male, 94.3%
Calm 63.8%
Confused 18.9%
Fear 7.8%
Surprised 6.9%
Sad 5.1%
Disgusted 2.3%
Happy 1.5%
Angry 1.3%

AWS Rekognition

Age 20-28
Gender Female, 53.9%
Fear 81.2%
Sad 16.4%
Calm 10.5%
Surprised 7%
Confused 3.2%
Happy 2.6%
Disgusted 1.9%
Angry 1.9%

Feature analysis

Amazon

Person
Adult
Male
Man
Person 99.4%
Person 99.4%
Person 99.3%
Person 96.2%
Person 84.3%
Person 69.9%
Adult 99.4%
Adult 99.4%
Adult 99.3%
Male 99.4%
Male 99.4%
Male 99.3%
Man 99.4%
Man 99.4%
Man 99.3%

Text analysis

Amazon

Harvard
College
Art
and
University
(Harvard
of
President and Fellows of Harvard College (Harvard University Art Museums)
Fellows
Museums)
President
P1970.4143.0000

Google

President and Fellows of Harvard College (Harvard University Art Museums) P1970.4143.0000
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.4143.0000