Human Generated Data

Title

Untitled (Ezra Shahn, Brooklyn, New York City)
Date

Fall 1936-Spring 1937
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4376.6
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Ezra Shahn, Brooklyn, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Fall 1936-Spring 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4376.6

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Jacket 100
Face 100
Head 100
Photography 100
Portrait 100
Person 99.6
Boy 99.6
Child 99.6
Male 99.6
Coat 87.3
Scarf 81.9
Overcoat 66
Hat 57.3
Vest 57.2
Body Part 57
Finger 57
Hand 57
Outdoors 56.9
Knitwear 56.6
Sweater 56.6
Pants 56.3

Clarifai
created on 2018-05-10

people 99.9
monochrome 99.3
child 99
one 97.8
adult 97.2
portrait 96
man 95.6
step 92.5
vertical 90.7
sit 88.8
wear 87
street 86.3
boy 86.2
sadness 81.6
indoors 81.1
outdoors 78.3
facial expression 77.8
administration 75
black and white 74.9
concentration 74.1

Imagga
created on 2023-10-07

child 54
person 32.8
people 28.5
outdoors 26.3
park 22.2
little 22.1
portrait 21.4
kid 21.3
school 21.2
outdoor 20.7
cute 20.1
childhood 19.7
fun 19.5
happy 19.4
bench 19.2
male 19.1
boy 18.3
world 17.6
summer 17.4
lifestyle 17.4
smile 17.1
youth 17
sitting 16.3
man 16.1
one 15.7
happiness 15.7
outside 15.4
building 15.1
juvenile 15.1
hair 15.1
city 15
adult 14.9
toddler 14.3
face 14.2
love 14.2
pretty 14
urban 14
play 13.8
teenager 13.7
children 13.7
joy 13.4
family 13.4
street 12.9
teen 12.9
son 12.8
brother 12.6
smiling 12.3
human 12
leisure 11.6
cheerful 11.4
couple 11.3
structure 11.2
alone 11
active 10.8
sad 10.6
parent 10.5
walk 10.5
walking 10.4
park bench 10.4
women 10.3
grass 10.3
blond 10.3
casual 10.2
girls 10
clothing 10
attractive 9.8
sadness 9.8
daughter 9.7
autumn 9.7
looking 9.6
day 9.4
adorable 9.2
playing 9.1
recreation 9
lady 8.9
depression 8.8
togetherness 8.5
stone 8.4
offspring 8.4
mother 8.3
road 8.1
handsome 8
life 7.9
look 7.9
preschooler 7.8
stairs 7.8
wall 7.7
expression 7.7
old 7.7
two 7.6
enjoying 7.6
sit 7.6
fall 7.2
activity 7.2
brick 7.1
together 7

Google
created on 2018-05-10

photograph 96.2
person 93.5
black and white 93.2
standing 90.5
sitting 90
child 87.3
monochrome photography 84.5
photography 83.4
male 82.6
snapshot 81.8
boy 79.3
human behavior 75.9
human 70.1
monochrome 66.9
girl 64.2
smile 53.3
stock photography 52.4

Microsoft
created on 2018-05-10

person 99.3
boy 97.8
outdoor 97.5
little 95.4
young 94.5
child 90.8
toddler 34.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 81.8%
Happy 94.9%
Surprised 6.3%
Fear 6%
Sad 3.5%
Confused 0.5%
Calm 0.2%
Angry 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Boy
Child
Male
Coat
Scarf
Person 99.6%
Boy 99.6%
Child 99.6%
Male 99.6%
Coat 87.3%
Scarf 81.9%

Text analysis

Amazon

Art
University
College
(Harvard
of
fm
neg
and
President and Fellows of Harvard College (Harvard University Art Museums)
Fellows
Harvard
inverted
Museums)
P1970.4376.0006 inverted fm neg
is
P1970.4376.0006
A
President
SMITH,
This is A BLACK SMITH,
BLACK
This

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4376.0006 inverted fm neg
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4376.0006
inverted
fm
neg