Human Generated Data

Title

Untitled (Ezra Shahn, Brooklyn, New York City)
Date

Fall 1936-Spring 1937
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4376.5
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Ezra Shahn, Brooklyn, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Fall 1936-Spring 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4376.5

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Hat 100
Cap 100
Boy 99.6
Child 99.6
Male 99.6
Person 99.6
Face 99.5
Head 99.5
Photography 99.5
Portrait 99.5
Jacket 97.9
Coat 91.4
Outdoors 88.8
Pants 84.6
Nature 80.7
Snow 67.3
Scarf 63.6
Bonnet 63.1
Beanie 57.6
Brick 56.8
Window 56.3
Baseball Cap 56.3
Architecture 56.1
Building 56.1
Wall 56.1
Glove 55.9
People 55.4
Vest 55.2

Clarifai
created on 2018-05-10

people 99.8
monochrome 98.8
adult 98.5
child 98.4
portrait 95.4
outdoors 92.9
door 92.8
man 92.4
vertical 90.4
horizontal 89.1
step 88.3
wear 87.3
indoors 85.9
facial expression 85.9
doorway 85.7
wall 81.8
one 79.2
shadow 79.1
street 77.2
window 76.9

Imagga
created on 2023-10-06

child 33.8
person 24.7
people 23.4
wall 21.9
adult 21.4
military uniform 20.8
city 20.8
uniform 19.8
urban 18.4
male 17.9
outdoor 17.6
street 17.5
portrait 16.8
man 16.8
clothing 15.5
juvenile 14.6
lifestyle 13.7
brick 12.9
outdoors 12.7
happy 12.5
parent 12.5
human 12
cute 11.5
fashion 10.6
boy 10.4
alone 10
covering 10
pretty 9.8
attractive 9.8
black 9.8
lady 9.7
consumer goods 9.7
walking 9.5
sitting 9.5
outside 9.4
happiness 9.4
youth 9.4
smile 9.3
building 9.2
one 9
posing 8.9
world 8.8
steps 8.8
men 8.6
dad 8.6
casual 8.5
stone 8.4
old 8.4
prison 8.3
teen 8.3
teenager 8.2
sensuality 8.2
style 8.2
mother 8.1
childhood 8.1
kid 8
love 7.9
couple 7.8
standing 7.8
face 7.8
hat 7.8
architecture 7.8
summer 7.7
lonely 7.7
tourist 7.6
joy 7.5
fun 7.5
looking 7.2
hair 7.1
son 7.1
family 7.1
stairs 7.1
little 7.1
travel 7

Google
created on 2018-05-10

photograph 95.9
black and white 93.4
monochrome photography 83.6
standing 83.1
photography 82.8
snapshot 81.8
male 81.3
sitting 74
monochrome 67.7
human behavior 57.1
stock photography 52.6

Microsoft
created on 2018-05-10

outdoor 99
building 87.3
step 25.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Female, 100%
Happy 93.8%
Surprised 6.5%
Fear 6%
Confused 3.3%
Sad 2.3%
Calm 1.1%
Disgusted 0.2%
Angry 0.1%

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Boy
Child
Male
Person
Coat
Boy 99.6%
Child 99.6%
Male 99.6%
Person 99.6%
Coat 91.4%

Categories

Imagga

streetview architecture 80.2%
paintings art 14.3%
text visuals 2.8%

Text analysis

Amazon

and
neg
Art
of
(Harvard
College
University
Museums)
Fellows
fm
President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4376.0005 inverted fm neg
Harvard
inverted
P1970.4376.0005
President
is
SMITH,
A
TAIS is A BLACK- SMITH,
TAIS
BLACK-

Google

SMITH, P1970.4376.0005 inverted fm neg @ President and Fellows of Harvard College (Harvard University Art Museums)
SMITH,
P1970.4376.0005
inverted
fm
neg
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)