Human Generated Data

Title

Untitled (New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4258

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.6
Apparel 99.6
Human 98.9
Person 98.9
Advertisement 92.1
Person 91.7
Person 91.7
Person 91.6
Helmet 84.9
Person 83.8
Poster 80.2
Hat 77.6
Building 76
City 76
Town 76
Urban 76
Metropolis 76
Flyer 72.2
Brochure 72.2
Paper 72.2
Collage 71.8
Kiosk 67.6
Sun Hat 65.3
Text 61.8
Overcoat 61.8
Coat 61.8
Person 52.2

Imagga
created on 2022-01-08

newspaper 73
product 55.5
creation 44.6
grunge 23.8
old 19.5
vintage 19
paper 18.1
silhouette 16.6
design 16.3
sax 16
drawing 15.2
architecture 14.1
texture 13.9
black 13.3
art 13.2
retro 13.1
pattern 13
man 12.9
building 12.9
male 12.8
city 12.5
business 12.2
ancient 12.1
person 11.6
plan 11.3
antique 11.3
finance 11
grungy 10.4
decoration 10.4
graffito 10.4
people 10
house 10
paint 10
dirty 9.9
graphic 9.5
construction 9.4
sketch 9.4
aged 9
businessman 8.8
wall 8.8
diagram 8.6
frame 8.3
success 8
office 8
text 7.9
travel 7.7
money 7.7
chart 7.6
worn 7.6
print 7.5
world 7.5
symbol 7.4
brown 7.4
color 7.2
currency 7.2
tracing 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 99.9
handwriting 94.6
street 90.9
person 85.1
clothing 83.3
woman 63.5
monochrome 55.6

Face analysis

Amazon

AWS Rekognition

Age 45-53
Gender Male, 79.3%
Calm 99.1%
Surprised 0.3%
Sad 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

Feature analysis

Amazon

Person 98.9%
Helmet 84.9%
Poster 80.2%

Captions

Microsoft

a person standing in front of a store 40.1%
a person holding a sign 40%
an old photo of a store 39.9%

Text analysis

Amazon

KISSES
5
Original
RAISINS
NUTS
2
HERSHEY'S
The Original
CASHEW
MILK
The
FRESH
CHOCOLATE
BAG
PISTACHIO
OLYMPIC
ALSO RAISINS
FRANKLIN
A
ALSO
FOR
ROASTED
SWEET MILK
BRAUL NUTS
x FRANKLIN OLYMPIC
2 cugs FOR
SWEET
&
BRAUL
SB 9 3
20:5
x
cugs

Google

ANKOIZTLTEFRANKLIN
CASHEW
MILK
CHOCOLATE
S
HERSHEY'S
2
83
1IMMRNTINUT
The
RAASTED
ARAISINS
PSTACHO
NUTS
4
BAG
ANKOIZTLTEFRANKLIN OLYMPI CASHEW FRES The Original RAASTED HERSHEY'S ERATIL ARAISINS PSTACHO NUTS KISSES SWELT MILK 4 CHOCOLATE 15 2 BAG S B 83 1IMMRNTINUT
FRES
ERATIL
SWELT
15
OLYMPI
Original
KISSES
B