Human Generated Data

Title

Untitled (May Day Parade, Communist Party route, probably Union Square, New York City)

Date

May 1, 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5595

Human Generated Data

Title

Untitled (May Day Parade, Communist Party route, probably Union Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1, 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5595

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Apparel 99.9
Clothing 99.9
Person 99.6
Human 99.6
Hat 99.3
Hat 98.6
Person 95.7
Hat 91.7
Person 91.5
Helmet 85.2
Sun Hat 85.2
Hat 82.5
Cowboy Hat 75.8
Art 68.3
Text 67.7
Hat 64.5
Cake 57.9
Dessert 57.9
Food 57.9
Hat 57.6
Sombrero 57.6
Label 56.9
Person 50.8

Clarifai
created on 2019-11-11

people 99.2
adult 96.2
group 94.4
man 93.6
no person 93.4
lid 91.2
veil 90.2
indoors 90
one 90
wear 89.5
furniture 88.1
chair 87.7
stock 87.4
restaurant 86.9
woman 86.2
vehicle 85.3
seat 85.3
street 84.6
portrait 83.8
art 83

Imagga
created on 2019-11-11

room 42.6
interior 34.5
table 33.5
toilet 33
furniture 32.5
decor 23
chair 22.1
home 20.7
seat 17.6
house 17.5
glass 16.8
modern 16.8
decoration 16.6
restaurant 15.6
design 15.2
architecture 14.8
wall 13.8
luxury 12.8
window 12.8
toilet seat 12.8
kitchen 12.5
shop 12
style 11.9
wood 11.7
comfortable 11.4
indoors 11.4
furnishing 11.2
old 11.1
dinner 10.9
elegance 10.9
building 10.8
elegant 10.3
floor 10.2
container 9.8
metal 9.6
black 9.6
apartment 9.6
party 9.4
barbershop 9.4
light 9.3
decorative 9.2
desk 8.8
chairs 8.8
flowers 8.7
setting 8.7
ancient 8.6
dining 8.6
food 8.4
vase 8.4
place 8.4
vessel 8.2
office 8.1
mercantile establishment 8.1
business 7.9
cabinet 7.8
stove 7.7
flower 7.7
lamp 7.6
drink 7.5
clean 7.5
service 7.4
inside 7.4
indoor 7.3
antique 7
wooden 7

Google
created on 2019-11-11

Snapshot 83.6
Art 62.5
Photography 62.4
History 54.1

Microsoft
created on 2019-11-11

drawing 98.7
text 98.3
cartoon 96.4
sketch 85.2
hat 81.9
art 76.2
illustration 61
painting 57.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 17-29
Gender Male, 55%
Angry 45.3%
Calm 53.7%
Disgusted 45.1%
Confused 45%
Sad 45.2%
Surprised 45.1%
Fear 45.1%
Happy 45.4%

AWS Rekognition

Age 7-17
Gender Male, 50.4%
Fear 45.7%
Confused 45.1%
Sad 52.3%
Happy 45%
Disgusted 45%
Calm 46.1%
Angry 45.6%
Surprised 45.1%

AWS Rekognition

Age 19-31
Gender Male, 54.2%
Happy 45.2%
Disgusted 45%
Confused 45.1%
Fear 45.2%
Surprised 45.6%
Sad 45.4%
Calm 51.7%
Angry 46.8%

AWS Rekognition

Age 30-46
Gender Male, 96.3%
Happy 2.1%
Angry 38.4%
Calm 2.9%
Confused 2%
Fear 10.9%
Disgusted 2.7%
Sad 38.1%
Surprised 2.9%

Feature analysis

Amazon

Person 99.6%
Hat 99.3%
Helmet 85.2%

Categories

Captions

Microsoft
created on 2019-11-11

a stack of flyers on a table 60.3%
an old photo of a person 39.3%
an old photo of a person 35.2%

Text analysis

Amazon

MPORTERS
OF
FOR
RY
PEYER
ARDO
RY MPORTERS & GIPTNOVELTIES OF
PEYER BR
&
YOUR
BR
RAIS
A
NOVEITY
APENNY
GIPTNOVELTIES
ARDO ORXCE FOR JACR YOUR SH
SH
ORXCE
LL
TOCAL
SCET A APENNY TOCAL
Boss
JACR
4P
SCET

Google

BR
SaRs
ORKER
1OCAL
PENNT
FOR
U
MPORTERS
OF
RY&GIFT
PEYER BR SaRs ORKER 1OCAL RAISE A PENNT FOR U ARDO NOVELTY MPORTERS OF RY&GIFT NOVELTIES
PEYER
RAISE
A
ARDO
NOVELTY
NOVELTIES