Human Generated Data

Title

The Hunger March

Date

1933

People

Artist: Lewis W. Rubenstein, American 1908 - 2003

Artist: Rico Lebrun, American 1900 - 1964

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Lewis W. Rubenstein, 1933.192

Human Generated Data

Title

The Hunger March

People

Artist: Lewis W. Rubenstein, American 1908 - 2003

Artist: Rico Lebrun, American 1900 - 1964

Date

1933

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 98.7
Painting 98.7
Person 98.5
Human 98.5
Person 96.2
Person 87.8
Apparel 76.8
Clothing 76.8
Horse 75.6
Mammal 75.6
Animal 75.6
Person 73.5
Person 72.9
Person 70.8
Person 58.2

Clarifai
created on 2018-02-09

people 99.8
painting 98.4
adult 98.3
man 98
one 96.1
art 95.5
illustration 94.6
religion 91.4
two 86.7
woman 81.5
group 81.4
cavalry 81
print 80.9
pants 78.2
kneeling 77.3
mammal 77.3
war 77
saint 76.6
color 76.3
position 76.1

Imagga
created on 2018-02-09

footwear 52.8
boot 38.9
shoe 35.7
covering 26.7
old 24.4
column 22.6
shoes 22.1
decoration 19
boots 18.5
clothing 17.7
leather 17.1
pair 16
lace 15.8
design 15.4
graffito 15.3
tattoo 14.7
black 14.4
structure 14.3
foot 14.3
style 14.1
dirty 13.5
sole 12.8
art 12.1
religion 11.6
wear 11.5
grunge 11.1
money 11.1
cash 11
financial 10.7
fashion 10.5
worn 10.5
detail 10.5
brown 10.3
banking 10.1
currency 9.9
gold 9.9
bank 9.8
leg 9.8
hiking 9.6
used 9.6
object 9.5
culture 9.4
finance 9.3
close 9.1
antique 8.7
faith 8.6
golden 8.6
temple 8.5
travel 8.4
color 8.3
sport 8.2
exercise 8.2
closeup 8.1
wealth 8.1
work 7.8
holy 7.7
two 7.6
walk 7.6
bill 7.6
equipment 7.6
wood 7.5
sandal 7.5
religious 7.5
traditional 7.5

Google
created on 2018-02-09

art 74.4
painting 65.6
horse like mammal 63.9
shoe 63.1
mural 60.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 60-80
Gender Female, 70.3%
Happy 8%
Sad 19.9%
Confused 5.5%
Angry 6.8%
Surprised 6.3%
Calm 43.3%
Disgusted 10.3%

AWS Rekognition

Age 30-47
Gender Male, 61.5%
Happy 2.7%
Calm 66.1%
Confused 1.9%
Sad 13.8%
Surprised 2.1%
Angry 3.9%
Disgusted 9.5%

Feature analysis

Amazon

Painting 98.7%
Person 98.5%
Horse 75.6%

Captions

Microsoft

a group of people sitting in a chair 26.1%
a group of people in a room 26%
a group of shoes on the floor 25.9%

Text analysis

Amazon

AN
AN D
D
lief.
ON
5O
ASHING
MNTEP

Google

AND te
te
AND