Human Generated Data

Title

Instruction

Date

1940

People

Artist: Thomas Hart Benton, American 1889 - 1975

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, M10176

Copyright

© T.H. and R.P. Benton Testamentary Trusts / Artists Rights Society (ARS), New York, NY

Human Generated Data

Title

Instruction

People

Artist: Thomas Hart Benton, American 1889 - 1975

Date

1940

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Human 99.4
Person 99.4
Person 99.2
Apparel 98.6
Clothing 98.6
Hat 98.6
People 88.2
Workshop 64.9
Advertisement 64.8
Face 63.9
Military 63.5
Art 61.7
Poster 61.4
Painting 60.9
Military Uniform 59.6
Family 57.3

Clarifai
created on 2018-04-18

people 100
group 99.3
adult 97.9
man 97.4
veil 97.1
lid 95.9
two 95.7
child 94.5
wear 94.2
portrait 94
print 93.7
one 93
woman 92.9
art 92.3
three 88.8
illustration 86.8
five 85
administration 84.8
four 84
leader 83.9

Imagga
created on 2018-04-18

comic book 37.5
currency 35.9
money 34.9
dollar 31.6
cash 29.3
finance 25.3
banking 23.9
bank 23.6
art 23.1
bill 22.8
paper 22
business 20.7
religion 20.6
dollars 20.3
book jacket 19.9
wealth 19.7
financial 18.7
newspaper 18.3
us 18.3
savings 17.7
close 17.7
loan 17.3
one 17.2
culture 17.1
hundred 16.5
ancient 15.6
jacket 15.5
product 15.3
print media 15
vintage 14.9
creation 14.9
church 14.8
finances 14.5
god 14.3
rich 14
old 13.9
economy 13.9
pay 13.4
history 12.5
holy 12.5
exchange 12.4
religious 12.2
temple 12
envelope 11.9
letter 11.9
postmark 11.8
wrapping 11.8
stamp 11.6
mail 11.5
closeup 11.5
puzzle 11.3
icon 11.1
masterpiece 10.9
franklin 10.8
banknotes 10.8
bills 10.7
banknote 10.7
face 10.7
antique 10.5
symbol 10.1
investment 10.1
printed 9.8
retro 9.8
postage 9.8
postal 9.8
painter 9.7
success 9.7
payment 9.6
notes 9.6
sculpture 9.3
jigsaw puzzle 9.2
note 9.2
man 9.1
circa 8.9
funds 8.8
covering 8.7
museum 8.7
profit 8.6
architecture 8.6
sign 8.3
mosaic 8.1
shows 7.9
president 7.9
bible 7.8
black 7.8
fortune 7.7
travel 7.7
artist 7.7
spirituality 7.7
grunge 7.7
post 7.6
capital 7.6
daily 7.5
pattern 7.5
buy 7.5
decoration 7.5
gold 7.4
global 7.3
paint 7.2
treasury 7.1

Google
created on 2018-04-18

Microsoft
created on 2018-04-18

text 100
book 99.6

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 90.8%
Calm 88.3%
Happy 2.1%
Sad 4.9%
Angry 1.7%
Surprised 1%
Disgusted 0.8%
Confused 1.1%

AWS Rekognition

Age 35-52
Gender Male, 98.4%
Confused 8.9%
Surprised 3.1%
Sad 41.6%
Calm 35.7%
Disgusted 2.1%
Angry 7.1%
Happy 1.6%

Feature analysis

Amazon

Person 99.4%
Hat 98.6%
Painting 60.9%

Captions

Microsoft

a man sitting on a book 52.6%
a man sitting on top of a book 52.5%
a man sitting next to a book 52.4%