Human Generated Data

Title

"Düsseldorf..."

Date

20th century

People

Artist: Joseph Beuys, German 1921 - 1986

Classification

Prints

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, The Willy and Charlotte Reber Collection, Louise Haskell Daly Fund, 1995.702

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

"Düsseldorf..."

People

Artist: Joseph Beuys, German 1921 - 1986

Date

20th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Hat 98.8
Clothing 98.8
Apparel 98.8
Advertisement 98.7
Person 98.2
Human 98.2
Person 98.1
Poster 96.6
Person 96.3
Word 91.7
Paper 91.4
Brochure 91.4
Flyer 91.4
Text 85.7
Collage 68.2
Face 67.1
Art 65.7
Label 58
People 55.3

Clarifai
created on 2019-11-09

man 98.8
people 98
portrait 97.3
person 93.5
adult 91
retro 90.5
face 86
beard 85
lid 83.5
illustration 82.8
business 79.3
bill 78.1
mustache 77.1
famous 76
art 75.9
young 75.6
leader 75.4
desktop 74
vintage 72.6
fashion 72.5

Imagga
created on 2019-11-09

book jacket 56.9
jacket 46.2
magazine 39.8
creation 35.5
man 34.3
wrapping 33.6
product 31.2
male 29.8
mug shot 27.5
portrait 27.2
comic book 25
person 24.6
covering 22.5
photograph 22.3
money 22.1
face 20.6
people 20.1
black 19.8
close 19.4
currency 18.9
adult 16.8
representation 16.5
business 15.8
one 15.7
cash 15.6
dollar 14.9
serious 14.3
head 13.4
bill 13.3
old 13.2
vintage 13.2
banking 12.9
stamp 12.6
handsome 12.5
mail 12.4
letter 11.9
finance 11.8
postmark 11.8
studio 11.4
human 11.2
bank 11
paper 11
alone 11
dark 10.9
art 10.9
closeup 10.8
financial 10.7
professional 10.1
model 10.1
message 10
print media 10
wealth 9.9
philately 9.9
circa 9.9
envelope 9.7
banknote 9.7
dollars 9.7
guy 9.7
eyes 9.5
card 9.4
aged 9
retro 9
postage 8.8
postal 8.8
happy 8.8
hair 8.7
boy 8.7
ancient 8.6
us 7.7
finances 7.7
attractive 7.7
expression 7.7
savings 7.5
economy 7.4
note 7.4
looking 7.2

Google
created on 2019-11-09

Poster 92.1
Font 78.3
Album cover 64.8
Art 62.5
Photo caption 61.6
Retro style 58.6
Facial hair 55.5
Illustration 54.5
Moustache 50.8

Microsoft
created on 2019-11-09

text 100
human face 98.5
man 96
book 95.4
person 94.2
poster 91.2
hat 86.2
human beard 71.6
clothing 70.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Female, 79.5%
Surprised 0%
Angry 0%
Calm 0.4%
Sad 99.4%
Confused 0.1%
Disgusted 0%
Happy 0%
Fear 0.1%

AWS Rekognition

Age 32-48
Gender Male, 99.5%
Disgusted 2%
Surprised 0.7%
Happy 0.1%
Confused 0.5%
Fear 0.4%
Sad 1.1%
Angry 1.8%
Calm 93.4%

AWS Rekognition

Age 22-34
Gender Male, 93.2%
Happy 0%
Fear 0%
Calm 81.1%
Disgusted 0%
Surprised 0%
Confused 0.2%
Angry 0%
Sad 18.7%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 98.8%
Person 98.2%
Poster 96.6%

Captions

Microsoft

Joseph Beuys and text 78.2%
a close up of Joseph Beuys 77.9%
a close up of Joseph Beuys and text 77.8%

Text analysis

Amazon

BEUYS
HEINE
BEUYS HEINE WILP
WILP
"DUSSELDORF..."

Google

BEUYS
"DÜSSELDOR..
BEUYS HEINE WILP "DÜSSELDOR..
HEINE
WILP