Human Generated Data

Title

Michelangelo Buonarroti

Date

18th-19th century

People

Artist: Raphael Morghen, Italian 1758 - 1833

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2786

Human Generated Data

Title

Michelangelo Buonarroti

People

Artist: Raphael Morghen, Italian 1758 - 1833

Date

18th-19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Human 99.2
Person 99.2
Art 97.9
Painting 92.6
Art Gallery 62
Photo 60.6
Photography 60.6
Drawing 59.5
Face 57.7

Clarifai
created on 2019-10-29

portrait 97.4
people 96.8
adult 94.1
one 93.6
wall 90.5
wear 87.2
art 85.4
desktop 84.6
man 84.3
old 79.2
vintage 78.5
blank 78.4
door 77.7
empty 76.1
texture 75.6
abstract 75.4
bill 75.2
retro 75
light 73.1
picture frame 73

Imagga
created on 2019-10-29

currency 35
money 34.9
cash 30.2
dollar 29.7
bill 27.6
finance 25.3
paper 22.2
dollars 21.2
banking 21.1
wealth 20.6
device 20.1
bank 19.8
financial 19.6
business 17.6
old 16.7
banknote 15.5
hundred 15.5
close 15.4
one 14.9
us 14.4
art 14.2
savings 14
symbol 13.5
wall 12.5
portrait 12.3
black 12.2
note 11.9
banknotes 11.7
vintage 10.8
bills 10.7
face 10.6
pay 10.5
notes 10.5
antique 10.4
rich 10.2
president 9.8
design 9.8
sign 9.8
texture 9.7
states 9.7
finances 9.6
mug shot 9.5
exchange 9.5
photograph 9.3
covering 9.3
pattern 8.9
franklin 8.9
profit 8.6
post 8.6
grunge 8.5
push button 8.5
head 8.4
structure 8.4
economy 8.3
dirty 8.1
closeup 8.1
payment 7.7
united 7.6
man 7.4
security 7.3
investment 7.3
representation 7.3
stamp 7.2
concepts 7.1
pick 7
door 7

Google
created on 2019-10-29

Photograph 95.8
Picture frame 86.5
Portrait 76.6
Art 75.5
Facial hair 68.1
Room 65.7
Moustache 62.5
Photography 62.4
Visual arts 55
Painting 54.7
Illustration 54.5
Square 51.2

Microsoft
created on 2019-10-29

human face 99.3
person 96.7
man 92.3
painting 91.4
drawing 89
gallery 87.1
text 84.5
posing 78.1
old 76.9
art 74.9
white 73
clothing 63.6
room 45.2
envelope 30.3
vintage 26.4
picture frame 14.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 98.4%
Disgusted 1.2%
Happy 0.3%
Fear 2.7%
Angry 2.1%
Surprised 85.8%
Calm 2.8%
Sad 0.3%
Confused 4.8%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a vintage photo of a man 71.8%
a man posing for a photo 71.7%
a black and white photo of a man 63.1%