Human Generated Data

Title

Untitled (man with straw cape and hat)
Date

c. 1875
People

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.20

Human Generated Data

Title

Untitled (man with straw cape and hat)

People

Artist: Raimund von Stillfried-Ratenicz, Austrian 1839 - 1911

Date

c. 1875

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Apparel 98.7
Clothing 98.7
Person 93.7
Human 93.7
Art 87.1
Face 86.4
Portrait 75.6
Photography 75.6
Photo 75.6
Hat 74.4
Painting 72
Sun Hat 72
Female 69.1
People 64.7
Girl 59.3
Text 56.9
Drawing 56.8
Sketch 55.5

Clarifai
created on 2018-03-16

people 99.6
one 99.2
print 98.2
adult 97.9
art 97.2
wear 96
woman 95.1
mammal 95.1
portrait 94.1
veil 93.3
man 91.8
cavalry 90
retro 89.2
lid 88.3
painting 86.5
engraving 84.4
illustration 81.6
lithograph 78.8
vintage 77.7
profile 77.7

Imagga
created on 2018-03-16

hat 23.3
book jacket 23
portrait 22.6
product 22.6
jacket 20.2
wicker 20
money 18.7
person 17.9
creation 17.7
ruler 17.3
currency 17
face 17
covering 16.9
dollar 16.7
close 16.5
work 16
bill 14.3
wrapping 13.6
finance 13.5
people 12.8
cash 12.8
closeup 12.8
bank 12.5
man 12.1
banking 11.9
adult 11.8
religion 11.6
male 11.3
art 11.3
attractive 11.2
culture 11.1
financial 10.7
happy 10.6
lady 10.5
old 10.4
happiness 10.2
head 10.1
fashion 9.8
pretty 9.8
outdoors 9.7
dollars 9.7
us 9.6
statue 9.6
exchange 9.5
paper 9.4
smile 9.3
clothing 9.2
business 9.1
newspaper 8.9
lovely 8.9
sexy 8.8
banknote 8.7
pay 8.6
model 8.6
sculpture 8.4
black 8.4
church 8.3
traditional 8.3
vintage 8.3
one 8.2
wealth 8.1
sketch 8
smiling 8
lifestyle 7.9
hair 7.9
architecture 7.8
ancient 7.8
travel 7.7
golden 7.7
summer 7.7
leisure 7.5
famous 7.4
symbol 7.4
gold 7.4
book 7.4
cute 7.2
holiday 7.2
prayer rug 7.1

Google
created on 2018-03-16

picture frame 86.7
art 84.6
portrait 64.6
vintage clothing 61
artwork 59.6
painting 58.2
drawing 52.3
visual arts 51.1

Microsoft
created on 2018-03-16

text 98.2
old 46.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 98.2%
Calm 16.3%
Disgusted 22.7%
Angry 34.7%
Surprised 3.7%
Confused 14%
Sad 7%
Happy 1.6%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.7%
Painting 72%

Captions

Microsoft

an old photo of a person 71.9%
old photo of a person 66.9%
a person holding a bat 16.6%

Text analysis

Amazon

1387-0
Hrteo