Human Generated Data

Title

Christopher Columbus

Date

19th century

People

Artist: Johann Wilhelm Baumann, German 19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R13911

Human Generated Data

Title

Christopher Columbus

People

Artist: Johann Wilhelm Baumann, German 19th century

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Person 98.3
Human 98.3
Art 96.1
Painting 94.7
Apparel 78.5
Clothing 78.5
Hat 78.5
Photography 62.9
Photo 62.9
Portrait 60.6
Face 60.6

Clarifai
created on 2019-08-10

people 99.4
portrait 98.9
painting 98.1
art 97.9
one 97.4
adult 96.9
retro 93
museum 92.7
picture frame 92.6
print 91.9
wear 90.6
exhibition 90.5
leader 89
old 87.5
illustration 86.1
woman 83.9
vintage 83.5
man 82.4
antique 81.6
famous 77.8

Imagga
created on 2019-08-10

mosaic 45.2
money 35.7
currency 31.4
cash 31.1
dollar 27.8
art 26.2
portrait 25.2
tile 24.9
banking 24.8
creation 24.3
paper 23
bill 22.8
finance 22.8
bank 22.4
one 20.9
close 20.5
financial 20.5
wealth 19.7
business 18.2
dollars 16.4
savings 14.9
banknote 14.6
us 14.5
face 14.2
culture 13.7
hundred 13.5
transducer 13.4
rich 13
covering 12.8
pay 12.5
exchange 12.4
franklin 11.8
banknotes 11.7
finances 11.6
notes 11.5
man 11.4
black 11.4
book jacket 11.4
economy 11.1
investment 11
closeup 10.8
device 10.8
people 10.6
old 10.4
note 10.1
electrical device 10.1
twenty 9.8
bills 9.7
payment 9.6
loan 9.6
window screen 9.4
head 9.2
adult 9
religion 9
market 8.9
jacket 8.9
president 8.8
sexy 8.8
funds 8.8
hair 8.7
states 8.7
bride 8.6
profit 8.6
capital 8.5
photograph 8.4
sculpture 8.4
mug shot 8.4
vintage 8.3
symbol 8.1
history 8
love 7.9
male 7.8
god 7.6
fine 7.6
united 7.6
historical 7.5
human 7.5
commerce 7.5
sensual 7.3
success 7.2
office 7.2
screen 7.2
concepts 7.1
protective covering 7.1
look 7

Google
created on 2019-08-10

Picture frame 90.3
Painting 87.9
Head 87.6
Lady 84.3
Portrait 80.6
Art 80.6
Visual arts 73.9
Room 65.7
Illustration 60.2
Self-portrait 54.6
Vintage clothing 53.5
Artwork 51.1

Microsoft
created on 2019-08-10

wall 99.5
human face 96.5
painting 96.4
drawing 92.8
indoor 92.5
person 80.9
text 77.3
sketch 76.2
clothing 71.1
old 69.5
hat 62.6
portrait 58
fashion accessory 55.7
art 52.8
picture frame 31.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 69.6%
Calm 17.1%
Disgusted 28.5%
Surprised 1.6%
Angry 34.2%
Confused 1.1%
Sad 16.4%
Happy 0.2%
Fear 1%

Microsoft Cognitive Services

Age 56
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Hat 78.5%

Captions

Microsoft

an old photo of a person 82.8%
old photo of a person 80.3%
a black and white photo of a person 70.3%

Text analysis

Amazon

LreBauann
CYYre
Nohme
LreBauann wf Nohme
wf