Human Generated Data

Title

Columbus
Date

19th century
People

Artist: Paolo Mercuri, Italian 1804 - 1884
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R10298

Human Generated Data

Title

Columbus

People

Artist: Paolo Mercuri, Italian 1804 - 1884

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 99.7
Performer 99.7
Person 99.2
Face 91.2
Clown 85.8
Apparel 78.5
Hat 78.5
Clothing 78.5
Art 73
Mime 69.7
Photo 62.4
Portrait 62.4
Photography 62.4

Clarifai
created on 2019-11-06

museum 99
painting 98.8
portrait 98.3
people 98.3
exhibition 96.7
one 96.5
picture frame 96.2
adult 96
empty 94.4
art 93.9
wear 93.6
retro 93.1
indoors 93
wall 92.2
album 92
woman 91.7
nostalgia 83.7
moment 83.7
blank 81.6
room 81.2

Imagga
created on 2019-11-06

old 24.4
vintage 20.7
paper 17.4
retro 16.4
grunge 14.5
frame 14
antique 13.8
wall 13
business 12.8
book 12.7
texture 12.5
film 12.3
portrait 12.3
people 12.3
design 12
stucco 12
photograph 12
money 11.9
currency 11.7
person 11.6
office 11.4
world 11.4
art 11.3
creation 11.3
product 10.9
black 10.4
adult 10.3
envelope 10.2
cash 10.1
one 9.7
child 9.6
negative 9.5
face 9.2
banking 9.2
bank 9
window 8.9
brown 8.8
stamp 8.8
album 8.8
symbol 8.8
bill 8.6
culture 8.5
window screen 8.5
page 8.3
economy 8.3
covering 8.3
wedding 8.3
screen 8.3
letter 8.3
human 8.2
decoration 8.2
aged 8.1
dirty 8.1
framework 8
hair 7.9
love 7.9
corner 7.8
ancient 7.8
mail 7.7
worn 7.6
post 7.6
skin 7.6
happy 7.5
man 7.4
protective covering 7.3
border 7.2
smiling 7.2
home 7.2
financial 7.1
women 7.1

Google
created on 2019-11-06

Photograph 96.5
Picture frame 94
Art 74
Portrait 72.2
Room 65.7
Visual arts 62.5
Photography 62.4
Painting 54.7
Rectangle 50.5
Illustration 50.4

Microsoft
created on 2019-11-06

room 99.5
scene 99.3
gallery 99.2
human face 98.8
wall 98.4
person 92.1
indoor 92.1
white 90.9
drawing 84.6
black 81.7
art 75.3
clothing 74.3
old 67.3
portrait 65.8
text 58.9
painting 28.4
picture frame 12.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Female, 74%
Sad 2.7%
Angry 23.4%
Happy 1.2%
Surprised 3.4%
Fear 0.8%
Calm 37.8%
Confused 2.6%
Disgusted 28%

Microsoft Cognitive Services

Age 50
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Hat 78.5%

Captions

Microsoft

a black and white photo of a painting 67.2%
a black and white photo 65.2%
a black and white photo of a room 65.1%

Text analysis

Amazon

GAVARD
GAVARD BAMmu
BAMmu