Human Generated Data

Title

The Mikado
Date

1872
People

Artist: Kyuichi Uchida, Japanese 1844 - 1875

Artist: Adolfo Farsari, American 1841 - 1898
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.3.2.2

Human Generated Data

Title

The Mikado

People

Artist: Kyuichi Uchida, Japanese 1844 - 1875

Artist: Adolfo Farsari, American 1841 - 1898

Date

1872

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.3.2.2

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.7
Human 99.7
Art 90.9
Military 90
Military Uniform 88.4
Painting 74
Bullfighter 58.7
Mammal 55.5
Animal 55.5

Clarifai
created on 2018-03-16

illustration 99.8
people 99.8
painting 99.5
art 99.5
man 99.4
print 99.4
adult 98.8
woman 97.9
one 97.7
wear 97.2
portrait 97.2
retro 93.2
bill 92.3
veil 91.6
lithograph 91.4
vintage 91.4
two 90.9
group 90.5
music 89.1
picture frame 89

Imagga
created on 2018-03-16

vintage 34.9
old 31.3
bookmark 30.6
mail 23
book jacket 22.6
stamp 22.3
letter 22
art 21.9
covering 20.7
postmark 20.7
postage 20.6
post 18.1
retro 18
envelope 18
jacket 17.6
paper 17.2
postal 16.7
grunge 16.2
symbol 16.2
antique 15.6
ancient 15.6
religion 15.2
device 14.7
aged 14.5
shield 14.2
armor 13.7
wrapping 13.3
texture 13.2
church 12.9
culture 12.8
museum 12.8
printed 12.8
icon 12.7
black 12.6
protective covering 12
masterpiece 11.9
global 11.8
shows 11.8
painter 11.7
decoration 11.3
card 11.2
renaissance 10.8
history 10.7
photograph 10.7
office 10.4
book 10.4
message 10
frame 10
prayer rug 9.9
circa 9.9
paintings 9.8
delivery 9.7
painted 9.5
fine 9.5
gold 9
one 9
post mail 8.9
zigzag 8.9
rug 8.9
fame 8.9
known 8.9
philately 8.9
stamps 8.9
mug shot 8.9
cutting 8.7
artist 8.7
saint 8.7
communications 8.6
unique 8.5
face 8.5
money 8.5
communication 8.4
currency 8.1
design 7.9
binding 7.8
letters 7.7
wall 7.7
god 7.7
wallpaper 7.7
worn 7.6
religious 7.5
page 7.4
brown 7.4
historic 7.3
mousetrap 7.3
new 7.3
paint 7.2
dirty 7.2
financial 7.1

Google
created on 2018-03-16

art 84.5
picture frame 80.8
modern art 72

Microsoft
created on 2018-03-16

gallery 96.8
room 94
indoor 85.6
scene 85.5
picture frame 15.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 54.9%
Happy 45%
Confused 45.2%
Calm 54.3%
Sad 45.1%
Angry 45.2%
Disgusted 45.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Painting 74%

Categories

Imagga

paintings art 99.6%
streetview architecture 0.3%

Captions

Microsoft
created on 2018-03-16

a room with art on the wall 65.4%
an old photo of a room 55.9%
a room with pictures on the wall 55.8%

Text analysis

Amazon

MIKADO
THE
192 THE MIKADO
192

Google

192 THE MIEADO
192
THE
MIEADO