Human Generated Data

Title

The Trio, Tokyo, Japan

Date

1898-1901

People

Artist: Lilla Cabot Perry, American 1848 - 1933

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Friends of the Fogg Art Museum Fund, 1952.117

Human Generated Data

Title

The Trio, Tokyo, Japan

People

Artist: Lilla Cabot Perry, American 1848 - 1933

Date

1898-1901

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Friends of the Fogg Art Museum Fund, 1952.117

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.3
Person 99.3
Person 98.7
Person 95.8
Leisure Activities 95.6
Art 89.5
Painting 89.5
Musical Instrument 87.3
Lute 82
Fiddle 76.8
Violin 76.8
Viola 76.8
Cello 64.7
Clothing 57.2
Apparel 57.2

Clarifai
created on 2018-03-16

people 99.6
adult 99.1
group 98.8
woman 98.1
music 97.9
wear 97.7
man 96.5
seat 96.4
painting 94.8
furniture 94.4
room 94.1
dancing 93.5
two 92.8
child 92
performance 90.3
art 89.8
religion 89.2
battle 87.3
three 86.6
position 85.1

Imagga
created on 2018-03-16

stringed instrument 54.5
musical instrument 47.2
oboe 37.9
man 25.5
woodwind 24.4
bowed stringed instrument 22.6
people 22.3
person 20.9
dress 19.9
male 19.8
wind instrument 19.8
bass 19.3
adult 19.1
violin 18.3
interior 17.7
love 16.5
device 16.4
fashion 15.8
couple 15.7
portrait 15.5
music 14.5
happy 14.4
looking 14.4
home 14.3
wedding 13.8
sitting 13.7
room 13.7
women 13.4
indoors 13.2
bride 12.5
chair 12.4
smile 12.1
attractive 11.9
lifestyle 11.6
flute 11.5
marriage 11.4
lady 11.4
instrument 11.3
bassoon 11.2
pretty 11.2
celebration 11.2
style 11.1
traditional 10.8
holding 10.7
guitar 10.6
face 10.6
cheerful 10.6
one 10.4
old 10.4
men 10.3
day 10.2
happiness 10.2
banjo 10.1
indoor 10
holiday 10
playing 10
married 9.6
play 9.5
model 9.3
two 9.3
hat 9.1
human 9
outdoors 8.9
posing 8.9
costume 8.8
together 8.8
smiling 8.7
luxury 8.6
clothes 8.4
musician 8.3
fun 8.2
stylish 8.1
romance 8
decoration 8
cello 7.9
hair 7.9
cute 7.9
viol 7.8
modern 7.7
expression 7.7
husband 7.6
vintage 7.4
tradition 7.4
entertainment 7.4
inside 7.4

Google
created on 2018-03-16

painting 81.6
art 80.9
modern art 54.5
artwork 54

Microsoft
created on 2018-03-16

person 98.5
floor 93.2
indoor 88.9
group 60.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 10-15
Gender Female, 54.8%
Surprised 45%
Sad 52.1%
Happy 47.7%
Disgusted 45%
Angry 45.1%
Calm 45%
Confused 45%

AWS Rekognition

Age 19-36
Gender Female, 54.9%
Sad 52.1%
Calm 45.3%
Angry 46.5%
Surprised 45.2%
Confused 45.1%
Happy 45.4%
Disgusted 45.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 89.5%

Categories