Human Generated Data

Title

Johannes Wolff (1863-1931)
Date

1897
People

Artist: John Singer Sargent, American 1856 - 1925

Framemaker: M. Grieve Co.,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.151

Human Generated Data

Title

Johannes Wolff (1863-1931)

People

Artist: John Singer Sargent, American 1856 - 1925

Framemaker: M. Grieve Co.,

Date

1897

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Human 97.8
Person 97.8
Lute 93.4
Musical Instrument 93.4
Art 87.8
Painting 83.3
Cello 77.2
Leisure Activities 71.5
Guitar 59.8

Clarifai
created on 2020-04-23

music 99.8
musician 99.7
violin 99.7
people 99.7
portrait 99.6
one 99.6
man 99.4
violinist 99.4
art 99
adult 99
instrument 98.8
concert 97.4
retro 96.8
painting 96.4
classical music 95.6
vintage 95.3
classic 94.5
wear 94.2
performance 91.7
orchestra 89.4

Imagga
created on 2020-04-23

bowed stringed instrument 100
stringed instrument 100
musical instrument 78.7
violin 58.5
music 50.6
viol 47.7
musician 42.7
instrument 41.8
guitar 40.6
musical 34.5
viola 32.1
play 31
playing 28.3
cello 25.9
concert 25.2
person 24.2
adult 24
device 23.9
man 22.8
bass 22.7
people 22.3
string 22.2
mandolin 20.6
performance 20.1
classical 20.1
rock 20
portrait 19.4
male 19.1
attractive 18.9
guitarist 17.7
melody 17.6
player 16
hair 15.1
black 15
sound 15
singer 14.9
style 14.8
acoustic 14.7
performer 14.4
studio 13.7
classic 13
hand 12.9
entertainment 12.9
orchestra 12.8
sexy 12
strings 11.8
song 11.7
model 11.7
band 11.7
smile 11.4
face 11.4
pretty 11.2
men 11.2
chord 10.8
perform 10.8
handsome 10.7
pop 10.7
art 10.4
sitting 10.3
happiness 10.2
casual 10.2
wood 10
blues 9.8
women 9.5
love 9.5
happy 9.4
dark 9.2
holding 9.1
make 9.1
old 9.1
fashion 9
dress 9
performing 8.9
tune 8.9
brunette 8.7
professional 8.7
guy 8.6
roll 8.5
bow 8.5
expression 8.5
note 8.3
teen 8.3
retro 8.2
danger 8.2
cool 8
smiling 8
fiddle 7.9
instrumental 7.9
symphony 7.9
rocker 7.9
weapon 7.8
artist 7.7
senior 7.5
electric 7.5
fun 7.5
hat 7.3
suit 7.2
cute 7.2
clothing 7.2
together 7

Google
created on 2020-04-23

Violist 90.7
Portrait 90.4
Violin 89.5
Violinist 87.1
Musical instrument 86.2
String instrument 85.7
Painting 82.4
String instrument 81.6
Violin family 80.2
Viol 76.8
Self-portrait 76.1
Artist 74.1
Bowed string instrument 72.9
Musician 70.9
Arpeggione 70.8
Viola 68.2
Fiddle 66.4
Art 62.5
Cello 61.9
Composer 59.4

Microsoft
created on 2020-04-23

text 99.7
person 99.7
painting 99.5
man 99.3
wall 96
book 92.5
human face 90.7
musical instrument 85.7
art 74.5
drawing 62.5
portrait 59.4
bowed instrument 14.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-35
Gender Male, 97.8%
Fear 0.3%
Sad 1.5%
Surprised 1.2%
Disgusted 2.3%
Calm 79.2%
Happy 0.2%
Angry 12.7%
Confused 2.6%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Painting 83.3%
Guitar 59.8%

Captions

Microsoft

a man holding a book 59%
a man wearing a suit and tie holding a book 58.9%
a man in a suit and tie holding a book 58.8%

Text analysis

Amazon

haes
Woln
laryo y
10ill npe haes Woln Jk m 1 laryo y
Jk m
npe
10ill
1

Google

Thgetn
Thgetn