Human Generated Data

Title

Musical Boy

Date

18th century

People

Artist: James Watson, British 1739? - 1790

Artist after: Frans Hals, Dutch 1581 - 1666

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1891

Human Generated Data

Title

Musical Boy

People

Artist: James Watson, British 1739? - 1790

Artist after: Frans Hals, Dutch 1581 - 1666

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.5
Person 99.5
Art 91.9
Person 84
Leisure Activities 75.4
Painting 73.9
Musical Instrument 73.4
Violin 69.6
Viola 69.6
Fiddle 69.6
Lute 68.5
Cello 61.6
Guitar 56.4

Imagga
created on 2022-01-15

potter's wheel 33.4
adult 26.5
wheel 26.4
water jug 24.8
people 24.5
machine 23.8
vessel 23.6
jug 23.5
bottle 23.2
happy 18.2
man 17.6
person 17.5
portrait 17.5
black 17
attractive 16.8
couple 16.5
male 16.4
sexy 16.1
container 16
home 15.9
hair 15.8
looking 15.2
pretty 14.7
smiling 14.5
kitchen 14.3
love 14.2
mechanical device 13.4
brunette 13.1
lifestyle 13
sitting 12.9
face 12.8
women 12.6
table 12.1
two 11.8
happiness 11.7
wine 11.6
interior 11.5
cute 11.5
lady 11.4
fashion 11.3
pot 10.9
vintage 10.9
drink 10.8
child 10.8
family 10.7
indoors 10.5
human 10.5
fun 10.5
old 10.4
room 9.8
cheerful 9.7
style 9.6
together 9.6
boy 9.6
men 9.4
model 9.3
smile 9.3
elegance 9.2
holding 9.1
glass 9.1
dress 9
mother 8.8
look 8.8
standing 8.7
light 8.7
dark 8.3
retro 8.2
sensuality 8.2
alcohol 7.9
expression 7.7
youth 7.7
cup 7.5
joy 7.5
food 7.5
device 7.3
indoor 7.3
sensual 7.3
suit 7.2
handsome 7.1
posing 7.1
life 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

painting 97.8
text 97.7
person 97.2
indoor 95.9
drawing 92.3
sketch 76.4
art 66.7
posing 35.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 92%
Calm 26.1%
Confused 23.4%
Surprised 17.5%
Sad 15.5%
Fear 5.1%
Disgusted 4.3%
Happy 4.2%
Angry 3.9%

AWS Rekognition

Age 29-39
Gender Female, 99.6%
Calm 94.2%
Sad 3.8%
Fear 0.6%
Confused 0.4%
Surprised 0.4%
Angry 0.3%
Happy 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 73.9%
Guitar 56.4%

Captions

Microsoft

a person sitting in a vase 29.9%
a person sitting next to a vase 29.8%
a person sitting on a table 29.7%

Text analysis

Amazon

THE
Collection
Lord.
the
BOY.
THE MUSICAL BOY.
Halls
Boydell
Jamas
Honourable
Right
MUSICAL
the Published July et the Collection of there Right Honourable Lord. Mountshart..
te
1777 Boydell Coguirrin
1777
Pminis Halls pinxit
Jamas te Yakoon. faulpsit
Mountshart..
of there
pinxit
Published July
et
faulpsit
Pminis
Coguirrin
Yakoon.

Google

MUSICAL
Hall
fineit
THE
mnir Hall fineit THE MUSICAL BOY.
mnir
BOY.