Human Generated Data

Title

Quack Doctor with His Booth on a Stage

Date

1772

People

Artist: Jean-Jacques de Boissieu, French 1736 - 1810

Artist after: Karel Dujardin, Dutch 1622 - 1678

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G460

Human Generated Data

Title

Quack Doctor with His Booth on a Stage

People

Artist: Jean-Jacques de Boissieu, French 1736 - 1810

Artist after: Karel Dujardin, Dutch 1622 - 1678

Date

1772

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Human 99.3
Person 99.3
Person 99.2
Person 98.9
Painting 97.1
Art 97.1
Person 93.7
Person 93.1
Person 88.8
Mammal 86.3
Animal 86.3
Horse 86.3
Horse 86.2
Person 86.2
Person 81.4
Archaeology 75
Drawing 74
People 62.5
Soil 59.8
Sketch 56.1
Military Uniform 55.5
Military 55.5
Duel 55.2
Person 53.1
Person 49.3

Clarifai
created on 2019-11-09

people 100
group 99.9
print 99.7
many 99.4
adult 98.8
illustration 98.7
military 97.6
lithograph 97.5
man 97.4
soldier 97.4
group together 96.1
engraving 96
administration 95.5
cavalry 94.4
several 93.8
leader 93.6
weapon 92.7
art 92.3
mammal 92.1
transportation system 92.1

Imagga
created on 2019-11-09

graffito 85.4
decoration 55.4
sketch 24.1
sand 21.7
drawing 21.5
beach 17.1
grunge 15.3
tourism 14.8
water 14.7
representation 13.6
man 13.4
old 13.2
sky 12.8
desert 12.6
vintage 12.4
travel 12
statue 11.7
people 11.2
landscape 11.2
sculpture 10.9
vacation 10.6
outdoors 10.4
wild 10.4
texture 10.4
tree 10
ocean 10
dirty 9.9
history 9.8
summer 9.6
ancient 9.5
art 9.4
sea 9.4
animal 9.4
architecture 9.4
silhouette 9.1
aged 9
scenery 9
scenic 8.8
rock 8.7
antique 8.7
black 8.4
park 8.2
national 8.2
landmark 8.1
textured 7.9
male 7.8
stone 7.7
tropical 7.7
old fashioned 7.6
horse 7.6
resort 7.5
cemetery 7.4
waves 7.4
brown 7.4
equine 7.3
transportation 7.2
religion 7.2
zebra 7.1

Google
created on 2019-11-09

Microsoft
created on 2019-11-09

drawing 97.7
sketch 95.6
old 95.3
person 93.1
horse 90.1
outdoor 86.3
text 85.3
clothing 70.5
group 65.8
mammal 55.6
man 52.1
stone 14.3

Face analysis

Amazon

AWS Rekognition

Age 45-63
Gender Female, 53.2%
Angry 47.7%
Sad 45.1%
Calm 50.2%
Confused 45.1%
Surprised 45.2%
Happy 46.3%
Fear 45.1%
Disgusted 45.3%

AWS Rekognition

Age 45-63
Gender Male, 54.5%
Fear 45%
Angry 45.3%
Confused 45%
Disgusted 45%
Sad 45.1%
Happy 53.3%
Surprised 45.1%
Calm 46.2%

AWS Rekognition

Age 51-69
Gender Male, 50.5%
Angry 49.5%
Sad 49.5%
Calm 49.9%
Confused 49.5%
Surprised 49.5%
Happy 50%
Fear 49.5%
Disgusted 49.5%

AWS Rekognition

Age 23-35
Gender Male, 52.6%
Sad 45.1%
Calm 53.3%
Disgusted 45.7%
Confused 45.1%
Happy 45.2%
Fear 45.2%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 30-46
Gender Male, 53%
Fear 53.1%
Surprised 46.4%
Happy 45.2%
Sad 45.1%
Angry 45.1%
Calm 45.1%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 26-42
Gender Male, 54.4%
Surprised 45%
Disgusted 45.1%
Fear 45%
Happy 45%
Angry 48.6%
Calm 50.2%
Sad 46%
Confused 45.1%

AWS Rekognition

Age 34-50
Gender Male, 54.6%
Sad 45.1%
Surprised 45.3%
Disgusted 45.1%
Angry 46.1%
Confused 45%
Fear 45.1%
Calm 53.3%
Happy 45%

AWS Rekognition

Age 24-38
Gender Male, 50.5%
Fear 49.7%
Calm 49.6%
Happy 49.6%
Confused 49.5%
Sad 50%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 49-67
Gender Male, 50.4%
Surprised 49.5%
Calm 49.9%
Disgusted 49.5%
Angry 49.5%
Fear 49.5%
Happy 50.1%
Confused 49.5%
Sad 49.5%

Feature analysis

Amazon

Person 99.3%
Painting 97.1%
Horse 86.3%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 80%
a vintage photo of a group of people posing for a picture 79.9%
an old photo of a group of people posing for the camera 79.8%

Text analysis

Amazon

Des
grarve
Salesa
Financr
grarve Salesa Rcceveur 3uJor u Des Financr
Jagry
Rcceveur
Jonered
rabinec
Karke. rabinec 7e S7or2e Jagry
Karke.
3uJor u
S7or2e
7e

Google

et
3u
De
e
Des
nancar
yardn
Gagny
K
ep
konsur3londel
Receveurgrneral
K et grave ep d Sablaau e Karle u yardn tire 3u (binec e konsur3londel De Gagny Receveurgrneral Des nancar
grave
d
Sablaau
Karle
u
tire
(binec