Human Generated Data

Title

The Author's Family

Date

1810

People

Artist: Bartolomeo Pinelli, Italian 1781 - 1835

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor C. E. Norton, M119

Human Generated Data

Title

The Author's Family

People

Artist: Bartolomeo Pinelli, Italian 1781 - 1835

Date

1810

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Dog 94.8
Animal 94.8
Canine 94.8
Mammal 94.8
Pet 94.8
Human 94.1
Person 94.1
Art 91.3
Person 89.8
Drawing 85.7
Person 81.7
Text 74.1
Sketch 73.7
Person 65.4
Painting 64.4
Book 59.7
Comics 55.7

Clarifai
created on 2019-11-06

people 100
group 99.4
print 98.7
illustration 98.4
adult 98.1
art 96.8
engraving 96.8
man 95.7
administration 91.6
canine 91.5
woodcut 90.4
two 90.2
three 89.5
lithograph 89.3
child 87.8
leader 87.7
several 87.3
woman 85.8
sit 85.2
furniture 85.1

Imagga
created on 2019-11-06

sketch 100
drawing 100
representation 96.9
old 24.4
vintage 22.3
retro 22.1
grunge 21.3
art 20.9
paper 20.4
antique 17.5
building 16.7
decoration 15.9
architecture 15.6
ancient 15.6
black 14.4
history 14.3
design 14.1
pattern 12.3
graffito 12.3
aged 11.8
artistic 11.3
house 10.9
city 10.8
currency 10.8
travel 10.6
texture 10.4
wall 10.3
decorative 10
frame 10
stamp 9.7
window 9.3
letter 9.2
historic 9.2
tourism 9.1
paint 9.1
dirty 9
landmark 9
man 8.7
construction 8.6
grungy 8.5
famous 8.4
ornate 8.2
detail 8
structure 8
postmark 7.9
mail 7.7
money 7.7
old fashioned 7.6
historical 7.5
style 7.4
gold 7.4
brown 7.4
religion 7.2

Google
created on 2019-11-06

Cartoon 95.1
Illustration 71
Art 67.7
Drawing 64.2
Sketch 52

Microsoft
created on 2019-11-06

text 100
book 98.2
cartoon 96.3
drawing 96.2
sketch 92.6
illustration 87
dog 84.5
person 80.9
clothing 70.3
animal 52.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-31
Gender Male, 54.7%
Disgusted 45.2%
Happy 45.9%
Angry 52%
Surprised 45.1%
Fear 45.5%
Confused 45.1%
Sad 45.7%
Calm 45.6%

AWS Rekognition

Age 18-30
Gender Female, 50.1%
Fear 45.1%
Sad 45.2%
Confused 45.1%
Surprised 45%
Disgusted 45%
Calm 45.7%
Angry 53.7%
Happy 45%

AWS Rekognition

Age 16-28
Gender Female, 53.9%
Sad 45.8%
Angry 45.2%
Fear 45%
Calm 53.8%
Surprised 45%
Disgusted 45%
Confused 45.1%
Happy 45%

AWS Rekognition

Age 36-54
Gender Female, 89.4%
Happy 0.8%
Disgusted 0.4%
Surprised 6.4%
Sad 5.1%
Fear 66.1%
Confused 1.2%
Calm 14.9%
Angry 5%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Dog 94.8%
Person 94.1%

Captions

Microsoft

a close up of a book 46.4%
close up of a book 40.8%
a photo of a book 40.7%

Text analysis

Amazon

TUTTO
Famiglia
La
FINISCE
Autore.
Finelliio La dell'. Autore.
dell'.
incive
Finelliio
so incive
so

Google

ine
e
Famiglia
dell
La
Autore
TUTTO FIMISCE Finelli ine e incise La Famiglia dell Autore
TUTTO
FIMISCE
Finelli
incise