Human Generated Data

Title

Punishment of Boys in School

Date

1810

People

Artist: Bartolomeo Pinelli, Italian 1781 - 1835

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor C. E. Norton, M79

Human Generated Data

Title

Punishment of Boys in School

People

Artist: Bartolomeo Pinelli, Italian 1781 - 1835

Date

1810

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Poster 99.3
Advertisement 99.3
Person 98.9
Human 98.9
Person 95.9
Art 94.5
Painting 92.2
Person 92.1
Person 78.3
Person 75.1
Person 69.1
Person 66.4
Person 64.7
Drawing 56.8
Person 48.8

Clarifai
created on 2019-11-06

people 100
group 99.8
print 99.8
engraving 99.3
art 99.2
illustration 98.7
adult 97.8
child 97.3
furniture 96.1
man 95.7
sit 94
woodcut 92.5
administration 92.2
seat 91
many 90.5
leader 89.4
book series 89.2
music 88.8
several 88.5
portrait 88

Imagga
created on 2019-11-06

sketch 100
drawing 83.6
representation 63.8
currency 37.7
money 37.5
paper 32.2
cash 31.1
finance 30.4
dollar 29.7
banking 26.7
bank 25.2
wealth 24.3
dollars 24.2
business 23.7
vintage 21.5
financial 21.4
bill 20.9
savings 20.5
economy 20.4
rich 19.6
loan 19.2
us 18.3
retro 18
old 16.7
newspaper 16.3
grunge 16.2
close 16
investment 15.6
exchange 15.3
hundred 14.5
pattern 14.4
antique 14
bills 13.6
finances 13.5
market 13.3
capital 13.3
texture 13.2
product 12.9
art 12.7
pay 12.5
design 12.5
ancient 12.1
sign 12
letter 11.9
franklin 11.8
stamp 11.8
banknotes 11.8
creation 11.7
one 11.2
graffito 10.9
wages 10.8
funds 10.8
frame 10
postmark 9.9
tile 9.8
success 9.7
debt 9.7
mail 9.6
envelope 9.6
decoration 9.4
comic book 9.2
aged 9.1
postage 8.9
closeup 8.8
banknote 8.7
states 8.7
number 8.4
note 8.3
backdrop 8.3
backgrounds 8.1
postal 7.9
book jacket 7.7
profit 7.7
puzzle 7.6
black 7.2
material 7.1

Google
created on 2019-11-06

Illustration 82.4
Art 78.6
Drawing 62
Artwork 57.4
Painting 56

Microsoft
created on 2019-11-06

text 100
drawing 98.2
cartoon 96.5
sketch 95.9
person 93
book 91.1
clothing 85.3
illustration 82.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-27
Gender Male, 81.3%
Happy 0%
Disgusted 0%
Surprised 0%
Sad 0.8%
Fear 0.1%
Confused 0.2%
Calm 1.6%
Angry 97.3%

AWS Rekognition

Age 14-26
Gender Female, 52.8%
Confused 45%
Happy 45%
Fear 45%
Surprised 45%
Angry 45%
Sad 45%
Calm 55%
Disgusted 45%

AWS Rekognition

Age 15-27
Gender Female, 51.2%
Calm 53.9%
Happy 45%
Fear 45.1%
Sad 45.7%
Surprised 45.1%
Angry 45%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 14-26
Gender Female, 50.5%
Happy 45%
Confused 45%
Surprised 45.1%
Disgusted 45%
Sad 45.3%
Calm 54.4%
Angry 45.1%
Fear 45%

AWS Rekognition

Age 14-26
Gender Female, 52.2%
Sad 45.4%
Surprised 45%
Calm 54.2%
Happy 45%
Angry 45.2%
Fear 45.1%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 19-31
Gender Female, 50.3%
Confused 45%
Sad 47%
Disgusted 45%
Happy 45%
Fear 52.1%
Angry 45.1%
Calm 45.6%
Surprised 45.1%

AWS Rekognition

Age 19-31
Gender Female, 54%
Fear 45.2%
Angry 45.1%
Disgusted 45%
Calm 53.4%
Confused 45%
Surprised 45.2%
Happy 45.4%
Sad 45.6%

AWS Rekognition

Age 20-32
Gender Male, 54.7%
Calm 50.2%
Sad 45.5%
Confused 45.1%
Disgusted 45.4%
Angry 47.9%
Fear 45.8%
Happy 45%
Surprised 45.2%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.3%
Person 98.9%

Captions

Microsoft

a close up of a book 40.4%
close up of a book 34.6%
a hand holding a book 34.5%

Text analysis

Amazon

fanciulli
dei
alla
Gastigo
Scuola
Pinolli
Pinolli inv. 9 dei fanciulli alla Scuola incine
incine
10
inv.
9

Google

Pinelli
inv
incioe
Gastigo
ZANINIS Pinelli inv e incioe Gastigo dei fanciulli alla Seuola 10
10
ZANINIS
fanciulli
Seuola
e
dei
alla