Human Generated Data

Title

That is Certainly Being Able to Read

Date

18th-19th century

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M4329

Human Generated Data

Title

That is Certainly Being Able to Read

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M4329

Machine Generated Data

Tags

Amazon
created on 2021-11-10

Person 98.6
Human 98.6
Art 92.1
Leisure Activities 84.9
Painting 82
Text 74.1
Person 69.6
Musical Instrument 69
Lute 65.6
Musician 56.5
Drawing 55.4

Clarifai
created on 2023-10-14

people 99.5
portrait 98.7
painting 98
wear 98
art 97.9
retro 96.3
one 95.7
vintage 95.2
old 94.5
antique 94.4
adult 94
two 93.9
canine 93.5
dog 92.3
mammal 91.5
baby 90.4
sepia pigment 90.2
man 89.4
child 86.6
print 86.3

Imagga
created on 2021-11-10

book jacket 45.3
vintage 43
jacket 36.2
binding 34.9
old 34.2
stamp 32.8
mail 29.7
envelope 29.4
letter 29.4
retro 28.7
paper 27.5
wrapping 26.8
postmark 26.6
postage 26.6
aged 24.4
ancient 23.4
grunge 23
postal 22.6
book 22.3
covering 21.9
antique 20.8
product 18.9
post 18.1
money 17.9
texture 17.4
currency 17.1
philately 16.8
circa 16.8
printed 16.7
global 16.4
cash 15.6
bill 15.2
creation 15.1
shows 14.8
symbol 14.2
stamps 13.8
bank 13.4
dollar 13
culture 12.8
finance 12.7
art 12.6
brass 12.2
card 12
close 12
banking 12
one 12
delivery 11.7
museum 11.6
memorial 11
letters 10.7
communications 10.5
worn 10.5
painted 10.5
fine 10.5
page 10.2
note 10.1
message 10.1
dirty 9.9
collection 9.9
post mail 9.9
zigzag 9.9
design 9.8
paintings 9.8
cutting 9.7
international 9.6
exchange 9.6
structure 9.5
unique 9.5
painter 9.5
world 9.4
country 9.1
rough 9.1
business 9.1
black 9
financial 8.9
masterpiece 8.9
fame 8.9
known 8.9
renaissance 8.8
container 8.8
states 8.7
used 8.6
blank 8.6
united 8.6
grungy 8.5
frame 8.4
wallpaper 8.4
map 8.4
savings 8.4
cover 8.3
national 8.2
border 8.1
closeup 8.1
wealth 8.1
history 8.1
office 8
icon 7.9
banknote 7.8
empty 7.7
wall 7.7
newspaper 7.6
earth 7.5
brown 7.4
material 7.1
portrait 7.1
face 7.1

Google
created on 2021-11-10

Art 82.6
Rectangle 74.9
Font 74
Painting 73.1
Vintage clothing 68.8
Visual arts 66.3
Illustration 64.4
Paper product 62.9
Paper 61.6
Pattern 58.6
Sitting 55.4
Child 54.7
Room 54.1

Microsoft
created on 2021-11-10

drawing 98.7
text 97.9
sketch 88.4
handwriting 88.1
painting 87.4
human face 86.6
white 85.6
gallery 85.1
illustration 78.2
old 75.3
black 71.2
person 66.3
print 60
door 55.4
art 50.6
picture frame 47.1
room 45.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 46-64
Gender Male, 69.4%
Calm 50.1%
Happy 16.1%
Sad 10.8%
Fear 7.6%
Surprised 4.9%
Angry 4.5%
Confused 3.3%
Disgusted 2.6%

AWS Rekognition

Age 17-29
Gender Female, 50.6%
Sad 86%
Fear 9%
Calm 1.7%
Confused 0.8%
Surprised 0.7%
Happy 0.7%
Disgusted 0.6%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Categories

Captions

Microsoft
created on 2021-11-10

an old photo of a sign 61.1%
an old photo of a box 46.4%
a sign on the side of a building 46.3%

Azure OpenAI

Created on 2024-11-15

This is a depiction of a print or artwork from a book. The artwork is rendered in a style resembling an etching or engraving and primarily consists of black lines and shading on a lighter background. It depicts an elderly man wearing a nightcap seated and leaning back as he reads a large, open book that he is holding with both hands. His facial expression is one of intense concentration or perhaps astonishment. Behind the seated man, a younger figure appears to be reacting dramatically, perhaps in fear or alarm, emphasizing the surprising or shocking content of what is being read. The younger figure has one arm raised as if to shield themselves or to express their shock. At the bottom of the artwork, there is a handwritten inscription that reads "Esto si que es leer" which translates to "This really is reading" or "So this is what reading is." The number "29" is inscribed on the top right of the artwork, suggesting it may be part of a series or collection. Without more context, it's hard to determine the exact story or message intended by this image, but it might be part of a series illustrating various human conditions or behaviors related to reading.

Anthropic Claude

Created on 2024-11-14

The image depicts a dark and unsettling scene. It shows a disheveled and distressed individual, likely a man, crouched down and clutching something in their hands. The figure appears to be in a state of distress or anguish, with a wild, frenzied expression on their face. The image has a gothic, nightmarish quality, with the dark background and the intensity of the figure's expression. The caption at the bottom reads "Esto si que es leer" which translates to "This is what it is to read" in English, further adding to the sense of disquiet and intensity evoked by the image.

Text analysis

Amazon

Esto
que
es
Esto H que es leen
29.
leen
H

Google

29. Esto si que es leer? 300000 00000 00000000000O00000 00000 0 O00 0@090@ 000000 0000000 00 00000 0000000000000000 000
es
300000
00000000000O00000
0
O00
000000
0000000
00000
0000000000000000
29.
Esto
si
que
leer?
0@090@
00
000