Human Generated Data

Title

What One Does to Another

Date

18th-19th century

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M4377

Human Generated Data

Title

What One Does to Another

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M4377

Machine Generated Data

Tags

Amazon
created on 2021-11-11

Painting 97.5
Art 97.5
Person 70.1
Human 70.1
Person 63.1

Clarifai
created on 2023-10-13

people 99.2
sepia pigment 98.7
art 98.6
antique 98.2
retro 98.2
painting 97.9
wear 97.8
paper 97.5
old 96.5
print 96
vintage 95.7
man 94.9
one 94.2
ancient 90.9
portrait 89.1
two 88.1
adult 85.4
sepia 83.3
illustration 83.2
no person 80.3

Imagga
created on 2021-11-11

vintage 42.2
old 41.8
grunge 31.5
retro 30.3
antique 28.8
texture 27.1
ancient 24.2
stucco 24.1
wall 24
art 22
frame 20.9
paper 19.6
aged 18.1
decoration 16.3
history 16.1
pattern 14.4
architecture 14.3
rusty 14.3
design 13.7
culture 13.7
stamp 13.4
binding 13.3
sculpture 13.1
ornate 12.8
detail 12.1
blank 12
letter 11.9
postage 11.8
border 11.8
mail 11.5
structure 11.2
monument 11.2
artwork 11
dirty 10.8
postmark 10.8
postal 10.8
envelope 10.8
wallpaper 10.7
stone 10.5
historical 10.4
brown 10.3
bookmark 10.2
page 10.2
drawing 10.2
museum 9.9
worn 9.6
post 9.5
grungy 9.5
ornament 9.5
religious 9.4
historic 9.2
travel 9.2
global 9.1
religion 9
material 8.9
decor 8.8
insulating material 8.8
empty 8.6
card 8.6
temple 8.5
book jacket 8.5
flower 8.5
style 8.2
carving 8
building 7.9
black 7.8
torn 7.7
window 7.7
obsolete 7.7
floral 7.7
old fashioned 7.6
classic 7.4
symbol 7.4
landmark 7.2
building material 7.2
lace 7.2
surface 7.1
wooden 7

Google
created on 2021-11-11

Art 81.4
Book 75
Font 74.8
Rectangle 72.7
Painting 70.3
Illustration 68.5
Vintage clothing 68.4
Paper 67.5
Drawing 67.3
Paper product 67.2
Visual arts 66.4
Plant 64.6
History 62.9
Printmaking 60.9
Pattern 59.6
Tree 56.3
Ink 55.8
Still life 54.1
Room 52.1

Microsoft
created on 2021-11-11

drawing 99.5
sketch 97.4
cartoon 93.4
old 84.3
text 84.2
black 77.2
illustration 76
painting 74.6
white 65.5
person 51.2
dirty 15.6
picture frame 10

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-34
Gender Female, 72%
Calm 83.8%
Angry 9.7%
Happy 3.6%
Sad 1.7%
Disgusted 0.5%
Confused 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 49-67
Gender Male, 95.2%
Calm 41.4%
Angry 21.7%
Sad 16.9%
Fear 13%
Surprised 2.1%
Confused 2.1%
Disgusted 1.5%
Happy 1.3%

AWS Rekognition

Age 23-35
Gender Male, 71%
Calm 26.5%
Angry 24.2%
Fear 21%
Surprised 19.5%
Sad 4.5%
Happy 2.3%
Disgusted 1.3%
Confused 0.7%

Feature analysis

Amazon

Person 70.1%

Categories

Imagga

paintings art 99.6%

Captions

Microsoft
created on 2021-11-11

an old photo of a vase 26.2%
an old photo of a building 26.1%

Azure OpenAI

Created on 2024-11-16

This image depicts an etching or engraving from a book or collection of artworks. The artwork shows two figures, wearing period clothing that suggests a setting from a historical time, possibly as early as the 16th to 18th centuries, engaged in what appears to be a sword duel. The figures are poised dynamically, with one seemingly leaning back to avoid an attack or in a dramatic pose. Below the image, there is a caption that appears to be in French, reading "Unos á otros." The book or portfolio containing the image has a visible aged patina, and the page itself is bordered by a decorated edge with a floral or marbled pattern, implying the book is quite old or at least styled in an antique fashion. The way the figures are dressed and the style of the drawing suggest it may be from a collection of historical reproductions, artwork illustrating a literary work, or a study of historical fencing and dueling techniques.

Anthropic Claude

Created on 2024-11-14

The image depicts a grotesque and surreal scene. It shows a group of distorted, skeletal figures sitting together, with one figure appearing to be the central focus. The figures have elongated, gaunt features and seem to be in a state of anguish or torment. The illustration has a dark, ominous tone, with the figures appearing to be in some sort of supernatural or otherworldly context. The Latin text below the image, "Uno a otro," suggests the figures are somehow related to or interacting with one another in a disturbing manner.

Text analysis

Amazon

otros.
à
Unos à otros.
Unos
One

Google

Vnas á otros O@O O0000@0O000 0000 0000o@0000 00000 00000O@000000000 00000 00000@0 000000
Vnas
á
otros
O@O
O0000@0O000
0000
0000o@0000
00000
00000O@000000000
00000@0
000000