Human Generated Data

Title

What One Does to Another

Date

18th-19th century

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M4377

Human Generated Data

Title

What One Does to Another

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M4377

Machine Generated Data

Tags

Amazon
created on 2021-11-11

Painting 97.5
Art 97.5
Person 70.1
Human 70.1
Person 63.1

Clarifai
created on 2023-10-13

people 99.2
sepia pigment 98.7
art 98.6
antique 98.2
retro 98.2
painting 97.9
wear 97.8
paper 97.5
old 96.5
print 96
vintage 95.7
man 94.9
one 94.2
ancient 90.9
portrait 89.1
two 88.1
adult 85.4
sepia 83.3
illustration 83.2
no person 80.3

Imagga
created on 2021-11-11

vintage 42.2
old 41.8
grunge 31.5
retro 30.3
antique 28.8
texture 27.1
ancient 24.2
stucco 24.1
wall 24
art 22
frame 20.9
paper 19.6
aged 18.1
decoration 16.3
history 16.1
pattern 14.4
architecture 14.3
rusty 14.3
design 13.7
culture 13.7
stamp 13.4
binding 13.3
sculpture 13.1
ornate 12.8
detail 12.1
blank 12
letter 11.9
postage 11.8
border 11.8
mail 11.5
structure 11.2
monument 11.2
artwork 11
dirty 10.8
postmark 10.8
postal 10.8
envelope 10.8
wallpaper 10.7
stone 10.5
historical 10.4
brown 10.3
bookmark 10.2
page 10.2
drawing 10.2
museum 9.9
worn 9.6
post 9.5
grungy 9.5
ornament 9.5
religious 9.4
historic 9.2
travel 9.2
global 9.1
religion 9
material 8.9
decor 8.8
insulating material 8.8
empty 8.6
card 8.6
temple 8.5
book jacket 8.5
flower 8.5
style 8.2
carving 8
building 7.9
black 7.8
torn 7.7
window 7.7
obsolete 7.7
floral 7.7
old fashioned 7.6
classic 7.4
symbol 7.4
landmark 7.2
building material 7.2
lace 7.2
surface 7.1
wooden 7

Google
created on 2021-11-11

Art 81.4
Book 75
Font 74.8
Rectangle 72.7
Painting 70.3
Illustration 68.5
Vintage clothing 68.4
Paper 67.5
Drawing 67.3
Paper product 67.2
Visual arts 66.4
Plant 64.6
History 62.9
Printmaking 60.9
Pattern 59.6
Tree 56.3
Ink 55.8
Still life 54.1
Room 52.1

Microsoft
created on 2021-11-11

drawing 99.5
sketch 97.4
cartoon 93.4
old 84.3
text 84.2
black 77.2
illustration 76
painting 74.6
white 65.5
person 51.2
dirty 15.6
picture frame 10

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-34
Gender Female, 72%
Calm 83.8%
Angry 9.7%
Happy 3.6%
Sad 1.7%
Disgusted 0.5%
Confused 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 49-67
Gender Male, 95.2%
Calm 41.4%
Angry 21.7%
Sad 16.9%
Fear 13%
Surprised 2.1%
Confused 2.1%
Disgusted 1.5%
Happy 1.3%

AWS Rekognition

Age 23-35
Gender Male, 71%
Calm 26.5%
Angry 24.2%
Fear 21%
Surprised 19.5%
Sad 4.5%
Happy 2.3%
Disgusted 1.3%
Confused 0.7%

Feature analysis

Amazon

Person 70.1%

Categories

Imagga

paintings art 99.6%

Captions

Microsoft
created on 2021-11-11

an old photo of a vase 26.2%
an old photo of a building 26.1%

Text analysis

Amazon

otros.
à
Unos à otros.
Unos
One

Google

Vnas á otros O@O O0000@0O000 0000 0000o@0000 00000 00000O@000000000 00000 00000@0 000000
Vnas
á
otros
O@O
O0000@0O000
0000
0000o@0000
00000
00000O@000000000
00000@0
000000