Human Generated Data

Title

Swallow That, You Dog
Date

18th-19th century
People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M4358

Human Generated Data

Title

Swallow That, You Dog

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M4358

Machine Generated Data

Tags

Amazon
created on 2021-11-11

Art 96.5
Painting 96.2
Person 85
Human 85
Person 71.1
Person 70.7
Drawing 56.2

Clarifai
created on 2023-10-14

people 99.8
art 99
painting 98.6
wear 98
print 97.8
adult 97.6
portrait 96.9
two 96.7
woman 95.3
child 94.5
group 93.9
vintage 93.7
old 93
man 92.9
illustration 92.2
retro 92.2
sepia pigment 90.6
family 90.4
baby 89.9
one 87.9

Imagga
created on 2021-11-11

binding 77.8
sketch 69.9
drawing 54.4
representation 42.6
vintage 38.9
old 36.9
retro 36.1
grunge 34.1
paper 32.9
book jacket 30.2
antique 28.6
ancient 27.7
texture 23.6
jacket 23.5
aged 22.6
frame 22.5
art 20.2
wrapping 17.9
blank 15.4
covering 15.2
stamp 14.7
damaged 14.3
material 14.3
letter 13.8
empty 13.7
dirty 13.6
page 13
postmark 12.8
history 12.5
mail 12.4
card 11.9
design 11.9
postage 11.8
postal 11.8
border 11.8
parchment 11.5
worn 11.5
symbol 11.4
black 11.4
textured 11.4
grungy 11.4
brown 11
pattern 10.9
wall 10.3
money 10.2
philately 9.9
style 9.6
note 9.2
historic 9.2
envelope 9.1
element 9.1
paint 9.1
currency 9
manuscript 8.8
graphic 8.8
torn 8.7
architecture 8.7
space 8.5
wallpaper 8.4
dollar 8.4
decorative 8.4
document 8.4
backdrop 8.2
rough 8.2
structure 8.1
building 7.9
decoration 7.9
text 7.9
shabby 7.8
artistic 7.8
slide 7.8
post 7.6
city 7.5
artwork 7.3
cash 7.3
message 7.3
detail 7.2
color 7.2
financial 7.1
travel 7

Google
created on 2021-11-11

Art 82.3
Rectangle 79.9
Book 76.7
Painting 71.2
Illustration 70
Font 69.5
Paper product 68.5
Paper 68
Visual arts 67.6
Drawing 66.2
Stock photography 65.2
Pattern 65
History 64.2
Printmaking 59.9
Vintage clothing 58

Microsoft
created on 2021-11-11

drawing 99.4
sketch 97.1
illustration 95.3
text 90.2
gallery 88.2
cartoon 88.1
painting 84.6
art 82.3
room 66.7
old 61.3
person 50.5
picture frame 13.3
stone 5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 50-68
Gender Female, 50%
Calm 66.2%
Sad 14.6%
Fear 11.5%
Surprised 4.7%
Confused 1.2%
Disgusted 0.7%
Angry 0.6%
Happy 0.6%

AWS Rekognition

Age 23-35
Gender Female, 86.5%
Calm 97.8%
Surprised 0.8%
Happy 0.5%
Fear 0.4%
Sad 0.3%
Angry 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 8-18
Gender Female, 66%
Happy 33.2%
Fear 31.3%
Calm 27.3%
Angry 4.3%
Surprised 1.9%
Sad 1.4%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 42-60
Gender Female, 52.4%
Calm 97.9%
Sad 1.2%
Happy 0.2%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 22-34
Gender Female, 55.5%
Sad 91.8%
Calm 2.9%
Fear 2.1%
Happy 1%
Angry 0.7%
Confused 0.7%
Surprised 0.5%
Disgusted 0.3%

AWS Rekognition

Age 15-27
Gender Male, 60.1%
Calm 47.3%
Fear 25.4%
Sad 9.4%
Surprised 8.6%
Angry 6.9%
Confused 1.6%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 23-35
Gender Female, 74.3%
Fear 66%
Sad 10.2%
Calm 9.8%
Angry 4.1%
Surprised 3.5%
Happy 3.4%
Confused 1.8%
Disgusted 1.2%

AWS Rekognition

Age 36-54
Gender Male, 64%
Calm 56.3%
Sad 40.6%
Confused 1.3%
Happy 0.9%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 39-57
Gender Male, 60.1%
Sad 27.9%
Happy 22.1%
Calm 21.8%
Fear 17.4%
Angry 8.9%
Surprised 1.2%
Confused 0.4%
Disgusted 0.3%

Feature analysis

Amazon

Person 85%

Categories

Imagga

paintings art 98.1%
streetview architecture 1.9%

Captions

Microsoft
created on 2021-11-11

an old photo of a person 53.2%
an old photo of a building 53.1%
old photo of a person 45.9%

Text analysis

Amazon

perro
Tragata perro
Tragata
58.

Google

5 8. Iragala perro
5
8.
Iragala
perro