Human Generated Data

Title

They Do Not Agree

Date

18th-19th century

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. and Mrs. Philip Hofer, M12550

Human Generated Data

Title

They Do Not Agree

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Date

18th-19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-01

Art 95.7
Painting 91.4
Horse 63.4
Mammal 63.4
Animal 63.4
Horse 62.9
Text 57.6
Person 57.5
Human 57.5
Person 48.7

Clarifai
created on 2019-11-01

people 99.9
illustration 99.8
print 99.5
art 99.4
adult 97.8
painting 97.7
group 95.8
wear 95.4
engraving 94.5
man 93.6
leader 91.7
lithograph 88.6
mammal 88.2
vintage 86.3
cavalry 85.9
military 84.6
old 84
antique 83
two 82.2
woman 80

Imagga
created on 2019-11-01

grunge 64.8
graffito 63.9
old 55.1
decoration 49.8
vintage 49.7
texture 47.3
aged 46.2
antique 43.3
retro 40.2
wall 38.9
memorial 37.4
grungy 35.1
doormat 35
dirty 33.5
gravestone 32.8
structure 30.6
frame 30
textured 29
damaged 28.6
ancient 28.6
paper 28.3
mat 27.7
material 26.8
pattern 26
rusty 25.7
worn 23.9
rough 21.9
brown 21.4
stone 21
floor cover 21
weathered 20.9
art 19.5
design 19.2
surface 18.5
wallpaper 18.4
torn 18.4
rust 18.3
stained 18.3
paint 18.1
border 18.1
space 17.9
decorative 17.5
stain 17.3
blank 17.2
color 16.2
messy 15.5
empty 15.5
decay 15.4
covering 15.4
flower 15.4
parchment 15.4
aging 15.4
dirt 15.3
page 14.9
floral 14.5
canvas 14.2
text 14
grain 13.9
backdrop 13.2
brass 13.1
ragged 12.7
burnt 12.6
dark 11.7
stains 11.7
spot 11.5
detail 11.3
graphic 11
scratched 10.8
backgrounds 10.6
old fashioned 10.5
artistic 10.4
world 10.1
shabby 9.8
grime 9.8
architecture 9.4
leaf 9.3
map 9.3
historic 9.2
artwork 9.2
black 9
distressed 8.8
faded 8.8
crumpled 8.7
crack 8.7
obsolete 8.6
north 8.6
yellow 8.6
close 8.6
textures 8.5
atlas 7.9
country 7.9
urban 7.9
burned 7.9
manuscript 7.8
scratch 7.8
album 7.8
geography 7.7
construction 7.7
detailed 7.7
rustic 7.7
card 7.7
japan 7.7
china 7.5
exterior 7.4
earth 7.3
global 7.3
building 7.3
metal 7.2

Google
created on 2019-11-01

Microsoft
created on 2019-11-01

drawing 91.8
person 91.4
gallery 88.7
clothing 82.3
text 79.7
painting 77.4
old 76.6
sketch 74.1
white 74.1
black 68.4
room 60.9
vintage 32.6
picture frame 28.5
plaque 17.2

Face analysis

Amazon

AWS Rekognition

Age 17-29
Gender Female, 52.2%
Sad 45.2%
Calm 54.7%
Disgusted 45%
Angry 45%
Confused 45%
Surprised 45%
Happy 45%
Fear 45%

AWS Rekognition

Age 31-47
Gender Female, 51.5%
Angry 45.1%
Happy 45%
Fear 45%
Disgusted 45%
Calm 54.6%
Surprised 45%
Confused 45%
Sad 45.2%

Feature analysis

Amazon

Painting 91.4%
Horse 63.4%
Person 57.5%

Captions

Microsoft

a vintage photo of a flower 58.5%
a vintage photo of a person 58.4%
a black and white photo of a flower 47.4%

Text analysis

Amazon

(lati
(lati 171.
171.
40.13.6
/r 40.13.6
/r

Google

Plati 17.
Plati
17.