Human Generated Data

Title

Portrait of a Boy

Date

c. 1840-1849

People

Artist: Gustave Courbet, French 1819 - 1877

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Paul J. Sachs, 1949.13

Human Generated Data

Title

Portrait of a Boy

People

Artist: Gustave Courbet, French 1819 - 1877

Date

c. 1840-1849

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Clothing 98.4
Apparel 98.4
Human 93.1
Person 93.1
Art 87.3
Painting 74
Hat 71.2
Sun Hat 62.2
Coat 59
Text 57.1
Overcoat 55.1

Clarifai
created on 2020-04-24

art 99.1
old 97.7
retro 96.5
people 96.4
vintage 95.2
street 91.4
portrait 90.9
illustration 90.5
monochrome 90.3
man 89
antique 88.8
one 88.6
wall 83.5
picture frame 81
classic 80.3
adult 79.5
texture 78.8
wear 78.5
painting 77.7
dirty 77.7

Imagga
created on 2020-04-24

memorial 63.6
gravestone 51.5
structure 45.1
old 43.2
stone 36.8
grunge 34.9
vintage 34.7
texture 33.3
aged 32.6
antique 32
brass 30
wall 28.2
ancient 27.7
book jacket 25
jacket 20.5
art 20.4
frame 20
retro 19.7
grungy 19
dirty 18.1
textured 17.5
rough 17.3
architecture 17.2
building 16.7
material 16.1
border 15.4
design 15.2
wrapping 14.8
rusty 14.3
door 14.3
empty 13.7
pattern 13.7
detail 13.7
damaged 13.4
paper 13.3
brown 13.3
worn 12.4
blank 12
paint 11.8
black 11.4
device 10.9
house 10.9
instrument of punishment 10.7
decay 10.6
surface 10.6
wooden 10.5
painted 10.5
covering 10.5
weathered 10.4
instrument 10.3
iron 10.3
letter 10.1
artistic 9.6
sculpture 9.3
wood 9.2
historic 9.2
city 9.1
decoration 9.1
backdrop 9.1
color 8.9
pillory 8.9
metal 8.9
latch 8.8
paintings 8.8
entrance 8.7
rust 8.7
parchment 8.6
obsolete 8.6
old fashioned 8.6
cemetery 8.6
culture 8.5
decorative 8.4
backgrounds 8.1
text 7.9
crack 7.7
wallpaper 7.7
close 7.4
industrial 7.3
history 7.2
book 7.1
fastener 7
lock 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

drawing 98.9
sketch 97.6
text 96.6
hat 95.5
human face 93.4
person 83.7
clothing 80.7
handwriting 80.5
painting 80.3
fashion accessory 80
man 78.4
black 72
old 70.1
fedora 64.9
cartoon 61
black and white 60.9
cowboy hat 54.2
cabinet 27.1

Face analysis

Amazon

AWS Rekognition

Age 20-32
Gender Male, 92.3%
Fear 0%
Confused 0.1%
Calm 97.9%
Angry 0.2%
Surprised 0.1%
Sad 1.5%
Disgusted 0%
Happy 0.2%

Feature analysis

Amazon

Person 93.1%

Captions

Microsoft

an old photo of a cat 50.2%
an old photo of a person 50.1%
a cat sitting on top of a building 29.8%

Text analysis

Amazon

-6t61
1o|>-/49
J

Google

1949-
13-
1949- 13- 10/2/49
10/2/49