Human Generated Data

Title

Portraits of Five Seated Englishmen

Date

19th century

People

Artist: Unknown Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.259

Human Generated Data

Title

Portraits of Five Seated Englishmen

People

Artist: Unknown Artist,

Date

19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-07-24

Human 98.6
Person 98.6
Art 96.1
Person 95.8
Person 95.3
Person 92.7
Poster 88.8
Advertisement 88.8
Painting 87.4
Drawing 82.5
Person 64.5
People 63.5
Sketch 58.3
Text 58

Clarifai
created on 2019-07-24

people 99.3
adult 98.8
wear 98.1
illustration 98
painting 96
man 95.9
group 95.8
art 93.6
woman 92.4
facial expression 89.7
one 88.4
map 88.3
outfit 87.2
veil 86.3
two 86.2
print 85.1
retro 84.6
portrait 84.1
bill 80.4
vector 79.7

Imagga
created on 2019-07-24

graffito 84
decoration 55.9
envelope 29.9
grunge 24.7
old 24.4
vintage 24
retro 21.3
container 19.4
antique 19.1
art 18.5
silhouette 16.6
dirty 16.3
map 15.3
aged 14.5
world 14.4
design 14.2
graphic 13.9
man 13.5
texture 12.5
black 12
painting 11.7
pillow 11.5
wallpaper 11.5
drawing 11.4
paper 11.4
ancient 11.3
flower 10.8
letter 10.1
geography 9.6
mail 9.6
floral 9.4
cushion 9.3
global 9.1
business 9.1
cartoon 8.9
style 8.9
symbol 8.8
stamp 8.7
stain 8.7
money 8.5
card 8.5
color 8.3
grain 8.3
artwork 8.2
postage 7.9
text 7.9
male 7.8
wall 7.8
space 7.8
sign 7.5
structure 7.4
backgrounds 7.3
people 7.3
paint 7.2
material 7.2
country 7.1
padding 7
textured 7
leaf 7

Google
created on 2019-07-24

Illustration 84.7
Art 80.3
Painting 58.3
Visual arts 55
Drawing 51.1

Microsoft
created on 2019-07-24

drawing 99.4
cartoon 99.2
child art 94.4
text 93.2
painting 92.5
sketch 92
clothing 81.2
person 77.4
art 75.7
illustration 72.9
poster 52.8

Face analysis

Amazon

AWS Rekognition

Age 30-47
Gender Female, 84%
Confused 5.9%
Sad 40.7%
Calm 7.3%
Surprised 7.8%
Happy 10.5%
Angry 24.3%
Disgusted 3.5%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Sad 20.6%
Happy 2.6%
Disgusted 1.4%
Calm 9.9%
Surprised 47.8%
Confused 5.5%
Angry 12.3%

AWS Rekognition

Age 26-43
Gender Female, 58%
Angry 38.9%
Confused 7.1%
Calm 16.8%
Disgusted 9.8%
Sad 11.1%
Happy 5.7%
Surprised 10.5%

AWS Rekognition

Age 26-43
Gender Male, 51.3%
Confused 45.8%
Disgusted 45.5%
Angry 47.4%
Calm 45.6%
Sad 49.2%
Surprised 46%
Happy 45.6%

Feature analysis

Amazon

Person 98.6%
Poster 88.8%

Captions

Microsoft

graffiti on a wall 36.7%
a graffiti covered wall 36.6%
an old photo of a person 36.5%