Human Generated Data

Title

Leaf from an Album: England and China

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.888.4

Human Generated Data

Title

Leaf from an Album: England and China

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.888.4

Machine Generated Data

Tags

Amazon
created on 2023-01-31

Art 99.8
Male 98.9
Person 98.9
Man 98.9
Adult 98.9
Person 98.8
Painting 98.7
Person 98.6
Person 98.6
Person 98.1
Male 98.1
Man 98.1
Adult 98.1
Person 98.1
Woman 98.1
Adult 98.1
Female 98.1
Drawing 96.8
Face 83.6
Head 83.6
Shoe 77.8
Footwear 77.8
Clothing 77.8
Shoe 75
Shoe 61
Hat 58.2
Page 57.4
Text 57.4
Book 56.2
Publication 56.2

Clarifai
created on 2023-10-13

people 99.6
wear 99.5
adult 99.2
man 99.2
art 98.6
illustration 97.8
group 96.9
woman 96.6
portrait 95.3
chalk out 94.3
two 94.3
retro 93.6
painting 93.4
vintage 90.3
old 88
outfit 87.9
print 86.2
one 85.9
furniture 84
facial hair 83.1

Imagga
created on 2023-01-31

sketch 100
drawing 77.9
representation 58.5
grunge 23.8
vintage 23.1
old 20.9
texture 18.7
wallpaper 17.6
paper 17.3
flower 16.1
art 15.9
retro 15.6
aged 15.4
antique 14
design 13.1
floral 12.8
person 12
material 11.6
damaged 11.4
artistic 11.3
style 10.4
ancient 10.4
document 10.2
people 10
sign 9.8
human 9.7
decay 9.6
worn 9.5
leaf 9.3
pattern 8.9
graphic 8.7
empty 8.6
blank 8.6
line 8.6
old fashioned 8.6
model 8.5
frame 8.4
hand 8.4
decorative 8.3
grain 8.3
card 7.9
adult 7.8
grime 7.8
male 7.8
color 7.8
stain 7.7
parchment 7.7
aging 7.7
sheet 7.5
silhouette 7.4
page 7.4
man 7.4
brown 7.4
letter 7.3
artwork 7.3
business 7.3
success 7.2
dirty 7.2
body 7.2
romantic 7.1
portrait 7.1

Google
created on 2023-01-31

Sleeve 87.2
Gesture 85.3
Art 84.6
Fashion design 78
Painting 76
Illustration 75.1
Font 74.6
Drawing 72.5
Pattern 71.5
Paper 69.8
Book 69.7
Visual arts 68.6
Uniform 68.3
Costume design 67.2
Paper product 67.2
Vintage clothing 66
Sketch 61
Line art 59.4
Artwork 55.8
Knee 55.4

Microsoft
created on 2023-01-31

drawing 98.7
sketch 98.4
text 95.7
man 73.6
person 73.2
illustration 73
cartoon 68.3
clothing 67.4

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Confused 52.7%
Surprised 12.5%
Disgusted 11.7%
Calm 10.9%
Sad 7.8%
Fear 7.5%
Angry 1.7%
Happy 0.8%

AWS Rekognition

Age 20-28
Gender Female, 58%
Calm 75.7%
Happy 13.2%
Surprised 11.5%
Fear 6.3%
Sad 2.2%
Angry 0.8%
Disgusted 0.8%
Confused 0.5%

AWS Rekognition

Age 66-76
Gender Male, 100%
Calm 79.2%
Surprised 19.7%
Fear 6.1%
Sad 2.3%
Angry 2.2%
Confused 1.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 43-51
Gender Female, 100%
Disgusted 20.6%
Happy 16%
Confused 15.2%
Surprised 14.2%
Calm 11.3%
Angry 10.5%
Sad 9.8%
Fear 7.9%

AWS Rekognition

Age 23-33
Gender Female, 58.7%
Calm 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 1.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 43-51
Gender Female, 69%
Calm 99.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Disgusted 0.2%
Happy 0.2%
Confused 0%
Angry 0%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Feature analysis

Amazon

Male 98.9%
Person 98.9%
Man 98.9%
Adult 98.9%
Woman 98.1%
Female 98.1%
Shoe 77.8%
Hat 58.2%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2023-01-31

a sign hanging on a wall 60.6%
a close up of a sign 60.5%
a sign on a wall 60.4%