Human Generated Data

Title

Leaf from an Album: England and China

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.888.2

Human Generated Data

Title

Leaf from an Album: England and China

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.888.2

Machine Generated Data

Tags

Amazon
created on 2023-01-30

Painting 99.5
Art 99.5
Person 96.9
Person 96.2
Person 95.9
Person 95.7
Person 95.5
Person 95.4
Baby 95.4
Person 95.3
Man 95.3
Adult 95.3
Male 95.3
Person 95.2
Person 95.1
Person 93.4
People 93
Person 93
Man 93
Adult 93
Male 93
Drawing 92.7
Person 92.7
Person 91.9
Person 90
Person 89.6
Face 78.9
Head 78.9
Person 75.6
Man 75.6
Adult 75.6
Male 75.6
Person 71.9
Weapon 57.5
Bow 56.6
Text 55.9

Clarifai
created on 2023-10-13

people 99.7
group 98.4
man 98.4
art 98.3
adult 97.6
military 97.4
wear 97.2
weapon 96.5
soldier 96.2
illustration 95.2
painting 91.7
veil 91.5
war 91.4
vintage 90
outfit 89.6
woman 89.6
army 88.9
many 88.9
uniform 88.6
sword 88.5

Imagga
created on 2023-01-30

vintage 24.8
drawing 24.2
old 23.7
antique 23.5
sketch 22.8
grunge 21.3
weapon 18.4
texture 18
flower 17.7
aged 17.2
ancient 15.5
retro 14.7
wallpaper 14.5
paper 13.4
sword 12.7
material 12.5
stain 12.5
graphic 12.4
structure 12.3
design 12.2
art 12.1
grain 12
grime 11.7
fracture 11.7
decay 11.6
obsolete 11.5
representation 11.3
floral 11
dirty 10.8
silhouette 10.7
mottled 10.7
color 10.6
aging 10.5
canvas 10.4
pattern 10.2
automaton 10.2
painterly 9.9
smudged 9.8
style 9.6
man 9.4
leaf 9.3
decoration 9.3
torn 8.7
artistic 8.7
men 8.6
old fashioned 8.6
wall 8.5
instrument 8.5
device 8.5
business 8.5
surface 7.9
forest 7.8
male 7.8
space 7.7
crack 7.7
empty 7.7
person 7.6
hand 7.6
frame 7.5
landscape 7.4
plants 7.4
effect 7.3
people 7.2
stick 7.1
sport 7.1

Google
created on 2023-01-30

Line 81.7
Painting 81.4
Art 80.9
Creative arts 77.7
Illustration 73
Drawing 70.5
Event 69.9
Visual arts 66.5
Costume design 64.6
Uniform 63.4
Vintage clothing 60.4
Pole 58.2
Arrow 54.8
History 54.4
Spear 53.8
Recreation 52.6
Pattern 50.5

Microsoft
created on 2023-01-30

wall 96.4
text 94.7
drawing 94.5
sketch 79.3
cartoon 76.6
person 65.6
different 35.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 89.4%
Calm 67.4%
Surprised 11.3%
Sad 8.5%
Fear 7.6%
Angry 4.2%
Confused 3.9%
Disgusted 2.1%
Happy 0.6%

AWS Rekognition

Age 30-40
Gender Male, 99.4%
Calm 90.6%
Surprised 7.1%
Fear 7%
Sad 2.5%
Angry 1.6%
Confused 1.5%
Disgusted 0.9%
Happy 0.2%

AWS Rekognition

Age 4-10
Gender Female, 52.4%
Calm 53.1%
Confused 28.7%
Angry 9.3%
Surprised 7.4%
Fear 6.4%
Sad 3.5%
Disgusted 1.4%
Happy 0.6%

AWS Rekognition

Age 20-28
Gender Male, 92.6%
Calm 70.6%
Confused 15.9%
Surprised 6.9%
Fear 6.6%
Angry 4.9%
Sad 2.9%
Disgusted 2.7%
Happy 0.7%

AWS Rekognition

Age 45-51
Gender Female, 62.2%
Calm 81.1%
Surprised 20.5%
Fear 5.9%
Disgusted 2.2%
Sad 2.2%
Confused 0.6%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 6-12
Gender Male, 100%
Calm 92.3%
Surprised 7.4%
Fear 6%
Sad 2.7%
Happy 1%
Disgusted 1%
Angry 0.8%
Confused 0.6%

AWS Rekognition

Age 26-36
Gender Female, 97.9%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Disgusted 70.4%
Confused 24.7%
Surprised 6.9%
Fear 6.2%
Sad 2.5%
Angry 1%
Calm 0.5%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Female, 97.2%
Calm 77.5%
Disgusted 18.7%
Surprised 6.5%
Fear 6.1%
Sad 2.5%
Angry 0.7%
Confused 0.7%
Happy 0.4%

AWS Rekognition

Age 31-41
Gender Male, 96.5%
Calm 73.9%
Disgusted 18.3%
Surprised 6.8%
Fear 6.3%
Sad 2.7%
Confused 2.2%
Angry 1.1%
Happy 0.9%

AWS Rekognition

Age 23-31
Gender Male, 88%
Surprised 52.7%
Disgusted 28.8%
Angry 20.6%
Calm 12.4%
Fear 7%
Sad 2.4%
Confused 1.3%
Happy 0.7%

AWS Rekognition

Age 43-51
Gender Male, 100%
Confused 95.3%
Surprised 7%
Fear 6.1%
Sad 2.2%
Calm 1.1%
Happy 0.6%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 35.8%
Sad 20.4%
Surprised 14.5%
Fear 12.4%
Happy 11.6%
Confused 5.1%
Angry 4.1%
Disgusted 3.2%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 86.1%
Surprised 8.6%
Fear 6%
Confused 5.4%
Sad 2.8%
Angry 0.9%
Happy 0.8%
Disgusted 0.4%

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Baby 95.4%
Man 95.3%
Adult 95.3%
Male 95.3%

Categories

Imagga

interior objects 97.1%
paintings art 1.4%
food drinks 1.1%

Text analysis

Amazon

YEEN
a
R
KLON
NGW
39
WASH

Google

the fl 章 營 M 營 <M BR 注存 201 勇 勇
the
fl
M
<
BR
201