Human Generated Data

Title

“Durzee”
Date

c. 1837-1840
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, 1981.87.3

Human Generated Data

Title

“Durzee”

Date

c. 1837-1840

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, 1981.87.3

Machine Generated Data

Tags

Amazon
created on 2019-05-22

Human 97.2
Person 97.2
Art 84.3
Drawing 76.2

Clarifai
created on 2019-05-22

wear 98
people 97.7
one 95.2
lid 95.2
adult 94.9
retro 94.4
man 93.5
veil 89.9
sit 89.8
vintage 89.3
paper 89
woman 85.8
old 85.4
indoors 84.9
art 84.6
portrait 82.2
antique 81
child 80.9
desktop 80.6
traditional 80.4

Imagga
created on 2019-05-22

prayer rug 34.6
rug 27.5
clothing 27
scarf 26.2
garment 24.4
poncho 24.4
cloak 24
person 24
stole 23.3
floor cover 21.7
covering 21.4
furnishing 20.9
old 18.1
portrait 17.5
face 17
hat 16
man 15.4
happy 15
love 15
white 14.4
holiday 14.3
people 13.4
adult 12.9
male 12.8
culture 12
religion 11.6
smiling 10.8
fashion 10.5
home 10.4
expression 10.2
black 10.2
cotton 10.2
happiness 10.2
fabric 9.9
sitting 9.4
decoration 9.4
smile 9.3
child 9.2
costume 8.8
country 8.8
women 8.7
casual 8.5
clothes 8.4
hand 8.3
color 8.3
traditional 8.3
gold 8.2
family 8
cute 7.9
veil 7.8
gift 7.7
attractive 7.7
plan 7.6
religious 7.5
tradition 7.4
day 7.1

Google
created on 2019-05-22

Illustration 86.5
Art 69.5
Headgear 67.5
Sitting 57.5
Drawing 53.7
Vintage clothing 52.1
Beef 51.9

Microsoft
created on 2019-05-22

drawing 98
cartoon 96.8
sketch 91.6
text 88.8
child art 86.8
painting 82.3
clothing 77.9
person 66.5
human face 60.4
illustration 57.2
retro 56.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 96.7%
Happy 10.8%
Surprised 14.1%
Angry 18.3%
Calm 26.8%
Sad 20.2%
Confused 8.2%
Disgusted 1.5%

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%

Categories

Imagga

paintings art 99.8%

Captions

Text analysis

Amazon

Dizee.