Human Generated Data

Title

Organ Grinder
Date

19th century
People

Artist: Unidentified Artist,

Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Louis W. Black, 1955.43

Human Generated Data

Title

Organ Grinder

People

Artist: Unidentified Artist,

Date

19th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Louis W. Black, 1955.43

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Art 99.4
Human 98.1
Person 98.1
Painting 93.1
Clothing 63.1
Apparel 63.1
Hat 63.1

Clarifai
created on 2019-05-31

people 99.5
adult 98.9
one 98.6
man 97.3
print 95.7
wear 93
painting 92.7
art 92.4
illustration 91.6
veil 90.2
lid 89.8
weapon 86.8
military 86.5
soldier 86.3
war 84.1
two 83.6
woman 83.1
outerwear 82.8
child 82.2
vehicle 81

Imagga
created on 2019-05-31

man 25.5
weapon 18.8
male 18.4
person 18.2
old 17.4
people 15.1
statue 14.1
clothing 13.9
architecture 13.3
religion 12.5
men 12
cleaning implement 11.7
building 11.2
stone 11.1
adult 11.1
sculpture 10.7
broom 10.6
equipment 10.2
history 9.8
military 9.7
culture 9.4
religious 9.4
monument 9.3
street 9.2
outdoor 9.2
device 8.7
stick 8.6
musical instrument 8.4
portrait 8.4
city 8.3
historic 8.3
sport 8.2
outdoors 8.2
style 8.2
newspaper 8.1
uniform 8
to 8
soldier 7.8
black 7.8
war 7.7
industry 7.7
fashion 7.5
clothes 7.5
traditional 7.5
instrument 7.5
figure 7.3
protection 7.3
holiday 7.2
bow and arrow 7.2
travel 7

Google
created on 2019-05-31

Gentleman 71.9
Art 65.5
Painting 59.3
Visual arts 55

Microsoft
created on 2019-05-31

book 99.7
text 99.5
drawing 98.9
painting 98.7
sketch 94.6
person 93.5
art 91.4
clothing 90.3
old 84.3
man 64.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-55
Gender Male, 99%
Surprised 19.5%
Disgusted 6%
Calm 29.6%
Happy 16%
Sad 8.7%
Angry 11.1%
Confused 9.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Painting 93.1%
Hat 63.1%

Categories

Imagga

paintings art 95.9%
streetview architecture 3.1%

Captions

Microsoft
created on 2019-05-31

a statue of a man holding a book 51.4%
a statue of a man 51.3%
a man holding a book 51.2%