Human Generated Data

Title

Concert of the Musical Society

Date

1867

People

Artist: Unidentified Artist,

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Meta and Paul J. Sachs, 1982.41

Human Generated Data

Title

Concert of the Musical Society

People

Artist: Unidentified Artist,

Date

1867

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Meta and Paul J. Sachs, 1982.41

Machine Generated Data

Tags

Amazon
created on 2020-04-30

Human 99.1
Person 99.1
Person 97.7
Art 97.5
Drawing 97.5
Person 92.2
Sketch 90.8
Text 69.3
Apparel 68.9
Clothing 68.9
Person 66.2
People 60.1
Painting 57

Clarifai
created on 2020-04-30

people 100
adult 99.7
print 99.6
two 99.3
group 98.8
art 98.5
man 97.9
three 96.3
leader 96.2
engraving 96
woman 94.8
administration 94.8
wear 93.9
four 92.3
illustration 91.9
portrait 91.7
offspring 90.9
etching 90.9
furniture 90.4
painting 88.8

Imagga
created on 2020-04-30

sketch 82.5
book jacket 71.2
drawing 62.1
jacket 57.3
representation 49
wrapping 42.1
covering 29.1
vintage 23.2
retro 20.5
old 20.2
paper 19.7
envelope 17.8
portrait 17.5
stamp 16.6
grunge 16.2
money 16.2
hair 15.9
black 15.6
currency 14.4
mail 14.4
model 14
attractive 14
people 14
antique 13.9
ancient 13.8
letter 13.8
sexy 12.9
postmark 12.8
postage 12.8
art 12.5
adult 12.3
face 12.1
fashion 12.1
body 12
close 12
cash 11.9
pretty 11.9
aged 11.8
brunette 11.3
person 11.3
postal 10.8
style 10.4
business 10.3
dress 9.9
philately 9.9
design 9.7
bill 9.5
card 9.4
dollar 9.3
banking 9.2
bank 9
printed 8.9
symbol 8.8
cute 8.6
feminine 8.4
head 8.4
savings 8.4
texture 8.3
human 8.3
one 8.2
sensual 8.2
book 8.2
man 8.1
posing 8
circa 7.9
shows 7.9
frame 7.8
expression 7.7
page 7.4
economy 7.4
makeup 7.3
lady 7.3
global 7.3
wealth 7.2
financial 7.1

Google
created on 2020-04-30

Microsoft
created on 2020-04-30

text 99.9
drawing 99.8
sketch 99.7
book 98.1
sitting 95.4
painting 91.1
child art 89.6
person 89
human face 87.7
illustration 81.9
cartoon 78.7
clothing 69
woman 68.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-38
Gender Male, 91.2%
Surprised 1%
Sad 4.9%
Fear 0%
Disgusted 0.1%
Calm 93%
Angry 0.5%
Confused 0.4%
Happy 0.1%

AWS Rekognition

Age 23-35
Gender Male, 99.7%
Disgusted 0%
Fear 0.1%
Confused 0.2%
Calm 94.1%
Surprised 0.1%
Sad 3.3%
Happy 0.1%
Angry 2.2%

AWS Rekognition

Age 18-30
Gender Female, 87.4%
Calm 58.6%
Surprised 12.4%
Sad 0.2%
Confused 0.5%
Fear 12.8%
Disgusted 0.2%
Happy 15.2%
Angry 0.2%

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Categories

Captions

Text analysis

Amazon

Korrsepmmr
l)
18611.
debpaw' 18611.
debpaw'
Korrsepmmr Jyz Jsuyimla
Jsuyimla
Jyz

Google

Kanypm Ayz ompunla 1 deelpant 1867 .
Kanypm
Ayz
ompunla
1
deelpant
1867
.