Human Generated Data

Title

Portrait Group: Jean Paul, Schiller, Goethe, and Herder

Date

1855

People

Artist: Adolph Menzel, German 1815 - 1905

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.531

Human Generated Data

Title

Portrait Group: Jean Paul, Schiller, Goethe, and Herder

People

Artist: Adolph Menzel, German 1815 - 1905

Date

1855

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Human 99.5
Person 99.5
Person 99.1
Person 98.7
Drawing 97.2
Art 97.2
Person 95.1
Sketch 91.1
Painting 90.6
Furniture 67.7
Sitting 66.6
Text 65.2

Clarifai
created on 2020-05-02

people 100
group 99.7
art 99.6
print 99.5
illustration 98.3
adult 98.2
man 98.1
engraving 97.3
wear 93
child 92.8
many 92.3
woman 90.2
painting 88.4
several 88.2
furniture 87.9
cavalry 87.4
administration 87.2
three 87.1
veil 85.9
soldier 85.6

Imagga
created on 2020-05-02

sketch 45.1
sculpture 36.4
drawing 36.2
statue 29.8
representation 28.8
brass 28.5
art 27.5
wind instrument 24.9
architecture 21.1
ancient 20.7
history 20.6
old 20.2
musical instrument 18.9
building 17.5
city 16.6
historic 16.5
marble 16
trombone 15.6
person 14.7
landmark 14.4
travel 14.1
tourism 14
antique 14
fountain 13.7
culture 13.7
religion 13.4
historical 13.2
monument 13.1
famous 13
decoration 13
detail 12.9
planner 12.8
god 12.4
church 12
stone 11.8
structure 11.4
religious 11.2
catholic 10.7
faith 10.5
artistic 10.4
carving 10.2
dress 9.9
figure 9.7
tourist 9.1
sax 9
roman 8.8
man 8.7
holy 8.7
column 8.7
old fashioned 8.6
design 8.5
grunge 8.5
decorative 8.3
sky 8.3
vintage 8.3
ornate 8.2
symbol 8.1
water 8
angel 7.8
theater 7.8
facade 7.8
portrait 7.8
luxury 7.7
spiritual 7.7
cathedral 7.7
museum 7.3
celebration 7.2

Google
created on 2020-05-02

Microsoft
created on 2020-05-02

drawing 98.9
sketch 98.7
text 98.7
book 93.9
person 87.1
cartoon 79
painting 78.1
old 70.1
clothing 68.5
black 65.8
vintage 34.9

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 22-34
Gender Female, 51%
Surprised 45.1%
Disgusted 45%
Confused 45%
Calm 54.5%
Happy 45%
Sad 45.2%
Angry 45.1%
Fear 45%

AWS Rekognition

Age 46-64
Gender Male, 54.3%
Angry 45.9%
Fear 45%
Disgusted 45%
Surprised 45%
Happy 45.1%
Calm 52.7%
Sad 46%
Confused 45.2%

AWS Rekognition

Age 37-55
Gender Male, 54.8%
Confused 45.3%
Disgusted 47.3%
Calm 49.7%
Angry 47%
Happy 45.1%
Fear 45.2%
Surprised 45.2%
Sad 45.3%

AWS Rekognition

Age 33-49
Gender Male, 51.8%
Surprised 45%
Disgusted 45%
Happy 51.6%
Angry 45.2%
Sad 45.6%
Calm 47.4%
Fear 45%
Confused 45%

Microsoft Cognitive Services

Age 19
Gender Female

Feature analysis

Amazon

Person 99.5%
Painting 90.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 85.2%
a vintage photo of a group of people posing for a picture 85.1%
a vintage photo of a group of people posing for a photo 82.7%

Text analysis

Amazon

ATor
Den ATor HO.lM
Den
l
HO.lM