Human Generated Data

Title

The Madhouse

Date

19th century

People

Artist: Wilhelm von Kaulbach, German 1805 - 1874

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, The Kate, Maurice R. and Melvin R. Seiden Purchase Fund and Richard Norton Memorial Fund, 1993.173

Human Generated Data

Title

The Madhouse

People

Artist: Wilhelm von Kaulbach, German 1805 - 1874

Date

19th century

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-07-16

Person 99.9
Human 99.9
Art 99.4
Painting 99.4
Person 98.8
Person 97.9
Person 95.6
Person 94.7
Person 92.3
Person 88.5
Person 88.4
Person 75.5
Person 65.3
Drawing 59.2
Person 57.3

Clarifai
created on 2019-07-16

people 100
adult 99.7
man 99.4
group 99.4
art 99.4
print 97.8
illustration 97.6
one 97.6
leader 96.3
veil 95.7
many 95.4
wear 94.3
two 93.9
woman 93.7
administration 93.4
furniture 93.2
interaction 93.1
reclining 90.1
engraving 89.7
five 89.5

Imagga
created on 2019-07-16

drawing 100
sketch 100
representation 100
vintage 26.5
antique 25.5
old 24.4
capital 22.8
art 22.4
map 22.1
atlas 21.6
sepia 20.4
geography 18.3
retro 18.1
world 17.7
paper 17.3
currency 17.1
money 17
travel 16.9
navigation 16.4
wallpaper 16.1
globe 15.8
ancient 15.6
grunge 15.4
financial 15.2
plan 15.1
planet 15.1
gold 14.8
expedition 14.8
design 14.7
discovery 14.6
continent 14.6
finance 14.4
nation 14.2
journey 14.1
geographic 13.8
boundary 13.8
navigate 13.7
location 13.7
find 13.7
guide 13.7
position 13.7
route 13.7
direction 13.3
country 13.3
tourism 13.2
cash 12.8
business 12.8
road 12.7
tour 12.6
city 12.5
symbol 12.1
dollar 12.1
economy 12.1
decorative 11.7
wealth 11.7
bank 11.7
pattern 11.6
states 11.6
path 11.4
banking 11
explore 10.8
history 10.8
decoration 10.6
rich 10.2
texture 9.7
dollars 9.7
black 9.6
state 9.6
frame 9.2
ornate 9.2
global 9.1
collection 9
graphic 8.8
sign 8.3
note 8.3
investment 8.3
backdrop 8.3
style 8.2
man 8.1
cartoon 8
market 8
funds 7.8
us 7.7
mail 7.7
stamp 7.7
savings 7.5
element 7.4
letter 7.3
painting 7.2

Google
created on 2019-07-16

Drawing 80.3
Art 75.5
Sketch 65.2
Artwork 61.4
Illustration 57.7
Painting 56
Figure drawing 51.6

Microsoft
created on 2019-07-16

text 99.8
sketch 99.2
drawing 99
book 97
person 78.7
cartoon 68.3
clothing 57
man 50.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 93.2%
Happy 7.6%
Confused 16.5%
Sad 12%
Disgusted 7.7%
Angry 8.7%
Surprised 25.9%
Calm 21.6%

AWS Rekognition

Age 57-77
Gender Female, 85.4%
Surprised 45.9%
Happy 38.6%
Calm 0.7%
Disgusted 1.4%
Angry 5.4%
Confused 6.2%
Sad 1.7%

AWS Rekognition

Age 48-68
Gender Male, 94.3%
Confused 21.6%
Calm 30.1%
Disgusted 15.7%
Surprised 6.2%
Sad 5.8%
Angry 13.9%
Happy 6.7%

AWS Rekognition

Age 57-77
Gender Male, 99.1%
Happy 2.8%
Surprised 3.7%
Calm 58.2%
Disgusted 1.7%
Angry 10.7%
Sad 13.2%
Confused 9.7%

AWS Rekognition

Age 14-25
Gender Female, 75.6%
Happy 4.1%
Disgusted 5.7%
Confused 7.3%
Sad 40.7%
Calm 28%
Angry 6.7%
Surprised 7.5%

AWS Rekognition

Age 23-38
Gender Female, 57.1%
Sad 5%
Confused 6.7%
Calm 7.1%
Happy 3.7%
Angry 9.9%
Disgusted 15.1%
Surprised 52.5%

AWS Rekognition

Age 20-38
Gender Female, 83.4%
Confused 15.7%
Angry 25.5%
Calm 5.3%
Disgusted 4.2%
Surprised 28.1%
Happy 2.6%
Sad 18.6%

AWS Rekognition

Age 45-63
Gender Male, 55.2%
Disgusted 5.6%
Surprised 10%
Happy 4.4%
Sad 9.5%
Confused 38.2%
Angry 27.2%
Calm 5.2%

AWS Rekognition

Age 60-90
Gender Male, 71.3%
Confused 3.9%
Sad 5%
Angry 7.9%
Surprised 6.6%
Disgusted 31%
Calm 41.7%
Happy 3.8%

AWS Rekognition

Age 60-90
Gender Female, 73.5%
Happy 7.5%
Calm 9.2%
Confused 5.1%
Angry 14.1%
Sad 46.3%
Surprised 8.3%
Disgusted 9.5%

AWS Rekognition

Age 17-27
Gender Male, 79.7%
Surprised 13%
Sad 17.3%
Confused 19.7%
Happy 1.4%
Calm 28.1%
Disgusted 11%
Angry 9.4%

AWS Rekognition

Age 45-66
Gender Female, 66.9%
Confused 3.9%
Surprised 4.8%
Happy 84.7%
Sad 0.9%
Disgusted 0.8%
Angry 3.3%
Calm 1.6%

AWS Rekognition

Age 20-38
Gender Female, 88%
Disgusted 20.6%
Happy 8.1%
Sad 18.5%
Angry 12.1%
Calm 29.1%
Surprised 6%
Confused 5.6%

AWS Rekognition

Age 57-77
Gender Male, 51.2%
Happy 45%
Disgusted 45.1%
Calm 53.5%
Confused 45.2%
Sad 45.4%
Angry 45.7%
Surprised 45.1%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Painting 99.4%

Captions

Microsoft

a close up of a book 34.8%
close up of a book 30.6%
a hand holding a book 30.5%