Human Generated Data

Title

The Gallows: Spies, Engel, Fischer, and Parsons (Haymarket Series)

Date

1934-1935

People

Artist: Mitchell Siporin, American 1910 - 1976

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Miriam, Rachel, and Judith Siporin, 1997.24

Human Generated Data

Title

The Gallows: Spies, Engel, Fischer, and Parsons (Haymarket Series)

People

Artist: Mitchell Siporin, American 1910 - 1976

Date

1934-1935

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Miriam, Rachel, and Judith Siporin, 1997.24

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 98
Human 97.4
Drawing 97.4
Sketch 91.1
Person 83.6
Painting 73.1
Poster 58.5
Advertisement 58.5
Canvas 56.7

Clarifai
created on 2018-03-16

people 99.8
art 99.3
adult 99.2
print 99.1
man 99
illustration 98.6
one 98.4
portrait 98.3
woman 96.6
retro 96.2
vintage 95.5
painting 92.4
antique 92.3
two 91.7
wear 91.4
old 91
facial expression 87.5
veil 85.3
engraving 85
ancient 84.2

Imagga
created on 2018-03-16

stamp 42.6
vintage 34.9
mail 33.5
postage 29.5
postmark 28.6
old 26.5
post 24.8
letter 24.8
postal 24.6
art 23.2
tattoo 22.6
decoration 22.6
envelope 22.5
retro 22.1
sketch 20
design 19.4
ancient 19
book jacket 18.9
drawing 17.9
philately 16.8
bookmark 16.2
symbol 16.2
grunge 15.3
paper 15
stamps 14.8
printed 14.8
antique 14.7
jacket 14.7
aged 14.5
shows 13.8
global 13.7
circa 12.8
culture 12.8
black 12.6
history 12.5
covering 12.4
comic book 12.2
money 11.9
currency 11.7
close 11.4
lighter 11.4
wrapping 11.2
delivery 10.7
representation 10.5
texture 10.4
cash 10.1
collection 9.9
one 9.7
cutting 9.7
communications 9.6
device 9.6
unique 9.5
man 9.4
graffito 9.4
finance 9.3
banking 9.2
religion 9
financial 8.9
zigzag 8.9
renaissance 8.8
icon 8.7
card 8.7
us 8.7
painted 8.6
communication 8.4
dollar 8.4
frame 8.3
painting 8.1
wealth 8.1
post mail 7.9
philatelic 7.9
masterpiece 7.9
museum 7.9
correspondence 7.8
paintings 7.8
binding 7.8
letters 7.8
artist 7.7
united 7.6
pattern 7.5
savings 7.5
closeup 7.4
church 7.4
painter 7.3
artwork 7.3
message 7.3

Google
created on 2018-03-16

art 89.5
human behavior 80.2
drawing 72.1
illustration 62.5
artwork 59.4
visual arts 57.7

Microsoft
created on 2018-03-16

book 99.1
text 99
posing 85.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Male, 99.5%
Disgusted 0.4%
Happy 1.6%
Surprised 1.5%
Sad 32.7%
Calm 30.3%
Angry 27.1%
Confused 6.4%

AWS Rekognition

Age 26-43
Gender Male, 52.1%
Surprised 8.8%
Happy 3.9%
Disgusted 10.3%
Calm 8.4%
Confused 9.4%
Angry 23.7%
Sad 35.5%

AWS Rekognition

Age 38-59
Gender Male, 97.2%
Calm 6.7%
Sad 14.7%
Confused 14%
Happy 1.4%
Disgusted 6.2%
Angry 55.4%
Surprised 1.5%

AWS Rekognition

Age 29-45
Gender Male, 99.2%
Confused 17.7%
Sad 16.9%
Calm 31.7%
Disgusted 1.5%
Happy 0.8%
Surprised 3.5%
Angry 28%

Microsoft Cognitive Services

Age 77
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 83.6%
Painting 73.1%

Categories

Imagga

paintings art 99.9%