Human Generated Data

Title

Side Show

Date

19th-20th century

People

Artist: Gifford R. Beal, American 1879 - 1956

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. John G. Pierce, 1964.117

Human Generated Data

Title

Side Show

People

Artist: Gifford R. Beal, American 1879 - 1956

Date

19th-20th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. John G. Pierce, 1964.117

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Person 99.1
Human 99.1
Person 98.7
Person 97.7
Person 95.4
Text 94.8
Page 94.8
Art 93.2
Drawing 93.2
Person 92.1
Person 91
Person 88.3
Person 86.2
Person 84.9
Person 83.9
Person 82.1
Advertisement 81.7
Poster 81.7
Person 79.6
Sketch 78
Book 73.2
Comics 73.2
Person 69.1
Person 68.9
Person 65.3
Interior Design 64.7
Indoors 64.7
Crowd 64.1
Person 60
Animal 57.3
Fish 57.3

Clarifai
created on 2020-05-02

people 100
illustration 99.7
adult 99.4
print 99.4
group 99.2
engraving 98.4
many 98
man 97.4
woodcut 97.4
wear 94.7
art 94.7
etching 93.8
military 92.5
administration 92.4
several 91.8
cavalry 91.5
lithograph 89.1
vehicle 88.4
woman 86.2
crowd 84.2

Imagga
created on 2020-05-02

sketch 100
drawing 100
representation 100
old 19.5
design 18.6
vintage 18.2
grunge 17
art 15
house 14.2
construction 12.8
paper 12.5
architecture 12.5
retro 12.3
black 12
building 11.1
texture 10.4
antique 9.5
paint 9
home 8.8
structure 8.7
winter 8.5
plan 8.5
finance 8.4
decorative 8.3
frame 8.3
silhouette 8.3
snow 8.2
bank 8.1
history 8
cartoon 8
business 7.9
wall 7.7
architectural 7.7
money 7.6
engineering 7.6
pattern 7.5
decoration 7.4
dollar 7.4
style 7.4
clip art 7.4
man 7.4
window 7.3
currency 7.2

Google
created on 2020-05-02

Cartoon 94.7
Illustration 81.6
Art 75.5
Drawing 64.2
Comics 63.7
Fiction 57

Microsoft
created on 2020-05-02

text 99.9
drawing 99
sketch 98.1
cartoon 96.4
person 92
illustration 87.9
clothing 81.4
man 54.9
horse 51.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-67
Gender Male, 54.6%
Sad 45.3%
Angry 45.3%
Calm 54.3%
Happy 45%
Fear 45%
Disgusted 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 39-57
Gender Male, 54.3%
Sad 46.1%
Calm 50%
Angry 48.4%
Surprised 45.4%
Disgusted 45%
Happy 45%
Confused 45.1%
Fear 45%

AWS Rekognition

Age 26-42
Gender Male, 50%
Confused 49.6%
Surprised 49.6%
Disgusted 49.5%
Calm 49.7%
Sad 50.1%
Angry 49.5%
Happy 49.5%
Fear 49.5%

AWS Rekognition

Age 26-42
Gender Male, 53.4%
Angry 45.4%
Fear 45.2%
Surprised 45.1%
Disgusted 45.1%
Sad 45.2%
Happy 50.7%
Confused 45%
Calm 48.2%

AWS Rekognition

Age 19-31
Gender Male, 50.1%
Happy 49.6%
Calm 49.7%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Fear 49.5%
Sad 49.7%
Angry 49.9%

AWS Rekognition

Age 23-35
Gender Male, 50.2%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 50.4%
Confused 49.5%
Sad 49.5%
Fear 49.5%
Surprised 49.5%

AWS Rekognition

Age 11-21
Gender Male, 50.3%
Fear 49.5%
Happy 49.5%
Sad 49.5%
Angry 50.5%
Surprised 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%

AWS Rekognition

Age 31-47
Gender Male, 53.9%
Sad 52.1%
Calm 46.7%
Fear 45.2%
Happy 45%
Angry 45.8%
Surprised 45.1%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 24-38
Gender Male, 50.2%
Disgusted 49.5%
Angry 49.6%
Surprised 49.6%
Happy 49.7%
Confused 49.6%
Calm 49.7%
Sad 49.8%
Fear 49.6%

AWS Rekognition

Age 35-51
Gender Female, 50.1%
Disgusted 49.6%
Calm 49.9%
Angry 49.6%
Confused 49.5%
Fear 49.6%
Happy 49.6%
Sad 49.6%
Surprised 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 50.4%
Sad 49.5%
Angry 49.5%
Happy 49.5%
Fear 49.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Poster 81.7%
Fish 57.3%

Captions

Microsoft
created on 2020-05-02

a close up of a book 45.4%
close up of a book 38.8%
a close up of a book cover 38.7%

Text analysis

Amazon

SIAHOXW
SIAHOXW HO
HO