Human Generated Data

Title

Confrontation
Date

1964
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Saundra B. Lane in honor of James Cuno, 2002.294
Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Confrontation

People

Artist: Ben Shahn, American 1898 - 1969

Date

1964

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-04-25

Head 99.6
Hole 75.8
Accessories 72.3
Accessory 72.3
Sunglasses 72.3
Mask 70
Art 64.8
Painting 64.8
Outdoors 59.5
Nature 55.5
Alien 55.2
Modern Art 55.2

Clarifai
created on 2020-04-25

no person 97.1
one 96.9
people 96.9
man 96.3
art 95.7
portrait 94.7
texture 92.6
old 92.3
retro 90.4
wear 90.2
winter 90.1
artistic 88.6
adult 88.5
painting 88.4
snow 86.7
head 85
print 84.8
two 84.5
antique 83.6
vintage 83.1

Imagga
created on 2020-04-25

disguise 100
attire 100
covering 100
mask 100
clothing 63.3
consumer goods 34.5
head 16.8
face 16.3
black 13.8
man 13.4
male 12
skull 11.7
close 11.4
eyes 11.2
portrait 11
model 10.1
people 10
human 9.7
medical 9.7
nose 9.5
animal 9.2
studio 9.1
medicine 8.8
body 8.8
skeleton 8.8
bone 8.8
anatomy 8.7
death 8.7
old 8.4
mammal 8.1
object 8.1
scary 7.7
pig 7.7
teeth 7.6
science 7.1
adult 7.1
person 7.1
life 7

Google
created on 2020-04-25

Face 96.1
Head 89
Nose 84.2
Illustration 76.8
Art 75.5
Drawing 71.5
Jaw 69.6
Visual arts 64.9
Watercolor paint 62.9
Sketch 55.2

Microsoft
created on 2020-04-25

drawing 99.9
sketch 99.8
painting 98.6
art 98
child art 95.9
text 94.6
human face 88.7
face 73.7
illustration 65.1
portrait 56.2
stone 7.8

Face analysis

Amazon

AWS Rekognition

Age 32-48
Gender Female, 87%
Confused 0.5%
Fear 2.1%
Disgusted 0.4%
Sad 0.4%
Calm 39.7%
Happy 2.1%
Surprised 46.8%
Angry 7.9%

Feature analysis

Amazon

Sunglasses 72.3%
Painting 64.8%

Captions

Microsoft

a group of stuffed animals 26.8%
a close up of a stuffed animal 26.7%
close up of a stuffed animal 26.6%

Text analysis

Amazon

3
3 Shahn
Shahn

Google

B Shahn
B
Shahn