Human Generated Data

Title

Soldier and Camp Follower
Date

1936
People

Artist: Mitchell Siporin, American 1910 - 1976
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Rachel and Judith Siporin in memory of their parents, Miriam and Mitchell Siporin, 2018.110

Human Generated Data

Title

Soldier and Camp Follower

People

Artist: Mitchell Siporin, American 1910 - 1976

Date

1936

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Painting 99.7
Art 99.7
Human 97.7
Person 97.7
Person 93.7
Outdoors 85.9
Nature 83
Building 69.6
Countryside 61.8
Tapestry 55.2
Ornament 55.2

Clarifai
created on 2019-07-20

painting 99.7
illustration 99.1
art 99.1
people 98.9
adult 97.8
print 97.2
religion 95
woman 94.8
veil 94.4
one 94.4
group 90.8
wear 88.9
no person 87.3
man 85.9
landscape 85.3
lithograph 83.8
two 82
tree 81.9
calamity 75.6
outdoors 74.8

Imagga
created on 2019-07-20

pumpkin 32.1
canyon 21.4
art 21
vegetable 20.9
light 20
color 18.3
colorful 17.9
produce 17.7
sculpture 17.3
fantasy 17.1
afghan hound 16.4
carving 16.2
plastic bag 16.1
artistic 15.6
rock 15.6
sand 15.2
dark 15
curve 14.9
bird 14.7
sandstone 14.6
dynamic 14.1
landscape 14.1
orange 13.8
fractal 13.8
cadaver 13.7
motion 13.7
futuristic 13.5
style 13.4
hound 13.1
pattern 13
bag 12.8
effect 12.8
portrait 12.3
wave 12.3
digital 12.2
black 12
flow 12
travel 12
antelope 11.8
texture 11.8
nylon 11.7
graphic 11.7
geology 11.7
desert 11.2
fabric 11.1
shiny 11.1
cave 10.8
bright 10.7
plastic art 10.5
flame 10.3
hair 10.3
abstraction 10.3
smoke 10.2
page 10.2
generated 10.2
hunting dog 10.1
swirl 10.1
stone 10.1
energy 10.1
power 10.1
hot 10
water 10
yellow 9.9
backdrop 9.9
slot 9.9
design 9.8
explosion 9.6
feather 9.6
movement 9.4
monument 9.3
space 9.3
graphics 9.3
face 9.2
smooth 9.1
element 9.1
container 9.1
lines 9
eye 8.9
food 8.9
detail 8.8
erosion 8.8
scenic 8.8
beak 8.7
rendering 8.6
modern 8.4
glowing 8.3
soft 8.1
natural 8
wildlife 8
night 8
southwest 7.8
render 7.8
eyes 7.7
illusion 7.7
summer 7.7
chaos 7.7
studio 7.6
fashion 7.5
painter 7.5
outdoors 7.5
blur 7.4
creativity 7.4
freedom 7.3
science 7.1
tree 7.1
shape 7.1
person 7.1

Google
created on 2019-07-20

Painting 93.1
Art 82.9
Illustration 78
Prophet 70.7
Visual arts 69.9
Mythology 69.1
Watercolor paint 53.8

Microsoft
created on 2019-07-20

drawing 99.7
sketch 98.5
child art 96.3
cartoon 94.8
art 68.9
person 60
illustration 50.1
painting 33.4
colorful 25.8
several 14.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.4%
Calm 26.1%
Disgusted 1.9%
Sad 48%
Confused 15.2%
Happy 3.6%
Angry 4.1%
Surprised 1.1%

AWS Rekognition

Age 26-43
Gender Male, 85.9%
Disgusted 1.5%
Angry 3%
Calm 70.1%
Sad 16.8%
Confused 3.1%
Happy 3.5%
Surprised 1.9%

AWS Rekognition

Age 26-43
Gender Male, 60.4%
Calm 73.2%
Angry 0.9%
Happy 1.3%
Sad 22.7%
Disgusted 0.8%
Confused 0.4%
Surprised 0.6%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 15
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.7%
Person 97.7%

Captions

Microsoft

a painting on a blanket 48.3%
a painting of a bed 46.8%
a painting of a colorful blanket 39.3%

Text analysis

Google

muhell Sino
muhell
Sino