Human Generated Data

Title

Self-Portrait

Date

19th-20th century

People

Artist: William Valentine Schevill, American 1864 - 1951

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Professor William E. Schevill, BR71.69

Human Generated Data

Title

Self-Portrait

People

Artist: William Valentine Schevill, American 1864 - 1951

Date

19th-20th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 98.8
Painting 98.8
Person 96.9
Human 96.9

Clarifai
created on 2020-04-23

painting 99.6
people 99.5
one 99.4
art 99.3
portrait 99.3
book series 98.7
book 98.2
adult 98.1
man 97.6
print 97
religion 96
facial hair 94.8
wear 93.8
saint 93.5
god 93.1
book bindings 93.1
cross 89.2
woman 88.4
literature 87.1
scripture 86.7

Imagga
created on 2020-04-23

monk 47.6
person 22.9
wall 20.2
people 17.8
stone 17.7
adult 17.5
outdoor 16.8
man 16.8
attractive 16.8
guillotine 16.4
portrait 16.2
pretty 15.4
old 14.6
device 14.2
instrument of execution 14.1
rock 13
lady 13
building 12.9
child 12.9
outside 12.8
travel 12.7
brick 12.5
park 12.3
cute 12.2
instrument 12.1
fashion 12.1
male 11.6
mountain 11.6
face 11.4
ancient 11.2
architecture 10.9
canyon 10.8
tree 10.8
climb 10.7
light 10.7
happy 10.7
sky 10.2
lifestyle 10.1
earth 10.1
orange 10
formation 9.7
escape 9.7
geology 9.7
outdoors 9.7
extreme 9.6
hair 9.5
happiness 9.4
monument 9.3
alone 9.1
tourism 9.1
dress 9
vacation 9
human 9
interior 8.8
sandstone 8.8
urban 8.7
natural 8.7
boy 8.7
cliff 8.7
love 8.7
colorful 8.6
model 8.6
youth 8.5
dark 8.3
color 8.3
mother 8.2
scenic 7.9
brunette 7.8
cell 7.8
rocky 7.7
remote 7.7
culture 7.7
break 7.6
chair 7.6
elegance 7.6
wood 7.5
one 7.5
holding 7.4
juvenile 7.3
yellow 7.3
sexy 7.2
shadow 7.2
smile 7.1
summer 7.1
wooden 7

Google
created on 2020-04-23

Microsoft
created on 2020-04-23

painting 99
text 98.3
art 95
person 93.7
human face 92.4
drawing 90.7
clothing 85.5
man 82.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 99.9%
Sad 1.8%
Disgusted 0.9%
Fear 0.4%
Angry 17.8%
Happy 0.2%
Calm 52.7%
Confused 24%
Surprised 2.3%

Microsoft Cognitive Services

Age 49
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.8%
Person 96.9%

Captions

Microsoft

a man wearing a suit and tie 80.6%
a man in a suit and tie 80.5%
a man wearing a suit 74.3%