Human Generated Data

Title

One of the Westmoreland homesteaders playing his violin, Pennsylvania
Date

1937
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3118

Human Generated Data

Title

One of the Westmoreland homesteaders playing his violin, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Leisure Activities 98
Person 93.5
Human 93.5
Musical Instrument 92.5
Violin 87.3
Viola 87.3
Fiddle 87.3

Imagga
created on 2021-12-15

stringed instrument 100
violin 100
bowed stringed instrument 100
musical instrument 78.7
man 26.2
viol 25.3
music 25.3
instrument 23.6
viola 22.7
adult 21.4
person 21.3
male 20.6
black 18
people 17.8
studio 17.5
play 16.4
musical 16.3
portrait 16.2
playing 15.5
musician 14.6
hand 14.4
holding 12.4
cello 12.2
looking 12
classical 11.5
men 11.2
art 11.1
one 10.4
old 10.4
wood 10
bow 9.9
face 9.9
dress 9.9
equipment 9.8
concert 9.7
indoors 9.7
device 9.6
work 9.4
happy 9.4
handsome 8.9
orchestra 8.9
melody 8.8
home 8.8
string 8.7
smiling 8.7
happiness 8.6
professional 8.5
business 8.5
attractive 8.4
sport 8.2
women 7.9
sword 7.8
model 7.8
culture 7.7
performance 7.7
hobby 7.6
player 7.5
fashion 7.5
dark 7.5
sound 7.5
leisure 7.5
classic 7.4
style 7.4
note 7.3
color 7.2
lifestyle 7.2
body 7.2
worker 7.1
guitar 7.1

Google
created on 2021-12-15

Musical instrument 93.6
Violin family 92.9
Violin 90.6
String instrument 90.3
String instrument 89.6
Fiddle 88.8
Plucked string instruments 86.3
Violist 84.4
Classical music 84.3
Style 84.1
Black-and-white 82.8
Musician 81.4
Music 81.2
Folk instrument 80.8
Viola 80.7
Picture frame 78.2
Recital 76
Monochrome photography 75.8
Art 75.5
Bowed string instrument 75.5

Microsoft
created on 2021-12-15

wall 99.3
musical instrument 98.4
text 97.7
person 96
indoor 94.8
violin 94.7
cello 90.7
music 87.2
piano 81.9
musician 80.6
black and white 80.5
violinist 54.6
violist 53.9
bowed string instrument 53.8
violin family 52.7
fiddle 52.6
guitar 51.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Male, 99.3%
Sad 50.8%
Calm 44.1%
Angry 2.7%
Confused 2.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0%
Happy 0%

AWS Rekognition

Age 23-35
Gender Male, 92.8%
Happy 99.8%
Calm 0.1%
Surprised 0%
Angry 0%
Confused 0%
Sad 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.5%

Captions

Microsoft

a man sitting in front of a mirror posing for the camera 66.9%
a man sitting in front of a mirror 66.8%
a man standing in front of a mirror posing for the camera 66.7%

Text analysis

Amazon

HEART
HEART SUNGS
SUNGS
LOY'S
COWRON

Google

COWBOY
HEART
SUNGS
COWBOY LOrs HEART SUNGS
LOrs