Human Generated Data

Title

Practicing for the Westmoreland Fair, Pennsylvania

Date

1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3117

Human Generated Data

Title

Practicing for the Westmoreland Fair, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Imagga
created on 2021-12-15

stringed instrument 100
banjo 100
musical instrument 89.3
guitar 53.6
music 40
man 36.3
musician 34.4
person 31.3
male 31.2
instrument 30.1
adult 28.2
playing 26.4
musical 25.8
guitarist 25.6
acoustic 24.5
people 24.5
rock 21.7
play 21.5
happy 18.2
senior 17.8
performer 17
guy 16.9
song 16.6
casual 16.1
smile 15.7
happiness 14.9
portrait 14.9
band 14.6
player 14.3
cheerful 13.8
men 13.7
handsome 13.4
attractive 13.3
electric 13.1
fun 12.7
old 12.5
jeans 12.4
smiling 12.3
couple 12.2
sound 12.2
singer 11.8
lifestyle 11.6
performance 11.5
black 11.4
fashion 11.3
boy 11.3
sitting 11.2
style 11.1
entertainment 11
blues 10.8
cool 10.6
string 10.6
home 10.4
studio 9.9
rocker 9.9
concert 9.7
indoors 9.7
women 9.5
roll 9.5
model 9.3
hat 9.3
one 9
melody 8.8
standing 8.7
antique 8.6
clothing 8.6
expression 8.5
two 8.5
pretty 8.4
professional 8.4
mature 8.4
joy 8.3
leisure 8.3
holding 8.2
sexy 8
country 7.9
strings 7.9
sing 7.9
room 7.3
active 7.3
bass 7.2
dress 7.2
art 7.2
businessman 7.1

Microsoft
created on 2021-12-15

person 98.9
musical instrument 94.5
music 82.8
text 82.4
black and white 64.6
musician 57.2
man 57.1
jazz 56.3
clothing 55.6
posing 47.2
guitar 29.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 95%
Calm 56.4%
Sad 34.4%
Fear 3.2%
Angry 2.9%
Confused 1.3%
Surprised 0.8%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 22-34
Gender Female, 94.6%
Happy 91.7%
Calm 6.6%
Surprised 0.4%
Sad 0.4%
Fear 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Guitar 100%
Person 99.7%

Captions

Microsoft

a person holding a guitar 92.9%
a person holding a guitar 90%
a person holding a guitar 89.9%