Human Generated Data

Title

Practicing for the Westmoreland Fair, Pennsylvania
Date

1937
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3117

Human Generated Data

Title

Practicing for the Westmoreland Fair, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3117

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Guitar 100
Leisure Activities 100
Musical Instrument 100
Person 99.7
Human 99.7
Musician 94.3
Person 93.9
Guitarist 86.7
Performer 86.7
Bass Guitar 67.9
Person 65.5
Electric Guitar 58.8
Banjo 58.3
Lute 56.6

Clarifai
created on 2023-10-15

guitar 99.9
people 99.9
music 99.7
portrait 99.3
guitarist 99.1
man 99
adult 98.7
musician 98.7
group 98.7
instrument 98.6
two 98.2
group together 96
three 95.2
band 95
singer 94.7
stringed instrument 93.4
monochrome 92.7
wear 92
electric guitar 91.9
woman 88.2

Imagga
created on 2021-12-15

stringed instrument 100
banjo 100
musical instrument 89.3
guitar 53.6
music 40
man 36.3
musician 34.4
person 31.3
male 31.2
instrument 30.1
adult 28.2
playing 26.4
musical 25.8
guitarist 25.6
acoustic 24.5
people 24.5
rock 21.7
play 21.5
happy 18.2
senior 17.8
performer 17
guy 16.9
song 16.6
casual 16.1
smile 15.7
happiness 14.9
portrait 14.9
band 14.6
player 14.3
cheerful 13.8
men 13.7
handsome 13.4
attractive 13.3
electric 13.1
fun 12.7
old 12.5
jeans 12.4
smiling 12.3
couple 12.2
sound 12.2
singer 11.8
lifestyle 11.6
performance 11.5
black 11.4
fashion 11.3
boy 11.3
sitting 11.2
style 11.1
entertainment 11
blues 10.8
cool 10.6
string 10.6
home 10.4
studio 9.9
rocker 9.9
concert 9.7
indoors 9.7
women 9.5
roll 9.5
model 9.3
hat 9.3
one 9
melody 8.8
standing 8.7
antique 8.6
clothing 8.6
expression 8.5
two 8.5
pretty 8.4
professional 8.4
mature 8.4
joy 8.3
leisure 8.3
holding 8.2
sexy 8
country 7.9
strings 7.9
sing 7.9
room 7.3
active 7.3
bass 7.2
dress 7.2
art 7.2
businessman 7.1

Google
created on 2021-12-15

Musical instrument 94.9
Guitar 91.6
Guitar accessory 88.7
Musician 87.8
String instrument accessory 85.7
Style 83.8
Plucked string instruments 83.3
String instrument 83
String instrument 80.1
Music 80.1
Folk instrument 78.9
Picture frame 77
Acoustic guitar 72.1
Monochrome photography 71.4
Monochrome 70.4
Vintage clothing 69
Stock photography 64
Art 62.8
Banjo 62.6
Guitarist 58.7

Microsoft
created on 2021-12-15

person 98.9
musical instrument 94.5
music 82.8
text 82.4
black and white 64.6
musician 57.2
man 57.1
jazz 56.3
clothing 55.6
posing 47.2
guitar 29.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 95%
Calm 56.4%
Sad 34.4%
Fear 3.2%
Angry 2.9%
Confused 1.3%
Surprised 0.8%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 22-34
Gender Female, 94.6%
Happy 91.7%
Calm 6.6%
Surprised 0.4%
Sad 0.4%
Fear 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Guitar 100%
Person 99.7%

Categories

Imagga

paintings art 42.1%
interior objects 34.8%
people portraits 19.7%
pets animals 2.3%

Captions

Microsoft
created on 2021-12-15

a person holding a guitar 92.9%
a person holding a guitar 90%
a person holding a guitar 89.9%