Human Generated Data

Title

Untitled (Westmoreland County, Pennsylvania)
Date

Summer 1937, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3391
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Westmoreland County, Pennsylvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Summer 1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.8
Person 99.8
Person 99.8
Footwear 99.6
Shoe 99.6
Clothing 99.6
Apparel 99.6
Leisure Activities 99.5
Musical Instrument 99.2
Guitar 99.2
Banjo 98.8
Person 98.3
Guitar 98
Person 94.6
Shoe 91.3
Musician 90.9
Music Band 59.1
Racket 59
Tennis Racket 59

Clarifai
created on 2018-03-23

instrument 100
music 99.9
people 99.9
musician 99.8
guitar 99.7
stringed instrument 99.6
group 99.1
adult 99
acoustic guitar 98.6
guitarist 98.6
man 98.1
group together 97.2
violin 96.9
singer 95
band 94.8
three 94.4
drum 94
percussion instrument 93.6
jazz 93.1
performance 91.7

Imagga
created on 2018-03-23

banjo 100
stringed instrument 100
musical instrument 100
guitar 82.8
music 78.5
musician 64.2
instrument 60.4
musical 58.4
guitarist 48.2
play 46.5
playing 44.7
rock 44.3
performer 38.9
player 37.7
electric 32.8
singer 31.7
acoustic 31.4
male 30.5
performance 29.6
man 29.6
band 29.1
person 28
song 27.3
concert 23.3
adult 23.3
string 23.1
entertainment 23
sound 22.5
style 22.2
jeans 22
roll 21.8
people 21.7
melody 19.6
guy 19.3
portrait 18.8
rocker 18.8
studio 18.2
cool 17.8
blues 17.7
perform 17.7
artist 17.3
jazz 16.7
pop 16.5
strings 15.8
attractive 15.4
stage 14.9
solo 14.8
hat 14.6
youth 14.5
black 14.4
country 14
smile 13.5
fun 13.5
happy 13.2
bass 11.9
expression 11.9
pretty 11.9
hair 11.9
casual 11.9
sing 11.8
model 10.9
pick 10.7
equipment 10.6
metal 10.5
sexy 10.4
art 10.4
singing 9.8
cowboy 9.8
crazy 9.8
dance 9.5
men 9.4
lifestyle 9.4
senior 9.4
star 9.1
teenager 9.1
holding 9.1
old 9.1
fashion 9
posing 8.9
performing 8.8
tune 8.8
microphone 8.7
standing 8.7
jump 8.6
happiness 8.6
cute 8.6
blur 8.4
dark 8.3
one 8.2
clothing 8
jamming 7.9
denim 7.9
antique 7.8
electrical 7.7
human 7.5
traditional 7.5
cheerful 7.3
group 7.2
women 7.1

Google
created on 2018-03-23

black and white 80.3
musical instrument 79.2
music 78.3
musician 75.4
string instrument 62.2
monochrome photography 52.9
plucked string instruments 51.8
monochrome 50.5

Microsoft
created on 2018-03-23

outdoor 99.6
person 89.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 54.8%
Surprised 45.2%
Disgusted 45.2%
Calm 45.5%
Confused 46.3%
Angry 45.9%
Happy 45%
Sad 51.9%

AWS Rekognition

Age 57-77
Gender Male, 99.8%
Angry 12.4%
Disgusted 0.9%
Happy 0.4%
Sad 59.6%
Calm 8.4%
Confused 17.2%
Surprised 1.1%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Calm 47.7%
Angry 45.8%
Happy 45.1%
Disgusted 45.4%
Sad 49.1%
Surprised 45.1%
Confused 46.7%

AWS Rekognition

Age 35-53
Gender Male, 83.8%
Happy 0.6%
Confused 1.6%
Sad 63.9%
Angry 22.3%
Calm 7.6%
Disgusted 2.6%
Surprised 1.4%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 99.6%
Guitar 99.2%
Tennis Racket 59%

Captions

Microsoft

a group of people on a stage 75.2%
a person playing a guitar 46.8%
a close up of a person playing a guitar 43.6%