Human Generated Data

Title

Untitled (Westmoreland County, Pennslyvania)

Date

Summer 1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2804

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Westmoreland County, Pennslyvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Summer 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2804

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Boy 99.2
Child 99.2
Male 99.2
Person 99.2
Male 99.2
Person 99.2
Adult 99.2
Man 99.2
Male 99.2
Person 99.2
Adult 99.2
Man 99.2
Male 97.9
Person 97.9
Adult 97.9
Man 97.9
Guitar 97.5
Musical Instrument 97.5
Clothing 84.3
Footwear 84.3
Shoe 84.3
Shoe 83.3
Shoe 83
Shoe 82.2
Group Performance 80.9
Banjo 76.7
Face 72.9
Head 72.9
Guitar 61.1
Violin 57.9
Leisure Activities 57.2
Music 57.2
Musician 57.2
Performer 57.2
Music Band 57
Cello 55.8
Guitarist 55.4

Clarifai
created on 2018-05-10

people 100
group together 99.7
adult 99.2
group 98.4
music 97.8
several 97.5
many 96
man 95.9
instrument 95.4
stringed instrument 94.9
five 94.9
musician 93.2
four 93
guitar 92.5
wear 92.4
three 90.2
recreation 89.9
athlete 89.2
administration 88.1
woman 87.4

Imagga
created on 2023-10-06

banjo 95.1
stringed instrument 90.5
musical instrument 88.2
guitar 48.5
music 46.1
musician 35
instrument 34.5
brass 33.5
trombone 28.9
musical 28.7
play 27.6
wind instrument 26.3
man 26.2
playing 23.7
rock 23.4
guitarist 22.6
male 22
person 20.3
violin 18.7
acoustic 18.7
adult 18.2
concert 17.5
people 17.3
singer 17.1
performer 16.3
hat 16.2
band 15.5
player 15.1
black 14.4
sound 14
attractive 14
song 13.6
portrait 13.6
string 13.5
electric 13.1
bass 12.7
bowed stringed instrument 12.7
entertainment 12
strings 11.8
performance 11.5
country 11.4
guy 11.2
melody 10.8
fun 10.5
sexy 10.4
men 10.3
blues 9.8
perform 9.8
cowboy 9.8
fashion 9.8
device 9.6
style 9.6
smile 9.3
art 9.1
pretty 9.1
holding 9.1
sport 9.1
old 9.1
posing 8.9
rocker 8.9
cool 8.9
sing 8.8
pop 8.7
war 8.7
jeans 8.6
youth 8.5
studio 8.4
sword 8.2
equipment 8.1
dress 8.1
weapon 8
cornet 8
women 7.9
chord 7.9
happiness 7.8
warrior 7.8
arts 7.8
microphone 7.8
outdoor 7.6
dance 7.6
roll 7.6
power 7.5
happy 7.5
dark 7.5
senior 7.5
outdoors 7.5
hair 7.1
face 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.5
person 96
posing 71.9
white 60.8
old 54.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Sad 88.7%
Confused 22.5%
Angry 16.2%
Surprised 10%
Calm 9.7%
Fear 7%
Happy 1.1%
Disgusted 0.7%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Sad 99.9%
Calm 12.6%
Surprised 6.3%
Fear 6.1%
Confused 5.9%
Angry 0.8%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Sad 99.9%
Confused 17%
Surprised 6.5%
Fear 6.1%
Calm 3.5%
Angry 1.3%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 54-64
Gender Male, 100%
Sad 100%
Confused 6.8%
Surprised 6.3%
Fear 5.9%
Calm 2.2%
Angry 0.2%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Boy 99.2%
Child 99.2%
Male 99.2%
Person 99.2%
Adult 99.2%
Man 99.2%
Guitar 97.5%
Shoe 84.3%
Violin 57.9%

Categories