Human Generated Data

Title

Untitled (Denpasar Museum, Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5149

Human Generated Data

Title

Untitled (Denpasar Museum, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5149

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Head 100
Face 100
Human 100
Smile 98.2
Person 95.2
Person 92.4
Female 91.1
Advertisement 90.5
Poster 90.5
Collage 90.5
Laughing 89.4
Person 84.9
Photography 83.5
Photo 83.5
Portrait 83.5
Person 82.9
Art 81
Drawing 81
Hair 76.6
Woman 74.6
Person 74.6
Text 73.4
Person 73.1
Person 70.4
Accessory 69.9
Accessories 69.9
Glasses 69.9
Girl 67.5
Selfie 64.7
Sketch 62.8
People 61.8
Man 60.6
Paper 60.3
Photo Booth 58.7
Teeth 58.5
Mouth 58.5
Lip 58.5
Performer 58
Jaw 57.7
Black Hair 55.5

Clarifai
created on 2018-03-23

people 100
portrait 99.4
adult 99.2
man 98.7
group 98.7
administration 96.2
leader 94.6
four 93.9
facial expression 93.1
one 92.5
five 92.1
three 91.5
music 90.6
two 90
monochrome 88.7
group together 88.7
facial hair 87.9
print 86.8
wear 83.2
writer 83.1

Imagga
created on 2018-03-23

comic book 56.9
currency 35.9
money 35.7
cash 30.2
dollar 26
mug shot 25.3
bill 23.8
finance 23.7
covering 23.5
print media 22.8
bank 22.4
book jacket 22.1
banking 22.1
mask 21.4
photograph 20.6
close 20.5
dollars 20.3
portrait 20.1
business 20
wealth 19.8
paper 18.8
representation 18.2
jacket 18.1
face 17
financial 16.9
one 16.4
disguise 16.2
hundred 15.5
man 15.5
savings 14.9
bills 14.6
exchange 14.3
economy 13.9
banknote 13.6
us 13.5
vintage 13.2
wrapping 13.1
culture 12.8
painter 12.6
finances 12.5
male 12.1
creation 12
art 12
banknotes 11.7
notes 11.5
franklin 10.8
black 10.8
crazy 10.7
states 10.6
united 10.5
negative 10.3
person 10.2
investment 10.1
religion 9.9
twenty 9.8
market 9.8
payment 9.6
pay 9.6
loan 9.6
people 9.5
eyes 9.5
closeup 9.4
church 9.2
note 9.2
masterpiece 8.9
postmark 8.9
postage 8.8
postal 8.8
wages 8.8
stamp 8.7
attire 8.7
mail 8.6
rich 8.4
letter 8.3
human 8.2
film 8.1
icon 7.9
president 7.9
antique 7.8
ancient 7.8
museum 7.8
adult 7.8
god 7.7
painted 7.6
capital 7.6
emotion 7.4
success 7.2

Google
created on 2018-03-23

face 96.4
facial expression 93.5
nose 86.9
head 86.1
black and white 82.7
drawing 81.4
facial hair 74.2
human 68.5
portrait 67.7
artwork 65.4
jaw 62.7
moustache 59.1
sketch 58.7
art 56
monochrome 54.7
visual arts 54.3
human behavior 52.8
monochrome photography 52.7
font 51.9

Microsoft
created on 2018-03-23

man 91.5
black 77
posing 75.6
group 64.5
white 60.2
hair 49
staring 17

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 76.9%
Happy 27%
Disgusted 3%
Surprised 30.5%
Calm 16.9%
Angry 7.6%
Sad 5.4%
Confused 9.6%

AWS Rekognition

Age 26-43
Gender Female, 63.2%
Sad 63.3%
Calm 12.6%
Confused 4%
Angry 5.7%
Happy 1%
Disgusted 1.3%
Surprised 12.1%

AWS Rekognition

Age 35-52
Gender Male, 62.5%
Calm 56.1%
Disgusted 1.7%
Angry 5%
Happy 9.2%
Confused 6.3%
Surprised 6.9%
Sad 14.8%

AWS Rekognition

Age 26-43
Gender Female, 91.7%
Sad 5.3%
Angry 12.2%
Happy 20.7%
Calm 9.2%
Surprised 43.2%
Disgusted 3.5%
Confused 5.9%

Feature analysis

Amazon

Person
Person 95.2%
Person 92.4%
Person 84.9%
Person 82.9%
Person 74.6%
Person 73.1%
Person 70.4%

Captions

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-30

The image shows a collection of various masks or theater masks. The masks appear to be from different cultures and styles, with some having exaggerated features like large eyes, mouths, and facial hair. The masks seem to be displayed as part of an exhibit or collection, with some labels or information visible below them. The overall impression is of a diverse and interesting set of traditional or decorative masks.

Created by claude-3-opus-20240229 on 2024-12-30

The black and white image shows an assortment of traditional masks displayed on a wall. The masks have exaggerated facial features carved from wood, like wide open eyes, protruding lips, and elongated chins or noses. Some masks have beards or hair represented. The masks vary in size, with some larger than others. A placard with text is mounted on the wall amidst the masks, likely providing context or information about the displayed collection. The masks appear to be from an indigenous culture, carefully handcrafted to represent stylized human faces or characters for ceremonial purposes.

Created by claude-3-5-sonnet-20241022 on 2024-12-30

This black and white image shows a collection of traditional theater masks displayed on a wall. The masks appear to be from an Asian theatrical tradition, possibly Indonesian or Japanese theater. Each mask has distinct characteristics - some feature exaggerated expressions with wide eyes and dramatic mustaches, while others display more subtle, stylized features. Several of the masks include facial hair or long black hair attachments. There are about seven masks visible in the arrangement, and there appears to be a document or paper posted among them on the wall. The masks showcase various emotional expressions ranging from dramatic surprise to sly smiles, which would have been used to portray different character types in theatrical performances.