Human Generated Data

Title

Untitled (Japan)
Date

March 14, 1960-April 22, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5541

Human Generated Data

Title

Untitled (Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 14, 1960-April 22, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5541

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Adult 98.3
Bride 98.3
Female 98.3
Person 98.3
Wedding 98.3
Woman 98.3
Sticker 94.4
Face 93.4
Head 93.4
Text 91.3
Architecture 76.8
Building 76.8
Wall 76.8
Advertisement 57.6
Poster 57.6
Handwriting 57.3
Stencil 57.3
Art 57.2
Collage 57.2
Photography 56.6
Portrait 56.6
Painting 56.4

Clarifai
created on 2018-05-10

people 99.7
adult 98.2
one 97.9
illustration 95.5
portrait 94.3
woman 91.7
man 91.1
wear 89.5
print 88.8
art 87.2
woodcut 81.9
war 80.7
administration 80
group 79.5
retro 77.7
monochrome 77.4
bill 75.1
painting 74.1
music 72.5
lid 72.5

Imagga
created on 2023-10-05

bookmark 49.1
book jacket 40.6
jacket 32.5
vintage 31.5
old 27.9
paper 27
grunge 25.6
retro 25.4
wrapping 24
antique 23.4
ancient 19.9
binding 19.8
covering 19.3
aged 19
currency 18.9
texture 18.8
stamp 18.4
money 17.9
cash 17.4
newspaper 17.3
postage 16.7
mail 16.3
product 15.1
art 15
postmark 14.8
letter 13.8
postal 13.7
bank 13.4
frame 13.3
finance 12.7
envelope 12.4
bill 12.4
banking 12
wealth 11.7
creation 11.7
close 11.4
note 11
decoration 10.9
philately 10.9
dirty 10.9
post 10.5
business 10.3
pattern 10.3
savings 10.3
dollar 10.2
graffito 9.8
financial 9.8
dollars 9.7
black 9.6
worn 9.6
damaged 9.5
card 9.4
flower 9.2
drawing 9.1
border 9.1
one 9
material 8.9
brown 8.8
exchange 8.6
grungy 8.5
floral 8.5
wallpaper 8.4
sketch 8.4
economy 8.4
symbol 8.1
design 8
printed 7.9
pound 7.7
blank 7.7
used 7.7
notes 7.7
pay 7.7
painted 7.6
united 7.6
rich 7.5
page 7.4
rough 7.3
global 7.3
architecture 7
textured 7

Google
created on 2018-05-10

photograph 95.2
black and white 94.3
monochrome photography 87.6
photography 80.3
monochrome 74.7
poster 69.8
stock photography 57.5
vintage clothing 55.7
history 55.2
artwork 51.2

Microsoft
created on 2018-05-10

old 56.9
picture frame 18

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 99.8%
Confused 80.4%
Calm 12.5%
Surprised 6.6%
Fear 6.2%
Sad 2.8%
Angry 2%
Happy 1%
Disgusted 0.5%

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.3%
Bride 98.3%
Female 98.3%
Person 98.3%
Woman 98.3%

Categories

Imagga

paintings art 59.7%
streetview architecture 40%

Captions

Microsoft
created on 2018-05-10

an old photo of a person 76.6%
an old photo of a person 74.8%
old photo of a person 73%

Text analysis

Amazon

20
1
PT
+
+ KB
BMW
V
23
KB
- 70
TAPE
3
MAZI
myster