Human Generated Data

Title

Lower East Side, Boy and Graffiti (New York City)
Date

1947
People

Artist: Rebecca Lepkoff, American 1916 - 2014
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.29

Human Generated Data

Title

Lower East Side, Boy and Graffiti (New York City)

People

Artist: Rebecca Lepkoff, American 1916 - 2014

Date

1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.29

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Art 81.9
Wall 60.7
Graffiti 59.7
Mural 55.7
Painting 55.7

Clarifai
created on 2023-10-26

monochrome 99.5
street 98.8
people 98.4
art 97.6
no person 95.8
graffiti 95.6
window 92.5
one 91.8
abandoned 91.7
vintage 91.1
adult 90.8
old 90.2
black and white 89.7
wear 89.3
city 84.9
architecture 84.7
shadow 84.3
woman 82.2
house 81.9
retro 81.8

Imagga
created on 2022-01-22

billboard 73.8
structure 62.8
signboard 59
grunge 23.9
old 23
vintage 20.7
texture 18.8
urban 18.4
city 18.3
sky 17.9
architecture 17.5
antique 17.3
step 17.2
drawing 17
building 16.7
wall 16.6
frame 15.8
retro 14.8
support 14.6
aged 14.5
black 14.4
ancient 13.8
sketch 13.8
border 13.6
pattern 13
art 12.4
tower 11.6
space 11.6
grungy 11.4
text 11.4
decoration 11.3
cemetery 11
device 10.8
travel 10.6
design 10.1
bridge 10
decorative 10
dark 10
landscape 9.7
sun 9.7
construction 9.4
paper 9.4
graffito 9.4
winter 9.4
street 9.2
paint 9.1
snow 8.9
stone 8.9
window 8.8
graphic 8.8
forest 8.7
light 8.7
dirt 8.6
empty 8.6
damaged 8.6
canvas 8.5
buildings 8.5
industrial 8.2
style 8.2
dirty 8.1
landmark 8.1
digital 8.1
sunset 8.1
metal 8.1
material 8
trees 8
night 8
representation 8
high 7.8
season 7.8
cold 7.8
house 7.5
memorial 7.4
new 7.3
color 7.2
road 7.2
river 7.1
blackboard 7

Google
created on 2022-01-22

Black 89.6
Line 81.9
Rectangle 80.6
Art 78
Tints and shades 77.3
Font 75.9
Handwriting 71.3
Visual arts 69
Metal 67.8
Monochrome photography 66.9
Drawing 66.3
Wood 65
Painting 64.7
Monochrome 64.1
Stock photography 62.7
Graffiti 62.7
Room 61.4
Illustration 61.2
Facade 58.6
Mural 56.7

Microsoft
created on 2022-01-22

text 99.7
drawing 88.9
handwriting 66.9
black and white 56.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 98%
Confused 1.2%
Sad 0.3%
Angry 0.2%
Happy 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

streetview architecture 97.6%
paintings art 1.8%

Captions

Microsoft
created on 2022-01-22

a store inside of a building 65.9%
a graffiti covered building 48.3%
graffiti on a wall 44.5%

Text analysis

Amazon

NOT
R
do NOT
SPDIE
do
By
AN
H
RS
DOM
SAPTE
APPLI
MARIATORNES
Roc SAPTE
he AN
B SM
MIKE
ROSALE
Roc
SAPI
EMMA
st
he
if
Auto st
the
EARTH
CARROU
Auto

Google

DAM
SADTE HERK MARIATREES ROSALTE U SERIE DAM
SADTE
HERK
MARIATREES
ROSALTE
U
SERIE