Human Generated Data

Title

Untitled (Fifth Avenue, New York City)
Date

1933-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4229

Human Generated Data

Title

Untitled (Fifth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.4
Human 98.4
Person 97.6
Person 94.8
Person 83.7
Building 70.1
Clothing 68.1
Apparel 68.1
Photography 62.9
Photo 62.9
Painting 60.1
Art 60.1
Architecture 57

Imagga
created on 2022-01-08

crate 57.3
box 52.9
old 48.1
container 40
texture 38.9
grunge 37.5
wall 35.7
vintage 35.6
antique 30.4
retro 30.3
brown 27.2
aged 27.2
ancient 26.8
textured 24.5
dirty 23.5
material 23.3
pattern 23.3
brick 22.9
rough 22.8
frame 21.6
architecture 21.4
paper 21.2
grungy 19.9
hole 19.6
surface 18.5
structure 18.5
backdrop 18.1
wood 17.5
building 17.4
border 17.2
damaged 17.2
construction 17.1
wooden 16.7
historic 16.5
art 16.3
history 16.1
design 15.8
grain 15.7
empty 15.5
fortress 15.4
weathered 15.2
wallpaper 14.6
tourism 14
landmark 13.5
stone 13.5
parchment 13.4
detail 12.9
culture 12.8
plank 12.7
travel 12.7
crumpled 12.6
old fashioned 12.4
building material 12.2
film 11.5
worn 11.5
rusty 11.4
chest 11.4
board 11.2
sky 10.8
decay 10.6
backgrounds 10.5
striped 10.3
blank 10.3
space 10.1
dark 10
slide 9.8
negative 9.8
timber 9.8
movie 9.7
rust 9.6
rustic 9.6
instrument 9.2
city 9.1
close 9.1
color 8.9
style 8.9
grime 8.8
scratch 8.8
ragged 8.8
graphic 8.8
faded 8.8
text 8.7
obsolete 8.6
window 8.5
historical 8.5
device 8.4
exterior 8.3
tower 8.1
metal 8
scratched 7.8
carpentry 7.8
noise 7.8
cinema 7.8
black 7.8
stains 7.8
castle 7.7
stained 7.7
door 7.6
horizontal 7.5
famous 7.4
page 7.4
camera 7.4
natural 7.4
effect 7.3
instrument of punishment 7.2

Google
created on 2022-01-08

Photograph 94.3
Rectangle 89.7
Line 81.9
Wall 81.5
Art 79.9
Font 78.1
Landmark 77.6
Tints and shades 77.4
Wood 75.2
Snapshot 74.3
Visual arts 69.3
Room 68.2
History 67.9
Paper product 67.8
Photographic film 66.1
Square 65.9
Stock photography 63.7
Vintage clothing 62.1
Arch 62
Negative 60.6

Microsoft
created on 2022-01-08

text 80.8
clothing 77.8
person 76.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 0-4
Gender Female, 100%
Calm 64.4%
Angry 19.2%
Confused 7%
Sad 4.3%
Disgusted 2%
Surprised 1.5%
Happy 0.8%
Fear 0.8%

AWS Rekognition

Age 4-10
Gender Female, 98.9%
Calm 94.3%
Sad 1.7%
Fear 1.3%
Happy 1.2%
Surprised 0.6%
Confused 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 26-36
Gender Male, 96%
Calm 79.8%
Confused 5.4%
Happy 5.4%
Sad 3.6%
Angry 2.2%
Disgusted 1.6%
Surprised 1.2%
Fear 0.8%

AWS Rekognition

Age 29-39
Gender Male, 95.4%
Happy 41.2%
Calm 25.2%
Disgusted 9.5%
Sad 6.9%
Angry 5.2%
Confused 5.1%
Fear 4.1%
Surprised 2.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 60.1%

Text analysis

Amazon

on
on BONT
BONT

Google

Dn bOMi
Dn
bOMi