Human Generated Data

Title

Untitled (South Street piers, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4222

Human Generated Data

Title

Untitled (South Street piers, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4222

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 94.5
Human 94.5
Clothing 90.9
Apparel 90.9
Person 85.3
Military 83.2
People 80.8
Military Uniform 79.9
Officer 74.6
Shorts 73.4
Standing 71.4
Person 62.9
Person 62.6
Hat 60.8
Poster 59.8
Advertisement 59.8
Person 57.4
Sailor Suit 56.4
Person 43.5

Clarifai
created on 2023-10-25

people 98.7
group 96.8
wear 95.7
retro 94
old 93.8
adult 93.7
art 93.1
vintage 93.1
man 91.3
two 91.1
no person 90.4
collage 89.8
movie 89.1
picture frame 88.9
woman 88.6
outdoors 86.1
antique 85.2
negative 84.1
sepia 82.5
travel 81.5

Imagga
created on 2022-01-08

sculpture 50.7
architecture 41.8
carving 32.5
building 32.1
tourism 31.3
art 28
travel 27.5
stone 27
statue 25.9
old 25.8
facade 25.7
ancient 25.1
history 23.2
culture 23.1
landmark 22.6
religion 21.5
city 19.9
church 19.4
palace 18.7
historic 18.3
column 18
historical 17.9
detail 17.7
monument 16.8
wall 16.8
famous 16.7
exterior 16.6
temple 15.6
tourist 14.5
earthenware 13.8
plastic art 13.4
sky 13.4
marble 12.9
heritage 12.6
window 12.5
wood 12.5
structure 11.9
tower 11.6
birdhouse 11.5
town 11.1
construction 11.1
vacation 10.6
wooden 10.5
ceramic ware 10.4
figure 10.4
square 9.9
antique 9.6
brown 9.6
world 9.6
buildings 9.5
religious 9.4
shelter 9.1
roman 8.9
house 8.9
brick 8.9
arch 8.7
architectural 8.6
god 8.6
attraction 8.6
place 8.4
fountain 8.1
textured 7.9
tourists 7.8
plank 7.8
roof 7.8
device 7.7
spirituality 7.7
texture 7.6
musical instrument 7.6
cross 7.5
style 7.4
protective covering 7.2

Google
created on 2022-01-08

Photograph 94.3
White 92.2
Photographic film 84.2
Font 81.9
Wall 81
Art 79.5
Suit 75.4
Wood 75.1
Snapshot 74.3
Hat 72.6
Monochrome 70.6
Sculpture 70.6
Vintage clothing 69
Monochrome photography 67
Stock photography 65.8
Rectangle 65.3
Negative 64.9
History 63.5
Room 60.7
Crew 57

Microsoft
created on 2022-01-08

statue 93.7
text 89
person 87.9
old 62.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 21-29
Gender Male, 78.5%
Calm 99%
Happy 0.2%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Sad 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 73%
Angry 12.6%
Confused 11.6%
Sad 1.2%
Surprised 0.8%
Disgusted 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Male, 98.9%
Happy 50.3%
Calm 30%
Surprised 4.8%
Angry 4.2%
Confused 3.7%
Disgusted 3.3%
Sad 2.3%
Fear 1.4%

AWS Rekognition

Age 29-39
Gender Male, 87.8%
Calm 98.7%
Sad 0.3%
Surprised 0.3%
Angry 0.3%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Male, 90%
Sad 36.8%
Calm 26.3%
Disgusted 17.7%
Angry 7.2%
Confused 5.3%
Surprised 2.6%
Happy 2.6%
Fear 1.5%

AWS Rekognition

Age 26-36
Gender Male, 100%
Surprised 44.5%
Calm 42.8%
Fear 3.6%
Confused 2.7%
Disgusted 1.9%
Angry 1.8%
Happy 1.6%
Sad 1%

AWS Rekognition

Age 23-31
Gender Male, 70.7%
Calm 99.6%
Sad 0.3%
Angry 0.1%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 86.8%
Calm 91.2%
Sad 2.4%
Disgusted 1.5%
Surprised 1.2%
Confused 1.1%
Angry 1.1%
Fear 0.8%
Happy 0.8%

AWS Rekognition

Age 12-20
Gender Female, 91.4%
Fear 25.8%
Calm 20.1%
Disgusted 16.1%
Sad 12.3%
Surprised 7.8%
Angry 6.5%
Happy 6.2%
Confused 5.2%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 57%
Happy 31%
Sad 9%
Angry 1.6%
Fear 0.4%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%

Feature analysis

Amazon

Person 94.5%
Poster 59.8%

Categories

Imagga

paintings art 71.1%
interior objects 27.3%
text visuals 1.2%

Captions

Text analysis

Amazon

BROOKLYN
BROOKLYN FERRIES
FERRIES
GRAIL
DN
DN BONT
BONT

Google

DN BOMI ALL BROOKLYN FERRIES 1000 100 100
DN
BOMI
ALL
1000
100
BROOKLYN
FERRIES