Human Generated Data

Title

Untitled (copy photograph of Ben Shahn's Rikers Island Penitentiary mural study: prisoner being beaten)

Date

1934-1935

People

Artist: Walker Evans, American 1903 - 1975

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2000.46

Human Generated Data

Title

Untitled (copy photograph of Ben Shahn's Rikers Island Penitentiary mural study: prisoner being beaten)

People

Artist: Walker Evans, American 1903 - 1975

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2000.46

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.7
Apparel 99.7
Person 98.7
Human 98.7
Person 90.2
Hat 77
Person 76
Sun Hat 75.5
Art 73.7
Painting 72.3
Person 71.1
Overcoat 60.6
Coat 60.6

Clarifai
created on 2023-10-15

people 99.9
print 99
art 98.7
adult 98.6
group 98.3
man 98
street 97.2
two 96.9
vintage 96.3
painting 95.9
illustration 94.5
wear 92.1
sepia pigment 90.7
one 90.3
woman 89.8
many 88.4
home 87
old 85.8
woodcut 85
three 85

Imagga
created on 2021-12-14

sketch 51.3
drawing 40.1
architecture 37.3
sculpture 34.7
statue 32.4
representation 30.2
building 27.6
art 27.3
ancient 25.1
fountain 23.4
monument 23.4
stone 22.3
history 20.6
old 20.2
famous 19.5
tourism 19
landmark 19
travel 18.3
marble 17.6
culture 16.2
city 15.8
structure 15.6
facade 15.3
newspaper 14.9
carving 14.8
palace 14.5
column 14.2
tourist 13.2
decoration 13
historic 12.8
religion 12.6
historical 12.2
detail 11.3
graffito 11
carved 10.8
antique 10.6
god 10.5
product 10.5
figure 10
roman 9.9
creation 9.8
man 9.5
arch 8.9
piazza 8.9
statues 8.9
body 8.8
buildings 8.5
church 8.3
temple 8.3
vintage 8.3
brick 8.1
water 8
artistic 7.8
architectural 7.7
grunge 7.7
sky 7.7
street 7.4

Google
created on 2021-12-14

Hat 92.7
Headgear 82.6
Art 81.7
Font 75.7
Sun hat 75.7
Vintage clothing 74.6
Window 72
Building 70.8
Wood 68.3
Illustration 68.1
History 67.5
Paper product 67.1
Room 66.2
Newsprint 64.4
Visual arts 63.3
Stock photography 63
House 62.4
Cowboy hat 58.4
Painting 58
Retro style 53.7

Microsoft
created on 2021-12-14

clothing 95.7
person 95.5
outdoor 95
text 90.9
drawing 90.1
man 80.2
sketch 61.9
cartoon 53.7
old 48.3
clothes 15.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-39
Gender Female, 58.2%
Sad 91.6%
Calm 7.5%
Happy 0.4%
Angry 0.3%
Fear 0.1%
Surprised 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 29-45
Gender Male, 81.7%
Sad 98%
Calm 1.1%
Angry 0.5%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0%

AWS Rekognition

Age 22-34
Gender Male, 96.3%
Sad 39%
Angry 24.7%
Fear 23.3%
Calm 10.9%
Confused 1%
Surprised 0.7%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 5-15
Gender Male, 96.8%
Calm 94.8%
Sad 3%
Confused 1.2%
Angry 0.3%
Surprised 0.2%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 18-30
Gender Male, 97.8%
Fear 39.4%
Calm 37.5%
Sad 17.6%
Angry 2.6%
Confused 1.1%
Surprised 0.9%
Happy 0.7%
Disgusted 0.3%

AWS Rekognition

Age 27-43
Gender Male, 67.3%
Sad 93.5%
Calm 3.1%
Angry 1.5%
Confused 0.8%
Fear 0.5%
Happy 0.3%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 48-66
Gender Male, 69%
Calm 47.5%
Confused 21.6%
Fear 15%
Surprised 6.6%
Sad 4.4%
Angry 3.1%
Disgusted 1.4%
Happy 0.4%

AWS Rekognition

Age 23-37
Gender Male, 78.1%
Angry 39.2%
Calm 20.3%
Sad 19.5%
Happy 15.2%
Fear 2.5%
Disgusted 2.1%
Surprised 0.7%
Confused 0.5%

AWS Rekognition

Age 2-8
Gender Female, 92.7%
Sad 79.3%
Calm 8.7%
Fear 5.6%
Happy 2%
Confused 1.5%
Surprised 1.4%
Angry 1.2%
Disgusted 0.4%

AWS Rekognition

Age 16-28
Gender Male, 77.2%
Surprised 32.3%
Sad 29.7%
Fear 21.4%
Angry 4%
Happy 4%
Confused 3.7%
Calm 2.9%
Disgusted 2.1%

AWS Rekognition

Age 25-39
Gender Female, 54.5%
Sad 50.9%
Calm 37.4%
Fear 3.3%
Happy 2.5%
Confused 2.1%
Angry 2%
Disgusted 0.9%
Surprised 0.9%

AWS Rekognition

Age 20-32
Gender Male, 97.6%
Happy 51.1%
Angry 16.9%
Calm 14.4%
Fear 6.4%
Sad 6.4%
Disgusted 3.6%
Surprised 0.6%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 72.3%

Categories

Imagga

paintings art 99.8%

Text analysis

Amazon

DELAWARE
SILE
-
...
- Y ...
Y
Exica

Google

SILEEEE 111
SILEEEE
111