Human Generated Data

Title

Untitled (copy photograph of Ben Shahn's Rikers Island Penitentiary mural study: prisoners playing baseball)

Date

1934-1935

People

Artist: Walker Evans, American 1903 - 1975

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2000.50

Human Generated Data

Title

Untitled (copy photograph of Ben Shahn's Rikers Island Penitentiary mural study: prisoners playing baseball)

People

Artist: Walker Evans, American 1903 - 1975

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2000.50

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Painting 97.8
Art 97.8
Person 97.3
Human 97.3
Person 96.9
Person 93.9
Person 84.8
Person 80.9
Person 75.3
Person 66.7
Mural 64.9
Drawing 63.3
Person 60.7
Cafe 59.6
Restaurant 59.6
Floor 57.5
Flooring 57
Sketch 55.5
Porch 55.3

Clarifai
created on 2023-10-15

people 100
group 99.7
print 99.1
art 98.9
adult 98.1
child 97.1
woman 96.7
man 96.1
painting 95.3
many 93.8
sit 90.9
wear 90.8
several 87.1
engraving 87
veil 85.9
boy 85.4
son 85.4
sepia pigment 84.6
family 84.6
illustration 84.3

Imagga
created on 2021-12-14

architecture 44.1
building 34
old 32.1
ancient 31.1
sketch 26.3
art 25.1
city 24.1
stone 23.7
historical 23.5
history 23.3
historic 22.9
sculpture 21.3
tourism 20.6
monument 20.6
travel 20.4
drawing 20.2
cathedral 19.8
religion 19.7
antique 18.5
landmark 18.1
famous 17.7
church 17.6
wall 17.4
vintage 17.4
representation 16.3
column 16
tourist 15.4
statue 15.3
arch 14.9
culture 14.5
temple 14.3
window 13.7
carving 13.6
structure 13
street 12.9
grunge 12.8
architectural 12.5
facade 12.3
decoration 11.9
paper 11.8
tile 11.5
buildings 11.3
town 11.1
texture 11.1
aged 10.9
retro 10.7
marble 9.9
door 9.8
balcony 9.7
house 9.6
artistic 9.6
construction 9.4
religious 9.4
support 9.3
ornate 9.2
detail 8.9
brown 8.8
columns 8.8
catholic 8.8
heritage 8.7
medieval 8.6
attraction 8.6
destination 8.4
exterior 8.3
paint 8.1
palace 8.1
dirty 8.1
urban 7.9
carved 7.8
god 7.7
place 7.4
design 7.3
tower 7.2
device 7.2
alley 7.1
textured 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

drawing 98
text 97.9
person 89.7
sketch 87
clothing 84.5
painting 78.4
cartoon 69.9
old 60.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-68
Gender Female, 61.3%
Calm 79.9%
Surprised 8.6%
Confused 4.4%
Sad 2.9%
Happy 1.9%
Angry 1.2%
Fear 0.8%
Disgusted 0.4%

AWS Rekognition

Age 39-57
Gender Female, 52.2%
Calm 79.6%
Fear 8.3%
Surprised 5.3%
Sad 4.6%
Confused 0.8%
Happy 0.7%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 39-57
Gender Male, 97.6%
Sad 51.3%
Calm 38.5%
Disgusted 6.4%
Fear 1.3%
Confused 0.8%
Angry 0.8%
Surprised 0.5%
Happy 0.4%

AWS Rekognition

Age 36-54
Gender Male, 90.2%
Calm 97.5%
Sad 1%
Angry 0.6%
Happy 0.3%
Fear 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 50-68
Gender Male, 97.9%
Sad 85.9%
Calm 13.4%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 32-48
Gender Male, 58.9%
Sad 68.5%
Angry 16.3%
Calm 14%
Confused 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 16-28
Gender Male, 79.9%
Calm 86.5%
Fear 5.7%
Sad 3%
Confused 1.8%
Angry 1.2%
Surprised 1.2%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 49-67
Gender Male, 69.1%
Calm 57.2%
Fear 22.1%
Sad 5.3%
Disgusted 5.1%
Angry 4.2%
Surprised 4.1%
Confused 1.1%
Happy 0.9%

AWS Rekognition

Age 25-39
Gender Male, 92.4%
Calm 66.7%
Sad 13.2%
Angry 7.4%
Surprised 7.1%
Confused 3%
Happy 1.3%
Fear 0.8%
Disgusted 0.6%

AWS Rekognition

Age 25-39
Gender Female, 52.8%
Calm 68.1%
Sad 19.5%
Happy 9.4%
Angry 1.2%
Confused 0.8%
Surprised 0.4%
Fear 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.8%
Person 97.3%

Categories

Captions