Human Generated Data

Title

Untitled (copy photograph of Ben Shahn's Rikers Island Penitentiary mural study: prisoners in classrooms)
Date

1934-1935
People

Artist: Walker Evans, American 1903 - 1975
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2000.49

Human Generated Data

Title

Untitled (copy photograph of Ben Shahn's Rikers Island Penitentiary mural study: prisoners in classrooms)

People

Artist: Walker Evans, American 1903 - 1975

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P2000.49

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 99.4
Person 99.3
Painting 98
Art 98
Person 97.8
Person 97.5
Person 96.9
Person 96
Person 94.8
Person 88
Person 80.7
Musician 76.9
Musical Instrument 76.9
Person 73
Crowd 69.7
Person 68.7
Person 65.6
Music Band 65.4
Leisure Activities 65.3
Person 64.8
People 61.6
Drawing 55.9

Clarifai
created on 2023-10-15

people 100
group 99.8
many 99.5
adult 99.5
man 97.9
child 97.9
woman 97.8
group together 96.4
art 95.8
vehicle 95.4
street 95.3
transportation system 95.1
wear 94.1
boy 93.9
several 93.7
print 90.9
war 90
soldier 89.6
elderly 89.4
illustration 89.2

Imagga
created on 2021-12-14

sculpture 51.5
statue 41.4
religion 38.6
temple 36.4
ancient 36.3
architecture 33.7
art 32.9
comic book 30.9
history 30.4
stone 30
culture 29.9
carving 28.7
travel 26.1
sketch 24.4
old 23
monument 22.4
god 22
religious 20.6
tourism 19
drawing 18.5
historic 18.3
historical 16.9
building 16.9
city 16.6
holy 16.4
representation 15.2
decoration 14.3
famous 14
landmark 13.5
heritage 13.5
spirituality 13.4
museum 13.2
antique 13.1
worship 12.6
spiritual 12.5
traditional 12.5
print media 12.4
figure 11.3
church 11.1
tourist 11
structure 10.8
china 10.6
detail 10.5
facade 10.4
east 10.3
carved 9.8
meditation 9.6
golden 9.5
oriental 9.4
column 9.2
world 9
palace 8.9
marble 8.8
pray 8.7
prayer 8.7
face 8.5
memorial 8.4
relief 8.2
symbol 8.1
currency 8.1
statues 7.9
dollar 7.4
tradition 7.4
plastic art 7.3
man 7.1

Google
created on 2021-12-14

Photograph 94.2
Organism 86.4
Art 83.9
Headgear 83.6
Adaptation 79.3
Illustration 72.1
Painting 71.1
Vintage clothing 70.3
Motor vehicle 68.2
History 68.2
Stock photography 64.5
Font 63.9
Printmaking 59.2
Drawing 58.4
Visual arts 57.2
Crowd 55.1
Room 54.8
Paper product 53.5
Working animal 53.5
Mythology 50.1

Microsoft
created on 2021-12-14

text 99.5
book 97.8
drawing 96.6
cartoon 93.6
old 91.5
sketch 89.9
person 84.2
clothing 65.8
group 59.2
posing 51.4
clothes 16

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Female, 61.1%
Sad 98.7%
Calm 0.9%
Fear 0.1%
Happy 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 47-65
Gender Male, 99.1%
Sad 84.1%
Confused 8.3%
Calm 5.7%
Angry 0.9%
Fear 0.6%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 23-35
Gender Male, 68.2%
Calm 95.4%
Surprised 2%
Sad 1.3%
Disgusted 0.4%
Happy 0.4%
Confused 0.3%
Angry 0.2%
Fear 0%

AWS Rekognition

Age 26-40
Gender Female, 94.2%
Sad 92.3%
Calm 7.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 23-35
Gender Male, 87.3%
Calm 63.5%
Angry 26.6%
Sad 4.9%
Fear 1.8%
Happy 1.1%
Surprised 0.9%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 50-68
Gender Male, 79%
Calm 98%
Sad 0.7%
Happy 0.5%
Angry 0.4%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 38-56
Gender Male, 95.5%
Calm 65.2%
Sad 23.1%
Angry 10.4%
Confused 0.4%
Disgusted 0.3%
Happy 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 47-65
Gender Male, 99.6%
Calm 36.3%
Happy 23.2%
Angry 20.3%
Fear 11.4%
Sad 4.5%
Confused 1.7%
Disgusted 1.5%
Surprised 1.1%

AWS Rekognition

Age 38-56
Gender Female, 59.8%
Calm 95.9%
Fear 2%
Happy 0.7%
Sad 0.7%
Angry 0.3%
Surprised 0.3%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 40-58
Gender Male, 56%
Sad 90.5%
Calm 7.1%
Angry 1.4%
Confused 0.6%
Fear 0.3%
Happy 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 40-58
Gender Male, 94.4%
Sad 80.5%
Calm 16.5%
Confused 1.3%
Angry 1.1%
Fear 0.4%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-35
Gender Male, 91.2%
Calm 98.6%
Sad 0.5%
Happy 0.5%
Angry 0.2%
Surprised 0%
Fear 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 27-43
Gender Male, 85.9%
Sad 97.6%
Calm 1.6%
Fear 0.3%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 79.3%
Calm 96.2%
Sad 1.1%
Happy 1%
Angry 1%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 33-49
Gender Male, 96.1%
Sad 67.4%
Calm 30.1%
Confused 0.7%
Angry 0.5%
Fear 0.4%
Happy 0.3%
Disgusted 0.3%
Surprised 0.1%

AWS Rekognition

Age 17-29
Gender Male, 94.3%
Sad 96.7%
Calm 2.8%
Angry 0.2%
Fear 0.2%
Confused 0%
Happy 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 37-55
Gender Female, 79%
Sad 74%
Calm 23.8%
Confused 0.9%
Fear 0.6%
Happy 0.3%
Surprised 0.2%
Angry 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 98%

Categories

Imagga

paintings art 92.9%
streetview architecture 4.6%
people portraits 2%