Human Generated Data

Title

Untitled (Lower East Side, New York City)

Date

1933-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3620

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3620

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-03-29

Human 99.2
Performer 99.2
Person 99
Person 96.9
Apparel 95.9
Clothing 95.9
Tie 94.6
Accessory 94.6
Accessories 94.6
Person 94.1
Suit 94
Overcoat 94
Coat 94
Hat 92.6
Face 74.7
Art 71.4
Clown 59.3
Leisure Activities 56.1
Photo 55.4
Photography 55.4
Portrait 55.2

Clarifai
created on 2018-02-09

people 99.9
two 99
adult 98.9
portrait 97.5
administration 95.9
man 95.8
three 95.3
wear 95.2
woman 95.1
one 94.5
group 94.2
veil 94
leader 93.3
lid 89.5
music 89.4
outfit 89.3
group together 88.3
four 87.3
child 85
movie 81.9

Imagga
created on 2018-02-09

religion 28.7
clothing 28.4
old 27.9
ancient 24.2
vestment 23
statue 21.3
gown 21
architecture 19.6
sculpture 19
antique 18.4
portrait 18.1
uniform 17.9
person 17.6
covering 17.6
religious 16.9
history 16.1
man 15.5
temple 15.1
historical 15.1
column 14.8
church 14.8
outerwear 14.5
male 14.2
art 14
culture 13.7
prayer 13.5
travel 13.4
gold 13.1
historic 12.8
stone 12.6
black 12.6
god 12.4
decoration 12.3
ruler 12
building 11.9
face 11.4
catholic 11.1
style 11.1
tradition 11.1
traditional 10.8
carving 10.8
vintage 10.8
spirituality 10.6
fashion 10.6
adult 10.4
people 10
necktie 9.7
pray 9.7
groom 9.2
hat 9.2
tourism 9.1
dress 9
lady 8.9
worship 8.7
love 8.7
holy 8.7
saint 8.7
spiritual 8.6
faith 8.6
oriental 8.6
attractive 8.4
figure 8.4
world 8.1
detail 8
interior 8
garment 7.9
golden 7.7
sitting 7.7
men 7.7
monk 7.7
palace 7.7

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 99.5
posing 97.5
standing 87.8
old 70.3
black 69.6
vestment 66

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 85.5%
Sad 4.6%
Surprised 2.4%
Calm 53%
Confused 5.3%
Angry 8.9%
Happy 7.6%
Disgusted 18.1%

AWS Rekognition

Age 35-52
Gender Male, 99.8%
Angry 3.4%
Happy 4.6%
Confused 8%
Disgusted 4.2%
Sad 8.2%
Calm 69.1%
Surprised 2.5%

AWS Rekognition

Age 35-52
Gender Male, 96.5%
Sad 1.4%
Angry 0.6%
Surprised 0.2%
Disgusted 0.1%
Confused 0.5%
Happy 0.1%
Calm 97.2%

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 94.6%
Suit 94%
Hat 92.6%

Captions

Azure OpenAI

Created on 2024-01-28

The image depicts a vintage scene with three individuals standing in front of what appears to be an ornate doorway or entrance to a building. The entryway has an elaborate design with intricate carvings. One individual, standing on the right side of the frame, seems to be casually leaning against the door frame with their right arm extended upwards. The attire and style suggest a historical setting. The overall composition has the appearance of an aged photograph with sepia tones, which adds to its historical ambiance.

Anthropic Claude

Created on 2024-03-29

The image shows three men standing in a dimly lit doorway. The man in the center is wearing a suit and hat, with a serious expression on his face. The other two men are standing on either side of him, one with his arm raised. The doorway features ornate carved details. The image has a vintage, black-and-white aesthetic, suggesting it was taken sometime in the past.