Human Generated Data

Title

Untitled (Lower East Side, New York City)

Date

1933-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2464

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2464

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-06-24

Clothing 99.2
Apparel 99.2
Human 99
Person 99
Person 98.8
Suit 96.1
Coat 96.1
Overcoat 96.1
Tie 81.4
Accessories 81.4
Accessory 81.4
Finger 78
Face 75.4
Man 70.3
Hat 68.8
Photo 65
Portrait 65
Photography 65
Sleeve 56

Clarifai
created on 2023-10-29

people 99.8
one 99.4
portrait 99.3
adult 98.7
man 97.1
wear 95.5
actor 93.1
street 92.7
lid 92.2
music 91
two 88.9
administration 88.7
leader 88.1
musician 87.6
facial expression 82.3
veil 82.2
woman 80.9
outfit 78.7
movie 76.7
boy 76.7

Imagga
created on 2022-06-24

person 33.1
man 25.5
world 23.6
male 19.1
adult 19.1
people 19
one 18.7
portrait 18.1
black 15.1
adolescent 14.8
face 14.2
casual 13.6
posing 13.3
lifestyle 13
elevator 13
attractive 12.6
old 12.5
juvenile 12.3
sexy 12
human 12
looking 12
dark 11.7
night 11.5
business 10.9
guy 10.7
happy 10.6
clothing 10.5
lifting device 10.4
expression 10.2
device 10.1
vintage 9.9
body 9.6
hair 9.5
water 9.3
model 9.3
sport 9.2
studio 9.1
pose 9.1
fashion 9
fitness 9
handsome 8.9
men 8.6
executive 8.6
light 8.5
shirt 8.4
pretty 8.4
professional 8.3
statue 8.1
active 8.1
wet 8
office 8
cool 8
businessman 7.9
serious 7.6
dance 7.6
balance 7.6
rain 7.5
leisure 7.5
room 7.4
dancer 7.4
sensual 7.3
sensuality 7.3
exercise 7.3
performer 7.1
happiness 7
modern 7

Google
created on 2022-06-24

Microsoft
created on 2022-06-24

person 99.1
posing 97.7
text 97.6
clothing 96.9
standing 95.2
man 94.5
human face 94.4
black and white 83
black 82.3
window 81.8
white 70.8
old 62.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Angry 62%
Calm 21.4%
Disgusted 6.8%
Surprised 6.7%
Fear 6.3%
Sad 3.8%
Confused 3.2%
Happy 0.7%

AWS Rekognition

Age 13-21
Gender Male, 99.9%
Calm 60.6%
Sad 41.7%
Confused 11%
Surprised 6.5%
Fear 6%
Disgusted 1.5%
Angry 1.4%
Happy 0.4%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Suit 96.1%
Tie 81.4%

Captions

Azure OpenAI

Created on 2024-01-27

The image is a black and white photograph, featuring two individuals standing in front of an ornate, patterned doorway. To the left, a person is dressed in a suit and hat, reminiscent of an earlier era fashion. To the right, another individual is posed with their arm raised, their attire appears casual, with a loosely fitted shirt tucked into high-waisted trousers. A small badge or sign on the doorway reads "NRA MEMBER" with additional text underneath that is not fully legible. The scene gives a vintage feel, possibly capturing a moment of historical significance. The architecture suggests the photo may have been taken in an urban setting, with part of a reflective glass window also visible, offering a glimpse of the surrounding environment.

Anthropic Claude

Created on 2024-03-29

This black and white image depicts two men in a setting that appears to be from an earlier time period, likely the early to mid-20th century. One man is wearing a suit and tie, while the other is dressed more casually in a shirt and pants. The man in casual attire is standing next to an ornately carved wooden pillar, suggesting this may be the entrance to a building or structure. The overall atmosphere of the image conveys a sense of the past, with the two men representing different social or economic backgrounds.

Meta Llama

Created on 2024-11-30

The image is a black-and-white photograph of two men standing in front of a doorway. The man on the left is wearing a dark suit, white shirt, and black tie, with a fedora hat. He has his hands clasped together in front of him. The man on the right is wearing a light-colored shirt, light-colored pants, and a newsboy cap. He is leaning against the doorframe with his left arm raised above his head. The background of the image shows a dark doorway with a decorative frame. There is a sign on the wall to the left of the doorway that appears to be an NRA (National Recovery Administration) sign, which was a government agency established during the Great Depression to promote fair labor practices and regulate industries. Overall, the image suggests that the two men are waiting for something or someone, possibly in a professional or business setting. The presence of the NRA sign adds a historical context to the image, indicating that it was taken during a time of economic hardship and social change in the United States.

Text analysis

Amazon

ou
NRA
MEMBER

Google

NRA MEMBER OL **
NRA
MEMBER
OL
**