Human Generated Data

Title

Untitled (Boris Gorelick in front of the United States Court House, Artists' Union and Artists' Committee for Action demonstration for job relief and a municipal art gallery, Foley Square, New York City)

Date

October 27, 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3922

Human Generated Data

Title

Untitled (Boris Gorelick in front of the United States Court House, Artists' Union and Artists' Committee for Action demonstration for job relief and a municipal art gallery, Foley Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 27, 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3922

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Photography 99.8
Face 99.8
Head 99.8
Portrait 99.8
Body Part 99.5
Finger 99.5
Hand 99.5
Overcoat 97.4
Firearm 93.3
Weapon 93.3
Gun 92.5
Handgun 92.5
Formal Wear 91.4
Jacket 86
Electrical Device 69.4
Microphone 69.4
Accessories 63.5
Neck 57
Glasses 56.3
People 56.1
Cap 55.8
Hat 55.8
Sunglasses 55.8

Clarifai
created on 2018-05-10

people 99.8
one 99.6
adult 98.8
man 98.4
portrait 95.9
administration 94.2
wear 91
indoors 90.1
two 87.8
leader 86.7
vehicle 85.8
actor 83.3
monochrome 81.1
woman 79.4
transportation system 79.4
sit 78.4
outfit 78.1
furniture 77.7
music 77
aircraft 73.9

Imagga
created on 2023-10-06

suit 41.7
person 37.4
business 36.4
man 36.3
office 32.6
male 32.1
people 31.8
adult 29.4
clothing 26.8
businessman 25.6
professional 25.3
corporate 24.1
portrait 23.9
garment 23.6
work 22.8
looking 20.8
sitting 20.6
executive 19.5
job 19.5
face 19.2
confident 19.1
businesswoman 19.1
desk 19
attractive 18.9
happy 18.8
handsome 18.7
computer 18.4
tie 18
smiling 17.4
smile 17.1
career 16.1
black 16.1
working 15.9
men 15.5
guy 15.4
indoors 14.9
one 14.9
indoor 14.6
serious 14.3
businesspeople 14.2
color 13.9
laptop 13.8
scholar 13.6
adolescent 13.4
formal 12.4
lifestyle 12.3
successful 11.9
intellectual 11.9
casual 11.9
coat 11.7
jacket 11.6
brunette 11.3
meeting 11.3
juvenile 11.2
expression 11.1
20s 11
alone 11
worker 10.8
necktie 10.8
1 10.6
sexy 10.4
shirt 10.4
manager 10.2
holding 9.9
hand 9.9
modern 9.8
fashion 9.8
pretty 9.8
success 9.7
corporation 9.6
only 9.5
workplace 9.5
smart 9.4
bow tie 9.2
trench coat 9
team 9
staff 8.9
good looking 8.8
home 8.8
mid adult 8.7
paper 8.6
boss 8.6
model 8.6
talking 8.6
room 8.4
employee 8.4
hair 7.9
day 7.8
standing 7.8
30s 7.7
sales 7.7
head 7.6
student 7.4
service 7.4
camera 7.4
inside 7.4
covering 7.3
building 7.3
newspaper 7.3
consumer goods 7.2
stylish 7.2
raincoat 7.2
women 7.1
interior 7.1
look 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 95.7
man 91.4
outdoor 90.2

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 34-42
Gender Male, 98.9%
Calm 97%
Surprised 6.4%
Fear 6.4%
Sad 2.3%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Suit
Baby

Clarifai

Human face
Man
Human arm
Human nose
Human mouth

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 93.1%

AWS Rekognition

Person 90%

AWS Rekognition

Person 89.3%

AWS Rekognition

Person 89.2%

AWS Rekognition

Adult 99.7%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 89.3%

AWS Rekognition

Male 99.7%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 89.3%

AWS Rekognition

Man 99.7%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 89.3%

AWS Rekognition

Suit 91.4%

AWS Rekognition

Baby 90%

Clarifai

Human face 94.8%

Clarifai

Human face 92.4%

Clarifai

Human face 34.3%

Clarifai

Human face 33.1%

Clarifai

Man 89.9%

Clarifai

Man 75.1%

Clarifai

Man 49.1%

Clarifai

Man 43.2%

Clarifai

Human arm 41.5%

Clarifai

Human arm 39.7%

Clarifai

Human nose 40.4%

Clarifai

Human mouth 38%

Categories

Imagga
created on 2023-10-06

people portraits 99.6%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a man in a suit and tie is standing in front of a crowd

Created by general-english-image-caption-blip-2 on 2025-07-07

a man in a suit standing in front of a crowd

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image appears to be a negative, showing a man dressed in a formal overcoat with a collared shirt and tie, standing in front of what seems to be a large architectural structure, possibly scaffolding or a modern building facade. Several figures wearing hats are visible in the foreground, likely part of a crowd or audience. The overall composition suggests a public or professional setting.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image appears to be a negative photograph featuring a man standing in what seems to be an outdoor setting. He is wearing a formal, long coat with his hands in his pockets. In the background, there are several people with visible white hats, suggesting a group or gathering. Behind them is a large structure with scaffolding or fencing visible, likely indicating a construction site or an industrial area. The mood conveyed by the negative inversion gives the scene an abstract, historical quality.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a black and white photograph of a man standing in an outdoor setting. The man appears to be wearing a heavy, woolen coat and has a serious expression on his face. The background suggests an urban or industrial setting, with some architectural structures visible behind the man. The overall mood of the image is somber and contemplative.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph that appears to be from Harvard University, as indicated by the credit line. The image shows a person standing, wearing a formal overcoat with buttons and what appears to be a collar underneath. The person is photographed from a slightly lower angle, making them appear tall and imposing against the background, which shows some architectural elements including what looks like railings or barriers. The photo has the characteristic grain and contrast of early to mid-20th century photography. There are some other people visible in the lower portion of the frame, though they are partially cropped or out of focus.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a man in a suit standing in front of a group of people, likely taken in the 20th century.

  • The man is wearing a dark-colored suit with a light-colored shirt and tie. He has short hair and appears to be middle-aged.
  • The group of people behind him are mostly out of focus, but they appear to be seated and facing the man.
  • In the background, there is a building with a corrugated metal roof and a brick wall. There are also some windows and doors visible.
  • The overall atmosphere of the image suggests that it was taken at an event or meeting, possibly a formal gathering or conference.

The image provides a glimpse into the past, capturing a moment in time when people came together to discuss important issues or celebrate special occasions.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a man in a suit, with other people visible in the background. The man is standing in the center of the image, wearing a dark-colored suit jacket and a light-colored shirt. He has short hair and appears to be looking to his left.

In the background, there are several other people visible, although they are not clearly defined. Some of them appear to be wearing hats or caps. There is also a building or structure visible in the background, with a large window or door on the right side of the image.

Overall, the image appears to be a historical photograph, possibly taken in the early 20th century. It may be a portrait of the man in the center of the image, or it could be a scene from a public event or gathering.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image shows a monochromatic photograph of a man standing in front of a crowd of people. The man is wearing a suit and tie, and he appears to be speaking or giving a speech. His face is partially obscured by the shadow of his head, and he is looking directly at the camera. The crowd of people behind him are blurry and indistinct, but they appear to be listening to the man's speech. The background of the image is a brick wall and a metal structure.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man standing in front of a crowd. He is wearing a suit and tie, and his hands are clasped in front of him. He appears to be addressing the crowd, and his facial expression suggests that he is speaking passionately. The background shows a building under construction, with scaffolding and metal structures visible. The photograph has a vintage look, with a slightly grainy texture and a soft focus.

Google Gemini

Created by gemini-2.0-flash on 2025-05-23

The image is a black and white negative featuring a fair-skinned man with light, wavy hair, dressed in a suit. He is positioned in the center of the frame, appearing to speak. Behind him is a building with a corrugated metal exterior, and to the left, a brick structure is partially visible.

In the foreground, in front of the man, are several people. Their heads are visible, and some are wearing hats. The image gives the impression of a gathering, possibly an event or meeting, with the man as the speaker or focus of attention.

The negative format of the image inverts the tones, giving it a distinct and somewhat eerie appearance.

Created by gemini-2.0-flash-lite on 2025-05-23

Here is a description of the image:

The image is a black and white negative, showing a man in a coat standing outdoors. The man is the central subject of the photograph, with his head and torso filling a significant portion of the frame. He is wearing a suit jacket or overcoat with a shirt and tie underneath. His hair is neatly styled, and his expression suggests he is speaking or engaged in a conversation. The background includes architectural elements, such as what appears to be the side of a building. In the foreground are the shadowy forms of other people, perhaps a crowd. The photograph is slightly grainy, typical of vintage images. The image also has a clear caption with the text "© President and Fellows of Harvard College (Harvard University Art Museums)" and a catalog number at the bottom right.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a man standing outdoors. The man is wearing a tweed jacket and appears to be in a formal or semi-formal setting. His eyes are obscured, likely due to the brightness of the surroundings or possibly due to an effect in the photograph. The background shows an industrial or construction site with large structures, scaffolding, and what appears to be a brick building. There are also a few other individuals in the background, some of whom are wearing hats. The overall atmosphere suggests an event or inspection at an industrial facility. The photograph is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

No captions written

Text analysis

Amazon

(Harvard
College
of
Fellows
Harvard
Museums)
and
President and Fellows of Harvard College (Harvard University Art Museums)
University
Art
President
P1970.3922.0000

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.3922.0000
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.3922.0000