Human Generated Data

Title

Untitled (Eighth Avenue and Forty-second Street, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2971

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Eighth Avenue and Forty-second Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2971

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Wedding 97.8
Indoors 96.5
Face 83.2
Head 83.2
Crowd 81.1
Barbershop 76.5
Courtroom 73.1
Room 73.1
Attorney 63
Hairdresser 56.7
Electrical Device 55.9
Microphone 55.9
Audience 55.4
Debate 55.4
Speech 55.4

Clarifai
created on 2018-05-10

people 100
adult 98.9
group 98.6
group together 97.2
two 96.1
man 95.8
administration 95.4
woman 94.3
four 94.3
three 93.9
several 93.4
five 91.7
many 90.8
war 88.8
leader 87.5
wear 86.2
military 84.8
vehicle 84.7
music 83.7
one 83.5

Imagga
created on 2023-10-07

office 41.3
laptop 40.6
man 40.3
business 36.4
computer 35.5
working 34.5
male 34
businessman 31.8
work 27.5
people 27.3
person 26.9
adult 22.8
corporate 18.9
worker 18.7
job 18.6
briefcase 17.7
businesswoman 17.3
men 17.2
desk 17.1
happy 16.9
professional 16.6
looking 16
smiling 15.9
indoors 15.8
technology 15.6
notebook 14.9
executive 14.7
casual 14.4
senior 14.1
keyboard 13.1
room 13.1
suit 12.9
communication 12.6
center 12.5
handsome 12.5
shop 12.2
smile 12.1
manager 12.1
mature 12.1
sitting 12
one 11.9
barbershop 11.7
upright 11.6
lifestyle 11.6
education 11.3
device 11.2
horizontal 10.9
face 10.6
attractive 10.5
talking 10.5
career 10.4
meeting 10.4
women 10.3
day 10.2
glasses 10.2
musical instrument 10.1
indoor 10
concentration 9.7
table 9.6
engineer 9.6
classroom 9.6
standing 9.6
businesspeople 9.5
finance 9.3
building 9.2
portrait 9.1
student 9.1
team 9
group 8.9
success 8.8
home 8.8
couple 8.7
piano 8.7
tie 8.5
support 8.4
monitor 8.4
old 8.4
color 8.3
phone 8.3
holding 8.3
occupation 8.2
successful 8.2
active 8.2
percussion instrument 8.1
modern 7.7
industry 7.7
wireless 7.6
reading 7.6
screen 7.5
shirt 7.5
mercantile establishment 7.5
teamwork 7.4
back 7.3
20s 7.3
equipment 7.3
keyboard instrument 7.2
call 7.2
black 7.2
machine 7.2
typesetting machine 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.1
man 94.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 20-28
Gender Male, 100%
Confused 32.4%
Calm 30.3%
Sad 21.5%
Fear 14.8%
Surprised 6.9%
Angry 2.3%
Disgusted 0.6%
Happy 0.2%

AWS Rekognition

Age 52-60
Gender Male, 100%
Sad 99.3%
Calm 28%
Confused 6.8%
Surprised 6.6%
Fear 6.2%
Angry 1.3%
Disgusted 0.8%
Happy 0.6%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 17
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Bride
Female
Woman

Clarifai

Man
Clothing
Human face
Human arm
Footwear
Human hair

AWS Rekognition

Adult 99.1%

AWS Rekognition

Adult 98.9%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Adult 97.8%

AWS Rekognition

Adult 96.8%

AWS Rekognition

Male 99.1%

AWS Rekognition

Male 98.9%

AWS Rekognition

Male 98.8%

AWS Rekognition

Man 99.1%

AWS Rekognition

Man 98.9%

AWS Rekognition

Man 98.8%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 79.5%

AWS Rekognition

Person 75.5%

AWS Rekognition

Person 62.1%

AWS Rekognition

Bride 97.8%

AWS Rekognition

Female 97.8%

AWS Rekognition

Female 96.8%

AWS Rekognition

Woman 97.8%

AWS Rekognition

Woman 96.8%

Clarifai

Man 94.6%

Clarifai

Man 93%

Clarifai

Man 89.9%

Clarifai

Man 66.2%

Clarifai

Man 36.6%

Clarifai

Man 36.3%

Clarifai

Clothing 86.3%

Clarifai

Clothing 78.5%

Clarifai

Clothing 52.1%

Clarifai

Human face 76.6%

Clarifai

Human face 70.2%

Clarifai

Human face 64%

Clarifai

Human face 49.8%

Clarifai

Human arm 41.8%

Clarifai

Footwear 39.5%

Clarifai

Human hair 37.3%

Clarifai

Human hair 34.3%

Clarifai

Human hair 33.6%

Clarifai

Human hair 33.5%

Categories

Imagga
created on 2023-10-07

paintings art 49.8%
people portraits 18.7%
streetview architecture 18%
food drinks 3.8%
pets animals 3.7%
events parties 2.9%
interior objects 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a man in a suit and tie is standing in front of a poster board

Created by general-english-image-caption-blip-2 on 2025-07-04

a man standing in front of a mural with a man in the background

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image shows a group of men in an outdoor setting, likely part of a performance or presentation. A muscular, shirtless man is standing and gesturing. Behind him is a painted backdrop featuring the image of a strongman lifting a bus, highlighting themes of physical strength or feats of power. The scene includes a podium or stand, and some attendees are visible in the foreground, suggesting this may be part of a public demonstration or sideshow. Signs reading "Natural Institute of Meals" and other text appear in the environment, contributing to the context of the event.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows a small gathering in front of a building. Prominently featured is a poster with an illustration of a strong man pulling a large bus. Two people are standing in front of the poster, one in a dark suit and tie and the other is shirtless, displaying a muscular physique. Part of the scene is an audience, of which one person is seen seated or crouched. There's a sign on the wall behind them reading "Natural Institute Of...." though the rest is not visible. The setting appears to be an outdoor event, possibly a demonstration or performance involving physical strength.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to depict a scene from the early 20th century. It shows several men standing in an alley or narrow street, with a sign for a "Medical Institute" visible on the wall. Some of the men are shirtless, suggesting this may be a location related to physical fitness or medical treatment. There is also a wooden crate or container in the foreground. The overall atmosphere seems to be one of a working-class or industrial setting from that historical period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This appears to be a black and white historical photograph showing several people at what looks like a street vendor or food stand. In the image, there are shirtless individuals and someone in business attire near what appears to be some kind of counter or booth. There's a sign visible that reads "NATURAL INSTITUTE" in the background, and the setting appears to be urban with brick walls visible. The image has the grainy quality typical of early-to-mid 20th century photography. The scene seems to be capturing some kind of street-level commercial or social interaction.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a man standing at a desk, with two men standing to his left and another man in the foreground.

The man at the desk is wearing a dark suit jacket, white shirt, and tie. He has short dark hair and is looking down at something on the desk. The two men to his left are shirtless and wearing dark pants. One of them has his hands on his hips, while the other has his hands by his sides. They both have short dark hair.

In the foreground, there is a man with short light-colored hair, wearing a white t-shirt. He is facing away from the camera and looking towards the man at the desk.

The background of the image appears to be an outdoor setting, with a brick wall and a wooden structure behind the man at the desk. There are several signs and posters on the wall, but they are not legible.

Overall, the image appears to be a candid shot of a group of men gathered around a desk, possibly in a professional or educational setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image depicts a black-and-white photograph of a man standing shirtless on the right side, wearing dark pants and a belt. He appears to be flexing his muscles. To his left is a man in a suit, possibly a judge or instructor, standing behind a podium with a sign on it that reads "NATURAL INSTITUTE" and "OPEN AIR GYM." The background features a mural of a man lifting weights, as well as a sign that reads "ADED MOTO." In the foreground, two men are visible, one wearing a white shirt and the other with his back turned. The overall atmosphere suggests a bodybuilding competition or demonstration.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The black-and-white photo shows a man standing in front of a podium, wearing a suit and tie. He is addressing a group of people. Behind him is a man wearing a belt and a harness, and he is holding a barbell. There is a poster on the wall behind them with a drawing of a man holding a barbell. On the left side of the image, there is a brick wall.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white image depicts a group of men in an outdoor area. One of them is standing in front of a podium with a box on top, and the other two are standing next to him. They are all looking at something on the podium. Behind them is a large painting of a man with a barbell. On the right side, there is a poster with some text and a logo.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-25

Here's a description of the image:

Overall Impression:

The image is a black and white photograph of what appears to be a public display or performance, possibly in an outdoor setting. The scene is somewhat crowded, with a few figures clearly visible in the foreground and background. The photograph has a vintage, grainy quality, suggesting it was taken some time ago.

Key Elements and Composition:

  • Center: The focal point is a man in a suit standing behind a small table or podium, seemingly addressing the audience.
  • Right: A muscular, shirtless man stands to the right, facing the audience. He is probably the performer.
  • Background: Painted murals depicting a bus/carriage with passengers and signs advertising a "Natural Institute".
  • Foreground: A man turned away from the camera in the foreground.
  • Atmosphere: The photograph exudes an atmosphere of curiosity and possibly anticipation, with the audience's attention focused on the performers.

Created by gemini-2.0-flash on 2025-05-25

Here is a description of the image:

This is a black and white photograph featuring what appears to be an outdoor demonstration or performance. There are several figures present, with a partial view of an audience in the foreground.

To the left, there's a person wearing a white shirt, their back to the camera. Behind them is a backdrop or wall with a painting of a muscular man pulling a car filled with people. Next to the painting is a man in a suit, who is likely an announcer or speaker, standing behind a small table with a briefcase. To the right of the announcer, there is a shirtless man with a muscular physique, posing or gesturing in front of a sign that reads "NATURAL INSTITUTE of HEALTH". The sign appears to have "OPEN AIR AND EN" at the bottom.

The scene is set in what seems to be a somewhat makeshift outdoor venue, with building walls and parts of structures visible in the background. Overall, the image suggests an event from the early to mid-20th century, possibly a strongman or health demonstration.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The black-and-white photograph depicts a scene that appears to be from the early to mid-20th century. The setting is outdoors, possibly at a fair or carnival, as suggested by the presence of a banner and a balloon in the background.

In the center of the image, there is a small stage or platform. On the stage, there are three men:

  1. A man dressed in a suit and tie, who seems to be addressing or presenting something to the audience.
  2. A shirtless man standing to the right of the suited man, flexing his muscles, likely demonstrating physical strength or fitness.
  3. Another shirtless man standing behind the suited man, also flexing his muscles.

In the foreground, there are two young boys with their backs to the camera, watching the scene on the stage. The boys appear to be engrossed in the presentation.

The background includes a brick wall and some posters or signs, one of which reads "NATURAL INSTITUTE" and another that partially reads "OLD MOTO." There is also a cage-like structure above the stage, which might be part of the fair or carnival setup.

Overall, the image captures a moment of public demonstration or performance, likely related to physical strength or health, with an attentive audience of young boys.

Qwen

No captions written

Text analysis

Amazon

MOTO
NATURAL
OPEN
DED MOTO
MAN
OPEN AIR
DED
OF
AIR
NATURAL INSTITUTE
INSTITUTE
MEAL
MAN MUSHOYAM
OF UNEMPLOYEE
MUSHOYAM
UNEMPLOYEE