Human Generated Data

Title

Untitled (Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4462.4

Human Generated Data

Title

Untitled (Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4462.4

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Advertisement 100
Wedding 98.7
Face 93.6
Head 93.6
Machine 92.9
Transportation 88.2
Vehicle 88.2
Art 80.9
Accessories 77.3
Bag 77.3
People 67.7
Cinema 63.6
Outdoors 56.8
Billboard 55.8
Text 55.3
Drawing 55.1

Clarifai
created on 2018-05-09

people 100
leader 99.4
group 99
administration 98.3
adult 98.1
man 97.3
chair 95.5
two 94.6
portrait 93.4
wear 92.3
three 91.6
five 90.4
several 89.7
woman 87.8
group together 87.5
veil 86.7
furniture 86.6
politician 86.3
outfit 84.9
facial expression 82.9

Imagga
created on 2023-10-05

money 34.9
currency 32.3
cash 31.1
dollar 29.7
finance 24.5
negative 24
banking 23.9
bill 23.8
financial 23.2
vintage 23.2
old 22.3
film 21.7
bank 21.5
business 21.3
postmark 20.7
stamp 20.3
mail 20.1
envelope 19.7
letter 19.7
paper 19.6
postage 18.7
one 18.7
postal 18.6
art 18.5
us 17.4
wealth 17.1
billboard 16.3
exchange 16.2
structure 16.2
web site 16.2
close 16
savings 15.8
circa 15.8
mug shot 15.6
retro 15.6
hundred 15.5
dollars 15.5
rich 14.9
printed 14.8
photograph 14.1
economy 13.9
shows 13.8
banknotes 13.7
aged 13.6
loan 13.4
signboard 13.3
man 12.9
investment 12.8
philately 12.8
card 12.8
photographic paper 12.3
symbol 12.1
ancient 12.1
memorial 12
banknote 11.6
states 11.6
pay 11.5
notes 11.5
profit 11.5
closeup 11.5
male 11.3
brass 11.3
creation 11.2
masterpiece 10.9
franklin 10.8
address 10.8
bills 10.7
market 10.6
finances 10.6
people 10.6
payment 10.6
office 10.5
united 10.5
senior 10.3
note 10.1
message 10
representation 10
funds 9.8
portrait 9.7
museum 9.7
success 9.7
black 9.6
post 9.5
icon 9.5
culture 9.4
grunge 9.4
commerce 9.3
face 9.2
paint 9.1
post office 8.9
economic 8.7
screen 8.6
capital 8.5
person 8.4
photographic equipment 8.2
sculpture 8.2
religion 8.1
painter 8
1967 7.9
known 7.9
president 7.9
paintings 7.8
price 7.7
fine 7.6
pattern 7.5
camera 7.4
text 7.3
global 7.3
computer 7.1

Google
created on 2018-05-09

Microsoft
created on 2018-05-09

old 75.2
posing 52.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 27-37
Gender Male, 99.5%
Sad 67%
Calm 23.3%
Angry 22.8%
Happy 13.1%
Surprised 7.1%
Fear 6.6%
Confused 4%
Disgusted 1.8%

AWS Rekognition

Age 16-24
Gender Male, 99.8%
Calm 98.7%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.4%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99%
Calm 95.4%
Surprised 6.4%
Fear 6%
Sad 2.7%
Happy 1.7%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Male
Man
Wheel
Bicycle
Handbag

Clarifai

Clothing
Human face
Tree
Poster
Human nose
Human eye

AWS Rekognition

Adult 98.7%

AWS Rekognition

Adult 98.4%

AWS Rekognition

Adult 97.9%

AWS Rekognition

Bride 98.7%

AWS Rekognition

Bride 97.9%

AWS Rekognition

Female 98.7%

AWS Rekognition

Female 97.9%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 96.7%

AWS Rekognition

Person 93.3%

AWS Rekognition

Person 84.8%

AWS Rekognition

Person 77.4%

AWS Rekognition

Person 63.7%

AWS Rekognition

Woman 98.7%

AWS Rekognition

Woman 97.9%

AWS Rekognition

Male 98.4%

AWS Rekognition

Man 98.4%

AWS Rekognition

Wheel 92.9%

AWS Rekognition

Wheel 87.7%

AWS Rekognition

Wheel 72.7%

AWS Rekognition

Wheel 66%

AWS Rekognition

Wheel 62.9%

AWS Rekognition

Bicycle 88.2%

AWS Rekognition

Bicycle 79.3%

AWS Rekognition

Bicycle 71.3%

AWS Rekognition

Bicycle 65.4%

AWS Rekognition

Bicycle 61.6%

AWS Rekognition

Handbag 77.3%

Clarifai

Clothing 93.9%

Clarifai

Clothing 92.3%

Clarifai

Clothing 85.2%

Clarifai

Clothing 83.6%

Clarifai

Clothing 39.8%

Clarifai

Clothing 37.1%

Clarifai

Clothing 33.9%

Clarifai

Human face 85.1%

Clarifai

Human face 80.8%

Clarifai

Human face 78%

Clarifai

Human face 61.5%

Clarifai

Tree 67.5%

Clarifai

Tree 40.3%

Clarifai

Poster 53.5%

Clarifai

Human nose 35.9%

Clarifai

Human nose 33.4%

Clarifai

Human nose 33%

Clarifai

Human eye 34%

Categories

Imagga
created on 2023-10-05

text visuals 56.7%
paintings art 16%
streetview architecture 13%
events parties 7.6%
nature landscape 3.3%
food drinks 1.5%
interior objects 1.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a man standing in front of a large poster of a large portrait of a man

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of a large screen with three portraits

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a large outdoor display featuring three portraits arranged side by side. The figures are dressed in formal attire, consisting of military uniforms and ceremonial clothing adorned with ornate decorations such as medals and intricate designs. The scene is set in an open area with buildings visible in the background, as well as bicycles and trees contributing to the setting. A small child stands in the foreground, gesturing upward toward the portraits. The image has a black-and-white, inverted (negative) photographic effect.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image appears to be a negative of a photograph showing large portraits displayed outdoors. The central portion contains three sizable, draped portraits featuring figures in formal or ceremonial attire. The attire of the figures includes military uniforms decorated with medals and honors, as well as traditional and intricate clothing adorned with elaborate jewelry. In front of the display, a child is saluting, adding a scene of interest to the lower part of the composition. The background includes bicycles and additional structures, suggestive of a public or event setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph depicting three large portraits or paintings displayed on a stage or platform. The portraits appear to be of three individuals wearing military or royal-style uniforms and regalia, suggesting they may be historical figures of some importance. The setting appears to be outdoors, with trees and other foliage visible in the background. There is a person standing in front of the display, though their identity is not clear. The overall scene conveys a sense of formality and reverence for the depicted individuals.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a black and white historical photograph showing a large display or mural installation. The image shows what appears to be three formal portraits mounted or displayed on a large panel or screen. The figures in the portraits are wearing what look like military-style uniforms with medals and decorations. The display appears to be set up outdoors, with some bicycles visible in the background. At the bottom of the image, there's a credit line indicating this is from the President and Fellows of Harvard College (Harvard University Art Museums).

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image is a black-and-white photograph of a large billboard featuring three portraits, with a young boy standing in front of it.

Billboard:

  • The billboard is rectangular and divided into three sections, each displaying a portrait.
  • The portraits are in black and white, with the leftmost portrait showing a man wearing a military uniform adorned with medals and epaulets.
  • The middle portrait depicts a woman wearing a necklace and a brooch, possibly a medal or other decoration.
  • The rightmost portrait features a man wearing a military uniform with a hat and medals.

Background:

  • In the background, there are several objects visible, including:
    • A bicycle leaning against a wall or fence.
    • A building with a tiled roof.
    • A tree or bush with leaves.
    • A car or truck parked behind the billboard.
    • A group of people standing behind the billboard, possibly tourists or locals.

Overall:

  • The image appears to be a historical photograph, possibly taken in the mid-20th century.
  • The presence of a young boy standing in front of the billboard suggests that the image may have been taken for a personal or family album.
  • The overall atmosphere of the image is one of nostalgia and historical significance.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

The image depicts a large outdoor display featuring three prominent figures, likely from Southeast Asia. The display is divided into three sections, each showcasing a different individual.

Left Section: A man is depicted wearing a military uniform adorned with medals and epaulets. He has short hair and is looking directly at the camera.

Middle Section: A woman is shown wearing a sari and a necklace featuring a large pendant. She also has short hair and is looking directly at the camera.

Right Section: A man is portrayed wearing a military uniform with a high collar and a fez hat. He has a mustache and is looking directly at the camera.

In the foreground, a person is standing in front of the display, while a building with a tiled roof is visible in the background. The overall atmosphere suggests that this is a historical or cultural display, possibly from the mid-20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-30

The image is a black-and-white photograph featuring a large, three-panel portrait of three individuals, likely a royal family. The portrait is mounted on a structure, possibly a stage or a display board, with a backdrop of trees and a building. The three individuals are dressed in traditional attire, with the man on the left wearing a military uniform, the woman in the middle wearing a necklace and a sash, and the man on the right also wearing a military uniform. There are bicycles parked in front of the structure, and a person is standing in front of it.

Created by amazon.nova-pro-v1:0 on 2025-05-30

The image is a black-and-white photo of a large mural of three people. The mural is displayed on a canvas on a frame, and it is placed on a grassy field. A girl is standing in front of the mural, and she is raising her hand. Behind the mural, there are bicycles, and there are trees in the distance. The image has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" on the bottom left.

Google Gemini

Created by gemini-2.0-flash on 2025-06-04

This is a black and white image that appears to be a negative of a photograph. In the foreground, there are three large portraits displayed on a structure. The portraits depict three individuals in what seems to be formal attire. The person on the left wears glasses and an embellished military-style uniform. The person in the center appears to be a woman with a decorative necklace and a sash adorned with emblems. The person on the right is wearing a military-style uniform and a hat.

Below the structure, there's a low wall or platform, and a young boy stands in front of it, looking to his right with his arm raised. Behind the portraits, one can see a building, presumably a house or a similar structure, with bicycles parked in front of it.

The negative effect in the image causes bright areas to appear dark, and vice versa. This creates an unusual visual effect, making the details of the scene somewhat difficult to discern at first glance. The image is marked with "President and Fellows of Harvard College (Harvard University Art Museums)" and a registration number, indicating that it is part of the Harvard University Art Museums collection.

Created by gemini-2.0-flash-lite on 2025-06-04

Here's a description of the image:

The image is a black and white, negative-style photograph showcasing a large public display or banner featuring three portraits of individuals. The portraits are printed on separate fabric panels and hung together.

Key elements:

  • Portraits: The portraits are the main focus. From left to right, they appear to depict a man wearing formal military attire and glasses, a woman wearing a necklace and what appears to be a shawl, and another man in a military-style uniform with a hat.
  • Banner Structure: The portraits are likely hung from a structure, possibly a temporary one. There are metal bars above the portraits for hanging.
  • Setting: The banner is displayed outdoors, likely in a public space. It is bordered by a wall of a house. There is also a child, a boy in shorts, standing on the ground and looking towards the portrait.
  • Context Clues: Based on the attire and the style, it is highly possible these portraits are of prominent figures, possibly political or royal figures. It is difficult to provide a definitive interpretation without information about the geographical location or the historical period.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a large, outdoor display featuring three prominent portraits. The portraits are of significant figures, likely political or royal, dressed in formal attire.

  1. Left Portrait: The individual is wearing a military uniform adorned with several medals and decorations. The person also wears glasses.
  2. Middle Portrait: The individual is dressed in traditional attire with a headpiece and is adorned with jewelry, including a necklace and earrings.
  3. Right Portrait: The individual is in a military uniform with a peaked cap, also decorated with medals and insignia.

The display appears to be mounted on a structure, possibly for a public event or ceremony. There are a few people visible at the bottom of the image, including a child walking in the foreground. The background shows some trees and buildings, suggesting an urban or semi-urban setting. The overall tone of the image is formal and ceremonial.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph depicting a large, three-panel mural displayed outdoors. The mural features three portraits of individuals, each set against a plain background. The individual on the left is dressed in formal attire with a sash and medals, suggesting a high-ranking figure or a monarch. The individual in the center is also formally dressed, wearing a traditional headdress and adorned with a necklace and medals, indicating a person of significant status, possibly a queen or a high-ranking female figure. The individual on the right is dressed in a military-style uniform with a cap and medals, signifying a role in the military or government.

In the foreground, a person is seen standing and looking at the mural. The setting appears to be a public area with bicycles visible in the background, and the backdrop includes trees, suggesting a casual, outdoor environment. The photograph also captures some text at the bottom, indicating it is part of the Harvard University Art Museums' collection.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph features a large public display of three portraits mounted on a wall or banner. The portraits depict three individuals in formal attire, each adorned with medals and decorations, suggesting they may be figures of authority or importance. The individual on the left wears a military-style uniform with epaulets and medals, the person in the middle is dressed in a traditional outfit with a headscarf and medals, and the person on the right is in a white uniform with a cap, possibly a medical or military officer.

In the foreground, a child is standing, seemingly observing the portraits. The background includes some bicycles parked to the left and a structure that appears to be a pavilion or a market area. Trees are visible at the top of the image, indicating that the setting is outdoors. The overall scene suggests a public event or a commemorative display.

Text analysis

Amazon

College
Art
and
Fellows
(Harvard
Museums)
of
University
Harvard
President
© President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4462.0004
©

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4462.0004
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4462.0004