Human Generated Data

Title

Untitled (Tiger Balm Garden, Hong Kong)

Date

March 3, 1960-March 13, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5420

Human Generated Data

Title

Untitled (Tiger Balm Garden, Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5420

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Plant 100
Potted Plant 100
People 100
Face 99.8
Head 99.8
Photography 99.8
Portrait 99.8
Beard 99.7
Person 99.3
Person 99.1
Person 98.9
Adult 98.9
Bride 98.9
Female 98.9
Wedding 98.9
Woman 98.9
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Person 98.5
Clothing 98.2
Hat 98.2
Person 98
Adult 98
Male 98
Man 98
Garden 94.7
Nature 94.7
Outdoors 94.7
Shirt 91.4
Gardening 83.8
Person 77.3
Person 76.1
Flower 74
Flower Arrangement 57.9
Baseball Cap 57.5
Cap 57.5
Musical Instrument 55.9
Flower Bouquet 55.2
Blouse 55.1

Clarifai
created on 2018-05-10

people 99.8
group 99.2
group together 95.8
child 95.7
adult 95.1
woman 94.9
man 94.3
administration 93.5
many 92
boy 88.1
war 86.4
several 85.7
leader 84.5
wear 83.7
music 80
five 79.9
education 79.3
family 78.5
military 78.3
police 76.6

Imagga
created on 2023-10-06

shop 33.7
people 30.7
man 29.6
classroom 26.3
male 25.8
room 24.9
mercantile establishment 22.6
adult 21.7
smiling 21.7
person 21.5
barbershop 21.4
child 20.1
sitting 19.7
family 18.7
boy 18.2
home 17.5
happy 17.5
couple 17.4
business 17
day 16.5
table 16.4
children 16.4
together 15.8
place of business 15.1
businessman 15
hospital 15
father 14.5
30s 14.4
women 14.2
meeting 14.1
color 13.9
men 13.7
bakery 13.5
adults 13.2
indoors 13.2
mature 13
lifestyle 13
education 13
restaurant 12.9
businesswoman 12.7
40s 12.6
team 12.5
businesspeople 12.3
cheerful 12.2
smile 12.1
dad 12.1
group 12.1
indoor 11.9
holding 11.6
mother 11.5
teacher 11.3
clothes 11.2
casual clothing 10.8
colleagues 10.7
looking 10.4
school 10.3
two 10.2
kid 9.7
class 9.6
professional 9.6
talking 9.5
office 9.3
food 9.2
student 9
discussion 8.8
chair 8.7
work 8.7
daytime 8.7
happiness 8.6
teamwork 8.3
camera 8.3
clothing 8.3
parent 8.3
20s 8.2
cafeteria 8.2
new 8.1
to 8
interior 8
working 7.9
life 7.9
building 7.8
days 7.8
portrait 7.8
daughter 7.8
corporate 7.7
four 7.7
casual 7.6
eating 7.6
females 7.6
desk 7.6
togetherness 7.5
friends 7.5
enjoyment 7.5
establishment 7.5
senior 7.5
worker 7.3
confident 7.3
black 7.2
kitchen 7.2
patient 7.1
medical 7.1
dinner 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.8
people 67
group 61.7
crowd 1.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 49-57
Gender Male, 99.3%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 36-44
Gender Female, 100%
Happy 95.6%
Surprised 6.4%
Fear 6%
Sad 2.3%
Calm 2.2%
Angry 0.6%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 6-14
Gender Female, 85.5%
Happy 78.5%
Fear 17%
Surprised 6.5%
Sad 2.3%
Calm 0.9%
Disgusted 0.8%
Confused 0.8%
Angry 0.3%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 98.6%
Surprised 6.4%
Fear 6.1%
Sad 2.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Calm 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Calm 74.7%
Surprised 6.8%
Fear 6.2%
Confused 5.9%
Angry 5.7%
Happy 4.5%
Sad 4%
Disgusted 2.8%

AWS Rekognition

Age 12-20
Gender Male, 56.3%
Happy 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Disgusted 0%
Calm 0%

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Bride
Female
Woman
Male
Man
Person 99.3%
Person 99.1%
Person 98.9%
Person 98.7%
Person 98.5%
Person 98%
Person 77.3%
Person 76.1%
Adult 98.9%
Adult 98.7%
Adult 98%
Bride 98.9%
Female 98.9%
Woman 98.9%
Male 98.7%
Male 98%
Man 98.7%
Man 98%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-02

a photograph of a group of people standing around a group of people -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image shows a group of individuals gathered outdoors near a building with large windows. The surroundings include decorative sculptures and plants, creating a garden-like atmosphere. One person appears to be seated or crouching near the sculptures and foliage, holding an object, while others stand nearby, some dressed casually in sweaters and plaid clothing. The architecture of the building in the background has a clean, classic appearance, with visible pipes and trim details. The scene seems to capture a casual or community moment.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image shows a group of people in an outdoor setting in front of a building. Various individuals are standing and interacting. Some are wearing mid-20th century casual attire, such as button-up shirts and sweaters. There are potted plants and decorative elements in the foreground, and the architecture of the building features windows and visible piping. The scene seems to capture a moment of social gathering or conversation.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image appears to be a black and white photograph depicting a group of people gathered together, likely in a public setting. In the foreground, there is an older man with a long beard wearing traditional clothing. Behind him, there are several other people, including a few women and children, all dressed in clothing typical of the time period. The background shows a building or structure, suggesting this is taking place outdoors, possibly in a courtyard or similar setting. The overall scene conveys a sense of community and interaction among the individuals depicted.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a black and white photograph, likely from several decades ago. The image shows a group of people gathered outside what appears to be a building. In the center of the photo is an elderly man with a long beard wearing traditional Chinese-style clothing and a cap. There are several young women in the photo wearing 1950s or 1960s style clothing, including blouses and casual wear. In the background, there's a man in a light-colored shirt, and a woman wearing sunglasses. The setting appears to have some potted plants or garden elements visible on the left side of the frame. The architectural elements visible suggest this might be taken at an institution or residence. The photo has the characteristic look of mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black and white photograph of a group of people standing in front of a building. The group consists of seven individuals, with two young girls in the foreground, a man with a long beard and a black hat in the center, and four other people behind them.

In the background, there are several potted plants and a large statue of a hand holding a bird. The building behind them has a light-colored facade with windows and a door. The overall atmosphere of the image suggests a casual gathering or event, possibly in a public or community setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a group of people standing outside a building. The group consists of both men and women, with some wearing casual clothing and others dressed in more formal attire. In the foreground, there are two young girls and an older man with a long white beard, who appears to be the central figure in the photo. Behind them, several other individuals can be seen, including a man holding a camera and a woman wearing sunglasses.

The background of the image features a large building with windows and a doorway, as well as some potted plants and a decorative statue. The overall atmosphere of the photo suggests that it was taken during a social gathering or event, possibly in the 1960s or 1970s based on the clothing and hairstyles of the individuals in the photo.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

A black-and-white photo of a group of people standing in front of a building. The people are standing in front of a building with windows. They are all looking in the same direction, and some of them are smiling. The man in the middle is wearing a hat and has a long beard. Behind them are potted plants and a statue. The building has a white wall with a window on the right side.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people standing outside a building. The group consists of five people, with two women standing on the right side, one woman in the middle, and two men on the left side. The woman in the middle is wearing a hat and has a long beard. The man on the left side is holding a camera. The group is standing near a statue and some potted plants.

Google Gemini

Created by gemini-2.0-flash on 2025-05-27

Here is a description of the image:

The black and white photograph depicts a group of people standing in front of a building. To the left, a man is kneeling down near some plants and a sculpted object. He's wearing a light-colored short-sleeved shirt and has a short haircut.

In the center of the frame, a distinguished-looking man with a long beard and a dark cap stands next to a young girl in a white collared shirt. To their right, there are two young women, one wearing a sweater over a light top and the other in a checkered button-up shirt.

In the background, a woman in sunglasses and a light-colored outfit stands further back, slightly blurred. Further in the background on the right, another person stands in what seems to be a doorway or opening, also somewhat blurred.

The building behind them has visible windows, and there are plants in pots in the foreground, adding depth to the scene.

Created by gemini-2.0-flash-lite on 2025-05-27

Here's a description of the image:

Overall Impression: This is a black and white photograph showing a group of people posing outdoors. The image has a vintage feel, suggesting it was taken some time ago.

People:

  • There are at least eight people visible in the image.
  • There's a man with a long beard and a black hat, likely an older man. He is wearing a dark jacket or coat.
  • Next to him stands a young girl with short hair, wearing a collared shirt.
  • On the left side a Caucasian man is crouched.
  • Several women appear to be present. They have different expressions, from smiling to looking at the camera.
  • One of the women is wearing sunglasses.
  • There is a woman in the background.

Setting:

  • The photo appears to be taken outdoors, possibly in a garden or courtyard.
  • There are potted plants and what appears to be a decorative, perhaps sculptural, element in the foreground.
  • A building is visible in the background.
  • There are windows.

Overall: The photo captures a moment in time of a group of people together. The image has a nostalgic quality and possibly commemorates an event or gathering.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black and white photograph depicting a group of people standing outside a building. The group consists of five individuals:

  1. A man with a beard and wearing a hat, positioned in the center of the image. He is standing next to a young girl who is looking up at him.
  2. A young girl standing to the left of the bearded man, smiling and looking up at him.
  3. A man standing behind the bearded man, leaning against the wall with one arm raised, possibly adjusting his glasses or shielding his eyes.
  4. A woman standing in the background, wearing a dress and sunglasses, with her arms crossed.
  5. A young boy standing to the right of the bearded man, wearing a striped shirt and shorts. He is smiling and looking towards the camera.

The setting appears to be a courtyard or garden area with potted plants and a statue visible in the foreground. The building in the background has a light-colored facade with windows and a door. The overall atmosphere of the image seems relaxed and friendly, with most individuals smiling or engaged in conversation.