Human Generated Data

Title

Russian Ball, New York City

Date

November 1976

People

Artist: Larry Fink, American 1941 - 2023

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, P2004.37

Copyright

© Larry Fink

Human Generated Data

Title

Russian Ball, New York City

People

Artist: Larry Fink, American 1941 - 2023

Date

November 1976

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, P2004.37

Copyright

© Larry Fink

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.6
Plant 99.5
Flower Bouquet 98.7
Flower 98.7
Flower Arrangement 98.7
Blossom 98.7
Clothing 91.2
Coat 91.2
Overcoat 91.2
Apparel 91.2
Accessories 74.7
Accessory 74.7
Finger 60.8
Interior Design 58
Indoors 58

Clarifai
created on 2023-10-26

people 99.9
groom 99.5
wedding 99.5
group 99
portrait 98.8
woman 98.5
adult 97.9
man 97.4
bride 96.6
monochrome 96.1
dress 95.9
two 95.4
child 94.7
three 93.3
wear 92.1
family 91.7
dinner jacket 90
ceremony 89.8
outfit 89.7
love 89.2

Imagga
created on 2022-01-09

man 37
male 32.7
people 31.2
adult 29.6
person 29.5
business 28.5
bow tie 26.7
couple 25.3
kin 24.5
office 23.4
happy 20.7
businessman 20.3
businesswoman 19.1
necktie 19
suit 17.4
happiness 17.2
smile 17.1
professional 16.7
women 16.6
love 16.6
men 16.3
attractive 15.4
groom 15.2
portrait 14.9
cheerful 14.6
corporate 14.6
smiling 14.5
world 14.2
room 14.2
executive 14.1
manager 14
two 13.6
work 13.3
businesspeople 13.3
indoors 13.2
group 12.9
sitting 12.9
indoor 12.8
pretty 11.9
bride 11.7
lifestyle 11.6
holding 11.6
bartender 11.4
black 11.2
home 11.2
worker 11
dress 10.8
lady 10.5
tie 10.4
computer 10.4
communication 10.1
confident 10
clothing 10
romance 9.8
modern 9.8
garment 9.8
romantic 9.8
family 9.8
interior 9.7
job 9.7
planner 9.7
success 9.7
looking 9.6
standing 9.6
spectator 9.5
females 9.5
laptop 9.1
team 9
working 8.8
colleagues 8.7
brunette 8.7
workplace 8.6
marriage 8.5
desk 8.5
bouquet 8.5
meeting 8.5
life 8.3
fashion 8.3
wedding 8.3
sexy 8
together 7.9
day 7.8
table 7.8
busy 7.7
30s 7.7
expression 7.7
married 7.7
four 7.7
youth 7.7
drinking 7.7
casual 7.6
talking 7.6
career 7.6
drink 7.5
fun 7.5
style 7.4
20s 7.3
alone 7.3
girls 7.3
handsome 7.1
night 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.6
wall 97.9
clothing 96.5
man 95.2
standing 92.9
text 85.5
woman 75.2
posing 69.3
dress 69.2
suit 62.4
black and white 62
people 59.2
human face 58.6
wedding dress 55.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Male, 99.4%
Calm 86.7%
Sad 7.9%
Angry 3.4%
Confused 0.7%
Surprised 0.5%
Fear 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 36-44
Gender Female, 86.4%
Angry 79%
Fear 15.8%
Happy 4.6%
Surprised 0.3%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Calm 0.1%

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Tie

Clarifai

No features identified

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 95%

AWS Rekognition

Suit 91.2%

AWS Rekognition

Tie 74.7%

Categories

Imagga
created on 2022-01-09

paintings art 61.5%
people portraits 19.5%
pets animals 11.9%
nature landscape 2.9%
streetview architecture 1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man and woman standing in front of a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image shows a scene with three figures engaging in what appears to be a social gathering or interaction in a dimly lit setting. There is a decorated table with a floral centerpiece in the foreground, and one of the individuals is standing close to it. The clothing suggests a formal or semi-formal event, as two figures are dressed in elegant attire including a suit and a shiny dress. Additionally, the background includes a framed artwork depicting a maritime scene with boats on water, which adds a classic and refined aesthetic to the environment.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a black and white photograph featuring three individuals standing indoors, likely at a social gathering. One person is wearing a floral-patterned dress with short sleeves, while another person is dressed in a shiny, pleated skirt and a sleeveless top. The third individual is wearing a formal suit with a pocket square. In the foreground, there is a table adorned with a centerpiece of flowers. A large framed painting depicting a maritime scene, with a sailing ship and tumultuous waves, is visible on the wall in the background.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph depicting a formal social event, possibly a wedding or formal party. The image shows three individuals - two women and one man. One of the women is wearing a long, pleated dress and the other is wearing a floral dress. The man is wearing a tuxedo. They appear to be standing in a room with a framed painting or artwork on the wall behind them. There is also a bouquet of flowers visible on a table in the foreground. The overall scene suggests a formal, celebratory occasion.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from a formal event or gathering, likely from the 1950s or 1960s based on the style of clothing. In the image, there are three people engaged in conversation. One person is wearing a floral patterned dress, another is in a dark sleeveless dress with a pleated skirt and brooch, and a tall figure in a dark suit and bow tie stands to the right. There's a framed painting of what appears to be a seascape visible on the wall behind them, and in the foreground, there's a table with a floral arrangement of what looks like chrysanthemums or similar flowers. The lighting creates dramatic shadows in the room, giving the photograph a classic, documentary-style feel.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of three people in a room. The woman on the left has her back to the camera and is wearing a dress with a floral pattern. The woman in the middle is standing with her arms crossed, wearing a sleeveless dress with vertical stripes. The man on the right is wearing a tuxedo and has his hands by his sides.

The background of the image shows a wall with a painting hanging on it. There is also a table with flowers and a candle on it. The overall atmosphere of the image suggests that the people are at a formal event or gathering.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

This image is a black-and-white photograph of three people standing in a dimly lit room. The woman on the left has her back to the camera, wearing a dress with a floral pattern and a dark belt around her waist. She has blonde hair styled in an updo.

In the center of the image, a woman stands facing the man on the right. She wears a sleeveless dress with a high neckline and a brooch on her chest. Her short hair is styled in a bob.

The man on the right is dressed in a tuxedo, complete with a bow tie and a white pocket square. He has dark hair and stands tall, looking at the woman in the center.

In the foreground, a table is visible, adorned with a floral centerpiece and some papers or documents. The background of the image features a wall with a framed picture hanging on it, although the details are difficult to discern due to the low lighting.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-01

A black-and-white photo features three people standing in a room. Two women are standing close to each other, and a man is standing on the right side. The woman on the left is looking at the woman in the middle, who is smiling and looking at the man. Behind them is a picture frame on the wall. A table with a flower vase and a book is placed in front of them.

Created by amazon.nova-lite-v1:0 on 2025-06-01

In a black-and-white photo, three people are standing in a room. A man is standing in front of a table with a flower arrangement. A woman is standing behind him, looking at him. Another woman is standing in front of him, looking at the woman behind him. A picture frame is mounted on the wall behind them. The room is dimly lit.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression:

The image is a black and white photograph of a group of three people, likely taken in an interior setting. The composition has a somewhat formal feel, with the subjects dressed in attire that suggests a special occasion. The lighting creates a sense of depth and mood.

Details:

  • People: There are three primary figures:
    • A woman with blonde hair, seen from the back, wearing a floral-print dress with a defined waist. She is turned towards the other two people.
    • A woman with short hair, wearing a dress, with her arms crossed. She is smiling and looking at the blonde woman.
    • A man in a dark suit with a bow tie, standing to the right, slightly turned toward the other two.
  • Setting: The scene appears to be indoors, possibly at a formal event or in a dining room. A table with a flower arrangement and possibly a candle is in the foreground. A painting hangs on the wall in the background.
  • Composition: The composition creates a sense of interaction between the individuals. The man is looking toward the two women.
  • Style: The style of the photograph suggests a vintage quality. The dark background and contrasted lighting give the image a dramatic effect.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

This is a black and white photograph of three people standing around a table. The photograph is framed in a white border, making it appear like a vintage or Polaroid-style print. The scene is lit dramatically, with parts of the background fading into shadow.

On the left, a woman with light hair is seen from behind. She wears a dress with a floral pattern, a belt, and a ruffled hem. She is turned towards the other two people, as if engaged in conversation.

In the center stands another woman, facing forward with her arms crossed. She has short hair and wears a dress with vertical stripes. A small floral corsage is pinned to her chest. She is looking slightly towards the person on the left.

To the right, a man is standing in a dark suit with a bow tie, suggesting a formal event. He is looking slightly towards the woman in the floral dress.

In the foreground, a table is partially visible, covered with a light-colored cloth. A bouquet of flowers sits at the center of the table.

The background is dark, with a painting of a seascape hanging on the wall. The light source appears to be from the left, casting shadows on the wall behind the subjects.

The overall impression is that of a candid moment captured at a formal or semi-formal gathering. The composition, lighting, and black and white tones give the image a classic and somewhat nostalgic feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The black and white photograph captures a social scene involving three individuals. The setting appears to be an indoor event, possibly a formal gathering or party, indicated by the attire and the presence of a table with a floral centerpiece.

  1. People:

    • Left Person: A woman with her back to the camera, wearing a floral-patterned dress with short sleeves. Her hair is styled in a short, wavy cut.
    • Center Person: A woman facing the camera, dressed in a sleeveless black dress with a pleated skirt. She is wearing a necklace and has a short hairstyle. Her expression appears to be one of surprise or excitement.
    • Right Person: A man dressed in a formal suit with a bow tie. He is standing with his hands in his pockets, looking towards the center woman with a neutral expression.
  2. Setting:

    • The background includes a framed painting or photograph on the wall, contributing to the formal ambiance.
    • A round table with a white tablecloth is in the foreground, adorned with a floral centerpiece and a single lit candle.
    • The lighting suggests an intimate, possibly evening event, with shadows casting a dramatic effect.
  3. Atmosphere:

    • The overall mood of the photograph seems lively and engaging, with the center woman's animated expression adding a dynamic element to the scene.
    • The formal attire and setting indicate a special occasion or celebration.

This image effectively captures a moment of interaction and celebration among the three individuals in a formal setting.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

This is a black-and-white photograph featuring three people in what appears to be a formal or semi-formal setting, possibly a wedding reception or a similar event. The image captures a moment where a man in a dark suit and bow tie is standing to the right, smiling and looking towards a woman in the center. The woman in the center, dressed in a black sleeveless dress with a floral pattern on the shoulder, is engaged in conversation with another person standing to her left, who is wearing a floral-patterned dress with puffed sleeves and a belt. The background includes a framed painting on the wall, adding to the formal ambiance. A table with a floral centerpiece is partially visible in the foreground, suggesting a dining or reception area. The overall style of the clothing and the setting suggests a mid-20th-century event.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This black-and-white photograph captures a formal or semi-formal gathering, likely from the mid-20th century based on the fashion and decor. The scene is indoors, with three individuals engaged in conversation near a table adorned with flowers.

  1. Individuals:

    • Left: A woman with long, wavy hair is wearing a light-colored dress with a floral pattern and a belt. She is turned slightly away from the camera, looking towards the other two individuals.
    • Center: Another woman with short, curled hair is dressed in a sleeveless dark top and a striped skirt. She is smiling and appears to be the focus of the conversation.
    • Right: A man in a dark suit and bow tie is leaning slightly forward, engaged in the conversation. His posture suggests attentiveness or amusement.
  2. Background:

    • A large framed painting hangs on the wall behind the individuals, depicting a seascape with ships. The painting adds to the formal and possibly sophisticated atmosphere of the setting.
    • The room has a neutral-colored wall and a chair is visible in the background, partially obscured by the man.
  3. Foreground:

    • A table in the foreground is covered with a tablecloth and has a centerpiece of flowers, adding to the decorative and formal nature of the event.

The overall composition suggests a social gathering or event where the individuals are comfortably interacting in a refined setting.