Human Generated Data

Title

Untitled (men and women imitating statue)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8384

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women imitating statue)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8384

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.9
Apparel 99.9
Human 99.3
Suit 98
Overcoat 98
Coat 98
Sleeve 94.8
Accessories 89.3
Accessory 89.3
Long Sleeve 86.9
Floor 86.6
Tuxedo 85.5
Footwear 82.3
Door 75.6
Female 75.1
Dress 74.5
Flooring 71.2
Chair 71.1
Furniture 71.1
Shirt 69.2
Face 67.8
Portrait 65.2
Photography 65.2
Photo 65.2
Shorts 61.6
Pants 61.4
Woman 59.3

Clarifai
created on 2023-10-25

people 99.8
wear 98.4
adult 96.1
man 95.6
group together 94.6
group 94.2
menswear 94.1
outfit 92.8
dress 86.3
woman 85.2
many 84.7
several 83.6
leader 80.1
music 79.8
monochrome 78.3
coat 76.7
two 75.2
veil 74.9
outerwear 74.6
fashion 74.2

Imagga
created on 2022-01-09

male 35.5
people 31.8
man 31.6
person 31
professional 28.4
doctor 27.3
nurse 24.3
adult 24.2
portrait 23.9
happy 23.2
men 23.2
medical 22.9
hospital 21.3
business 20.7
stethoscope 20.4
uniform 19.2
suit 19.1
health 18.8
job 18.6
women 17.4
standing 17.4
smiling 17.4
medicine 16.7
clothing 16.5
businessman 15.9
smile 15.7
corporate 15.5
office 15.3
work 14.9
couple 14.8
looking 14.4
team 14.3
handsome 14.3
care 14
clinic 13.9
coat 13.7
group 13.7
worker 13.6
attractive 13.3
lifestyle 13
confident 12.7
building 12.2
staff 12.2
fashion 12.1
working 11.5
together 11.4
human 11.2
teamwork 11.1
casual 11
two 11
occupation 11
doctors 10.8
modern 10.5
adults 10.4
day 10.2
happiness 10.2
pretty 9.8
family 9.8
diversity 9.6
mature 9.3
life 9.2
black 9.1
old 9.1
style 8.9
room 8.9
interior 8.8
indoors 8.8
partnership 8.6
ethnic 8.6
model 8.6
garment 8.4
company 8.4
device 8.3
world 8.2
patient 8.2
friendly 8.2
businesswoman 8.2
dress 8.1
lady 8.1
success 8
executive 8
mother 7.8
face 7.8
physician 7.8
40s 7.8
window 7.6
illness 7.6
walking 7.6
practitioner 7.5
holding 7.4
successful 7.3
indoor 7.3
jacket 7.3
bright 7.2
hair 7.1
love 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.4
text 98.3
clothing 92.8
dance 92.1
standing 90.3
man 89.3
wedding dress 85.4
suit 85.2
dress 80.4
bride 78.6
black and white 69.2
posing 66.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 84.5%
Happy 96.7%
Surprised 1.8%
Calm 1.1%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 36-44
Gender Male, 72.9%
Calm 73.6%
Surprised 12.6%
Happy 10.1%
Sad 1.6%
Confused 1.1%
Disgusted 0.5%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 51.5%
Calm 81.3%
Surprised 12.2%
Sad 4.5%
Angry 0.9%
Happy 0.5%
Confused 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99%
Surprised 92.9%
Sad 4.9%
Calm 1.1%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Shoe

Clarifai

No features identified

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 66.7%

AWS Rekognition

Tie 89.3%

AWS Rekognition

Tie 82.1%

AWS Rekognition

Shoe 82.3%

AWS Rekognition

Shoe 79.3%

Categories

Imagga
created on 2022-01-09

streetview architecture 60.1%
paintings art 26.3%
interior objects 12.1%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image is a black-and-white negative depicting a group of five individuals standing indoors near a doorway. The individuals are dressed in mid-20th-century attire, with suits, dresses, and patterned blouses. A rug is partially visible on the wooden floor, and the doorway reveals a glimpse of greenery outside. The setting appears to be within a home or formal environment. Multiple handwritten annotations and numbers, including "12247," are present on the edges of the image.

Created by gpt-4o-2024-08-06 on 2025-06-17

This is a black and white negative image showing five individuals standing in a room with wooden flooring. They appear to be dressed in formal or semi-formal attire, with two of them wearing suits and ties. One person is wearing a polka dot blouse and pants, while another stands in a dress. A man on the right is wearing a pinstripe suit. The interior setting includes wallpapered walls and a patterned rug partially visible on the bottom right. There is a doorway in the background leading to another room, with some foliage visible outside the window. The photo has markings "12247" and "8" drawn on the border.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph depicting a group of people dressed in stylish, formal attire. The group consists of several individuals, both men and women, who are posing together in what seems to be an indoor setting. The individuals are gesturing with their hands and appear to be in a celebratory or festive mood. The overall atmosphere of the image suggests it may be capturing a social or cultural event.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a negative/inverted black and white photograph from what seems to be the mid-20th century. In the image, there are four people standing in what appears to be an interior room with wooden flooring. Two of them are wearing white suits or jackets, while one person is wearing a patterned top. There's also a small decorative statue or figurine visible in the background. The photograph has an interesting visual effect due to being in negative, making the light areas appear dark and vice versa. The people appear to be in a casual, social setting, and their body language suggests they're in a lighthearted or jovial mood. The number "12247" is visible at the bottom of the photograph, suggesting it may be part of a cataloged collection or series.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

The image depicts a black-and-white photograph of four individuals, two men and two women, standing in a room. The photograph has been digitally altered to appear as if it is a negative image, with the subjects and background appearing in white and the shadows in black.

The man on the left is dressed in a light-colored suit, complete with a tie and dress shoes. He has his right hand raised, with his palm facing outward. The woman beside him wears a patterned blouse and pants, and her right hand is also raised. The second woman is attired in a light-colored dress and coat, and her right hand is positioned near her face. The man on the right is dressed in a light-colored suit, complete with a tie and dress shoes, and his right hand is raised, with his palm facing outward.

In the background, there is a doorway with a window above it, as well as a statue of a woman. The floor is made of wood, and there is a rug in the bottom-right corner of the image. The overall atmosphere of the photograph suggests that the individuals are posing for a formal portrait or photograph.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of four people standing in a doorway, with the caption "12247" at the bottom.

The man on the left is wearing a white suit and tie, with his hands outstretched in front of him. The woman next to him has blonde hair and is wearing a patterned blouse and pants. The woman in the middle has blonde hair and is wearing a dress. The man on the right is wearing a white suit jacket and striped pants, with his hands clasped together in front of him.

The background of the image shows a doorway with a window above it, and a rug on the floor. The overall atmosphere of the image suggests that the people are posing for a photo, possibly at a social gathering or event.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-01

The black-and-white photograph shows a group of people standing on a wooden floor, probably in a house. The group consists of four women and two men. The man on the left is wearing a suit, a tie, and leather shoes. The woman on the right is wearing a dress, a bracelet, and leather shoes. The other three women are wearing dresses, and the man on the right is wearing a suit, a tie, and leather shoes.

Created by amazon.nova-lite-v1:0 on 2025-06-01

The image features a monochromatic photograph of several individuals, possibly engaged in a social gathering or performance. The people are dressed in formal attire, including suits and dresses, and some are wearing hats. The image has a surreal quality, with some individuals appearing to be floating or out of focus, creating a dreamlike atmosphere. The setting appears to be indoors, with a large window in the background that allows natural light to illuminate the scene. The photograph has a vintage or old-fashioned feel, with a black-and-white filter and a slightly blurry quality.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression: This is a black and white negative image, which means the light and dark values are inverted. It appears to be a posed photograph of four people, likely taken indoors. The style suggests it might be a portrait or a candid snapshot from the mid-20th century.

People:

  • Group of Four: Two men and two women are the main subjects. They seem to be casually posing or interacting.
  • Clothing: The men are wearing suits. One suit appears to be solid and another has striped pants. The women are in lighter casual outfits. One woman appears to be wearing a dress.
  • Gestures: The people have hands out, in open, welcoming, inviting, gestures.

Setting:

  • Interior: The background is unclear, but it seems to be in a building. The presence of a window, a decorative sculpture, and a patterned rug further suggests an indoor setting.

Technical Details:

  • Negative: The photograph is a negative, evidenced by the color and tone inversion.
  • Format: The image is rectangular, suggesting a print or a frame.
  • Details: The image has the identifier "12247" in the bottom left corner.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

The image is a black and white negative featuring five people posing for a photo. On the left, a man stands in a suit with a hand raised near his chest. Next to him is a woman in a printed top and wide-legged pants, also with a hand raised. Behind them, a statue of a woman is visible.

To the right of the statue, another woman in a suit stands with her hand up, while a man in a suit with striped pants is on the far right. Both of them also have their hands raised. The group is standing on a wooden floor with a rug visible in the bottom right corner. A door with glass windows and a dark frame is in the background. The image has a slightly high contrast and an overall vintage feel. The numbers "12247" are written on the left and bottom of the image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a group of five individuals in what appears to be a theatrical or costume setting. The individuals are dressed in various costumes, and their faces are painted black, suggesting they may be performing in blackface.

Here is a detailed description of each individual from left to right:

  1. The first person is wearing a light-colored suit with a black bow tie. They have their hands raised in a gesture, possibly part of a performance or pose.
  2. The second person is dressed in a patterned outfit, possibly a polka-dotted shirt and pants. They are standing with one hand on their hip.
  3. The third person, standing in the background, is wearing a striped outfit and appears to be observing the others.
  4. The fourth person is dressed in a white coat or lab coat and is wearing white gloves. They are holding their hands up in a gesture similar to the first person.
  5. The fifth person is also wearing a light-colored suit with a black bow tie and white gloves. They are standing with their hands raised in a gesture.

The setting appears to be indoors, with wooden flooring and some furniture visible in the background. The photograph has a vintage feel, and the number "12247" is printed on the bottom left and right corners, possibly indicating a catalog or archive number.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image is a black and white photograph featuring five figures in a domestic setting, possibly a living room, with wooden walls and a window with dark curtains in the background. The figures are dressed in formal attire, with three wearing white suits and two in more casual clothing with floral and pinstripe patterns. The individuals on the left and right sides are standing upright, while the three in the middle appear to be levitating or suspended in mid-air, creating a surreal and whimsical effect. The scene has a playful and artistic quality, evoking a sense of magic or fantasy. The floor is wooden, and a small rug is visible in the lower-right corner. The overall composition and attire suggest a staged or conceptual photograph, possibly for a fashion or artistic project.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white image features four individuals, all seemingly suspended in mid-air, giving the impression that they are floating. They are dressed in formal attire, with two men wearing white suits and ties, one woman in a polka-dotted blouse and pants, and another woman in a light-colored dress. The background shows a room with wooden floors, a patterned rug, and a window with curtains. The image has a surreal quality, likely due to the floating effect and the expressions on the faces of the individuals. There is also a statue of a woman in the background, further adding to the whimsical nature of the scene. The numbers "12247" and "8" are visible in the image.

Text analysis

Amazon

12247.
H
8

Google

12247. 12247.
12247.