Human Generated Data

Title

Untitled (three men and a woman under large umbrella)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8380

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three men and a woman under large umbrella)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8380

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.9
Apparel 99.9
Person 98.6
Human 98.6
Person 98.5
Person 98.4
Person 94.7
Person 90.1
Hat 89.7
Helmet 87.4
Face 85.8
Shirt 80.8
Female 78.8
Suit 77.8
Coat 77.8
Overcoat 77.8
Tie 77
Accessories 77
Accessory 77
Guitar 76.2
Musical Instrument 76.2
Leisure Activities 76.2
Sailor Suit 75.8
Portrait 74.8
Photography 74.8
Photo 74.8
Icing 74.5
Food 74.5
Dessert 74.5
Cake 74.5
Cream 74.5
Creme 74.5
Finger 74.4
Head 66.5
Suit 65.8
Wedding 65.8
Gown 64.9
Fashion 64.9
Robe 64.7
Sleeve 63.3
Canopy 60.8
Girl 60.3
Flower 59
Plant 59
Blossom 59
Bridegroom 57.8
Wedding Gown 57.8
Woman 57.8
Man 56.9

Clarifai
created on 2023-10-25

people 99.8
man 98.6
group 96.7
adult 96.3
monochrome 95.2
group together 92.1
music 91.3
two 88.8
veil 88.6
leader 87.2
three 86.8
wear 82.6
musician 81.6
woman 80.3
street 79.6
portrait 77.4
singer 76.9
lid 76.7
ceremony 75.5
administration 74.8

Imagga
created on 2022-01-09

surgeon 66.2
man 31.6
person 30.9
people 25.1
medical 23.8
nurse 23.6
coat 23.6
mask 23
male 22
lab coat 20.2
adult 18.8
doctor 17.9
professional 17.8
medicine 17.6
laboratory 17.4
portrait 16.8
scientist 16.6
worker 16
black 15.6
lab 15.5
chemistry 15.5
research 15.2
astronaut 15.2
science 15.1
clothing 14.8
hospital 14.2
biology 14.2
work 14.1
health 13.9
human 13.5
chemical 12.5
clinic 12.5
face 12.1
happy 11.9
attractive 11.2
student 11.2
men 11.2
equipment 10.7
scientific 10.7
studio 10.6
development 10.5
expression 10.2
smile 10
care 9.9
working 9.7
assistant 9.7
technology 9.7
serious 9.5
instrument 9.3
emotion 9.2
occupation 9.2
hand 9.1
pretty 9.1
danger 9.1
team 9
garment 8.8
looking 8.8
test 8.7
exam 8.6
uniform 8.6
business 8.5
study 8.4
umbrella 8.3
lady 8.1
suit 8.1
specialist 8
investigation 7.9
happiness 7.8
surgery 7.8
ruler 7.8
analysis 7.8
education 7.8
eyes 7.7
disguise 7.7
white 7.7
industry 7.7
profession 7.7
illness 7.6
sword 7.6
fun 7.5
covering 7.5
holding 7.4
patient 7.4
teenager 7.3
protection 7.3
color 7.2
lifestyle 7.2
women 7.1
businessman 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 95.3
black and white 86.4
person 84.7
man 65.6
clothing 60.4
human face 53.8
street 53
accessory 30.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Surprised 70.8%
Happy 19.4%
Calm 3.6%
Fear 2.5%
Sad 1.1%
Confused 0.9%
Disgusted 0.9%
Angry 0.8%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 51.8%
Sad 27.8%
Happy 7.1%
Confused 6.8%
Surprised 2.5%
Disgusted 2.1%
Angry 1%
Fear 0.9%

AWS Rekognition

Age 35-43
Gender Female, 97%
Happy 95.3%
Surprised 3.3%
Calm 0.6%
Sad 0.4%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat
Helmet
Suit
Tie
Guitar
Person 98.6%
Person 98.5%
Person 98.4%
Person 94.7%
Person 90.1%
Hat 89.7%
Helmet 87.4%
Suit 77.8%
Suit 65.8%
Tie 77%
Guitar 76.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of men in white suits and hats -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image appears to be a black-and-white negative photograph depicting a group of individuals dressed in formal attire. The person in the center is wearing an elaborate hat and holding flowers, and someone else is holding an umbrella over them, likely to provide shade. The composition suggests an elegant outdoor event or gathering, possibly during a sunny day as indicated by the use of the umbrella.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a black and white negative photograph showing a group of people dressed in formal attire. One of the individuals holds an umbrella over the group, which suggests they may be outside on a sunny day. The individuals are wearing suits with ties, and at least one of them appears to have a flower pinned to their lapel, which indicates a special occasion. Another individual is dressed in a detailed outfit with a large decorative hat and holds flowers, suggesting a sense of celebration or ceremony. The scene appears to be a candid moment of social interaction among the group.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of four people standing together in what appears to be a formal or ceremonial setting. They are all wearing white clothing and holding umbrellas, suggesting it may be a wedding or other special occasion. The individuals have friendly, smiling expressions on their faces, indicating they are enjoying the moment together. The image has a vintage, black and white aesthetic, giving it a historical feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a vintage black and white photograph showing a group of people dressed in formal white attire. One person is wearing an elegant white dress and a decorative hat with feathers or flowers. The others are wearing white suits with dark ties. Someone is holding a white umbrella above the group. The image has a formal, possibly celebratory atmosphere, and based on the clothing styles and photographic quality, it appears to be from an earlier era, possibly the 1930s or 1940s. The photo has numbers written at the top (12263) suggesting it may be from an archive or collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a group of people in formal attire, with one person holding an umbrella.

The group consists of four individuals, all dressed in formal clothing. The man on the left wears a white suit and hat, while the woman in the center has a white dress and hat adorned with flowers. The man to her right also wears a white suit, and the man on the far right is dressed in a light-colored suit. The woman holds a bouquet of flowers in her left hand, and the man to her right holds an open umbrella above her head.

In the background, trees are visible, suggesting that the photo was taken outdoors. The overall atmosphere of the image is one of elegance and sophistication, with the formal attire and the umbrella creating a sense of refinement and luxury.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is a black-and-white photograph of four individuals, with the central figure being a woman adorned in a white hat and coat, holding an umbrella. The three men surrounding her are dressed in suits and ties, with one of them grasping the umbrella handle. The background features trees and a clear sky, suggesting a daytime setting. The overall atmosphere appears to be one of elegance and sophistication, with the subjects exuding refinement and poise.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph featuring a group of men dressed in formal attire. The central figure is a man wearing a white suit, a hat, and holding an umbrella. To his left, another man is wearing a white suit and a white hat, with a white feather on his head. To the right, there are two men in white suits, one of whom is holding the umbrella. The photograph appears to be from the early 1900s, as indicated by the clothing and the style of the image. The image has a watermark in the top left corner with the number "12263."

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white image shows four people standing in an outdoor area. Three of them are wearing suits, and one is wearing a white fur coat. The person on the left is holding an umbrella, and the person next to him is holding a hat. The person in the center is smiling, and the person on the right is looking at the person in the center. Behind them are trees and plants.

Google Gemini

Created by gemini-2.0-flash on 2025-05-09

Here is a description of the image:

The image is a black and white negative of a group of people under an umbrella. The group consists of at least five individuals, all seemingly dressed in formal attire.

In the center, there is a woman wearing a decorative hat, potentially with feathers. She is wrapped in what appears to be a fur stole or similar garment. Next to her is a man in a suit and hat, smiling towards the camera.

An umbrella is held above the group by another man, also in a suit, who is positioned to the right of the woman. To his right, another man, also in a suit and smiling, is standing.

The negative state of the image means the tonal values are inverted, with areas that would normally appear light being dark and vice versa. This gives the photograph an unusual, stark appearance. The number "12263" is visible in the upper and left side of the image.

Created by gemini-2.0-flash-lite on 2025-05-09

Here's a description of the image:

This appears to be a negative image, showcasing a group of five people in what seems like a social or formal setting. They are all dressed up.

Here's a breakdown:

  • People: The main focus is on the central group. There are four men, all wearing suits. One man, positioned in the center, is holding an umbrella overhead. Also in the center of the photo is a woman with an ornate hat. The people are smiling or have neutral expressions.
  • Clothing: The men are in white suits. The woman has a decorative hat with feathers.
  • Setting: The background hints at an outdoor environment, possibly a garden or park, with some foliage visible.
  • Lighting/Style: The photo is a negative, so the colors are reversed. The composition suggests a posed photograph, likely taken in the early to mid-20th century.
  • Additional details: The corner of the image displays the number "12263."

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a group of five individuals, all of whom appear to be wearing blackface. The group consists of four men and one woman. They are dressed in formal attire, with the men wearing suits and the woman in a fur coat and a hat adorned with feathers. One of the men is holding an umbrella. The individuals are smiling and seem to be enjoying themselves, possibly at a social event or gathering. The background shows some trees and a bright sky, suggesting it might be an outdoor event. The photograph appears to be from an earlier era, as indicated by the style of clothing and the use of blackface, which is now widely recognized as offensive and racist.

Text analysis

Amazon

12263.
6

Google

12263. 12263.
12263.