Human Generated Data

Title

Untitled (two men and a woman standing in front of a painting in a museum)

Date

1969

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11315

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men and a woman standing in front of a painting in a museum)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11315

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99
Clothing 98.2
Apparel 98.2
Indoors 81.3
Interior Design 80.1
Coat 72.8
Sleeve 68.9
Room 67.8
Art 65.1
Long Sleeve 62.9
Suit 58.3
Overcoat 58.3
Hair 57.9
Furniture 57.5

Clarifai
created on 2023-10-25

people 99.5
woman 98.3
adult 98.3
man 95.7
group 95.6
elderly 95.2
education 94.8
indoors 93.2
teacher 92.7
monochrome 92.7
science 87
medical practitioner 85.7
chair 79.8
leader 79.6
sit 78.7
room 76.1
looking 75.8
furniture 75.5
three 75.4
family 72.9

Imagga
created on 2022-01-09

man 39.7
laptop 37.5
person 37
male 35.5
adult 34.2
teacher 33.8
computer 33.7
office 33.5
businessman 30.9
people 30.7
business 28.6
professional 28.2
executive 25.9
desk 24.6
smiling 23.9
indoors 22.9
senior 22.5
educator 22.4
home 22.3
happy 21.9
sitting 21.5
working 21.2
corporate 19.8
work 19.6
mature 17.7
indoor 17.4
businesswoman 17.3
businesspeople 17.1
education 16.5
room 16.1
looking 16
blackboard 15.8
portrait 15.5
smile 14.3
horizontal 14.2
corporation 13.5
elderly 13.4
meeting 13.2
men 12.9
casual 12.7
colleagues 12.6
retired 12.6
retirement 12.5
handsome 12.5
table 12.1
student 12
communication 11.8
face 11.4
career 11.4
old 11.2
technology 11.1
color 11.1
20s 11
happiness 11
clothing 10.6
modern 10.5
group 10.5
couple 10.5
two 10.2
suit 9.9
classroom 9.7
notebook 9.6
30s 9.6
tie 9.5
adults 9.5
lifestyle 9.4
manager 9.3
document 9.2
worker 9
team 9
one 9
patient 8.8
businessmen 8.8
talking 8.6
teamwork 8.3
camera 8.3
inside 8.3
occupation 8.3
board 8.1
cheerful 8.1
school 8.1
job 8
women 7.9
together 7.9
associates 7.9
bright 7.9
day 7.8
living room 7.8
60s 7.8
40s 7.8
mid adult 7.7
health 7.6
shirt 7.6
keyboard 7.5
human 7.5
clothes 7.5
world 7.5
jacket 7.4
nurse 7.2
family 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

drawing 98
cartoon 96.1
text 95.5
person 95
clothing 93.5
man 92.4
painting 91
standing 90.2
sketch 73.4
art 59.2
picture frame 51.2
posing 49.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Female, 90.7%
Calm 53.9%
Happy 20%
Surprised 11.2%
Sad 5%
Angry 3.8%
Disgusted 2.8%
Confused 1.8%
Fear 1.4%

AWS Rekognition

Age 45-51
Gender Female, 59.2%
Fear 54.2%
Calm 26.2%
Surprised 9.9%
Disgusted 2.4%
Happy 2.2%
Angry 2.1%
Sad 2%
Confused 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Clothing
Picture frame
Human face
Human arm

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 97.6%

Clarifai

Clothing 87.8%

Clarifai

Clothing 82%

Clarifai

Clothing 77.6%

Clarifai

Clothing 68.7%

Clarifai

Picture frame 52.2%

Clarifai

Human face 46.6%

Clarifai

Human face 45.1%

Clarifai

Human face 44.2%

Clarifai

Human face 43.5%

Clarifai

Human arm 35%

Categories

Imagga
created on 2022-01-09

people portraits 77.7%
paintings art 13%
events parties 3.8%
food drinks 3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

painting artist and his wife with a painting of a woman.

Salesforce

Created by general-english-image-caption-blip on 2025-05-02

a photograph of a priest and a priest in a church

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image depicts a negative photograph of three individuals in what appears to be an art gallery or exhibition space. Two of the individuals stand near a framed painting that seems to feature a portrait or abstract human figure. The setting includes dark walls, a staircase visible on the left, and additional framed artwork in the background. The attire of the figures suggests a formal or semi-formal environment.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image appears to be a negative photograph showing three individuals standing in an art gallery or similar setting. The individual on the left is wearing a patterned jacket, while the individual in the center is wearing a light-colored suit with a bow tie and glasses. They are all looking at a large framed painting on the wall, which is a portrait of a person. The image has a number "5757" written on the top and is inverted in color, typical of a photographic negative. The setting includes a staircase on the left side and a smaller frame visible on the right wall.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows three older individuals, two men and one woman, standing in front of a framed painting. The painting appears to be an abstract or expressionist work with a figure or face depicted in a stylized manner. The individuals are dressed formally, with the men wearing suits and the woman wearing a light-colored coat. They seem to be examining or discussing the painting. The overall scene suggests an art gallery or museum setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a black and white photograph showing several people standing in what looks like an art gallery or exhibition space. There's a framed artwork visible on the wall behind them. The image has an interesting negative or inverted quality to it, making the figures appear almost ghost-like or ethereal. The subjects are dressed in what appears to be formal attire, with at least one person wearing what looks like a tie. The lighting creates strong contrasts between light and dark areas in the photograph, giving it a dramatic quality. The composition suggests this might be documentation of an art opening or gallery event.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black and white photograph of three people standing in front of a painting. The painting is in a decorative frame and depicts a woman with long hair and a flowing dress. The woman appears to be holding a bird or a small animal in her hands.

The three people are standing in a room with dark walls. The person on the left is wearing a long dress and has short white hair. The person in the middle is wearing a white suit jacket, a black shirt, and a tie. The person on the right is wearing a dark jacket with a patch on the left side and white pants. All three people are looking at the painting.

There is a table in front of the painting with some papers or books on it. The overall atmosphere of the image suggests that the three people are admiring the artwork together.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a black and white photograph of three individuals standing in front of a painting. The person on the left is a woman with short hair, wearing a long coat or dress. The man in the middle has short hair and is dressed in a white suit jacket, black shirt, and tie. The individual on the right is a man with short hair, wearing a dark jacket with a logo on the left side of his chest and white pants.

In the background, there is a dark-colored wall with a painting hanging on it. The painting appears to be an abstract piece featuring a figure. To the right of the main painting, another piece of artwork can be seen, although it is not clearly visible. On the left side of the image, a staircase is partially visible.

The overall atmosphere of the image suggests that the individuals are attending an art exhibition or gallery event.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image shows a black-and-white photograph of three people standing in front of a wall with a painting. The painting depicts a man wearing a crown of thorns, possibly representing Jesus Christ. The man on the left is wearing a coat and eyeglasses, while the man in the middle is wearing a suit and tie. The man on the right is wearing a jacket and has a beard. There is a book on the desk in front of them.

Created by amazon.nova-pro-v1:0 on 2025-06-04

A black-and-white photo of three people standing in front of a wall with a painting. The man in the middle is wearing glasses, a tie, and a belt. He is looking at the man on his right, who is wearing a jacket. The woman on the left is wearing a shawl. There is a book on the table in front of them. There is a staircase on the left side.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

A black-and-white negative depicts three individuals standing in what appears to be an art gallery. The image has been inverted, making light areas dark and vice versa.

To the left is a woman with short hair, wearing a patterned garment that drapes over her shoulders. Next to her is a man wearing glasses, a light-colored suit jacket, a dark tie, and pants. His left hand is on his hip. To the right is another man with a white beard and a dark blazer with a white emblem on the pocket. He is looking to the left.

Behind the group is a framed painting of a figure, possibly religious, with a crown. A table with a book on top is visible in the foreground. Part of a window is seen on the left, and another framed artwork is visible on the right.

The negative also has handwritten markings at the top, reading "57527."

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression:

The image appears to be a negative of a photograph. It shows three people in what looks like a gallery or a room with artwork. The scene is somewhat formal, with the individuals likely observing or discussing the art.

People and their Appearance:

  • Three Individuals: There are three people visible. They appear to be older.
  • Attire: The man in the center is wearing a white suit, a black shirt, and a tie. The woman on the left has a coat on. The man on the right is wearing a suit jacket and is wearing white pants.
  • Facial Features: All three individuals have visible facial features.

Setting and Objects:

  • Artwork: A large framed painting dominates the central part of the image. It depicts a figure, possibly a religious figure. A smaller framed painting is on the right.
  • Gallery/Room: The background is a dark color, indicating it might be a wall. There are light-colored rectangular shapes (possibly windows) on the left side, and a small table on the bottom.

Composition:

  • The composition seems balanced, with the three figures arranged around the central artwork.
  • The lighting (or negative reversal of it) makes the details of the painting and the people quite visible.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph featuring three individuals standing in front of a framed artwork. The artwork appears to be an abstract painting with a mix of light and dark areas, creating a somewhat ghostly or ethereal effect.

  1. Individuals:

    • The person on the left is wearing what appears to be a robe or a cloak, which could indicate a religious or ceremonial role.
    • The person in the middle is dressed in a suit with a tie, holding the frame of the painting. This person seems to be in a more formal or professional attire.
    • The person on the right is wearing a jacket with a badge or emblem on it, which might suggest membership in a club or organization.
  2. Setting:

    • The setting appears to be indoors, possibly in a gallery, museum, or a similar venue. The background is relatively plain, with a wall and a window visible on the left side.
    • There is a small table or stand in front of the painting, which holds what looks like a book or a catalog, possibly related to the artwork.
  3. Painting:

    • The painting itself is abstract and has a somewhat surreal quality, with blurred and indistinct forms. It is framed in an ornate frame, which adds to its prominence in the image.

The overall mood of the photograph suggests a formal or ceremonial event related to the display or unveiling of the artwork. The attire of the individuals and the setting indicate a sense of importance or reverence toward the painting.

Qwen

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This black-and-white photograph captures a scene in what appears to be an art gallery or exhibition space. Three individuals are present in the image, standing in front of a framed abstract painting.

  1. On the left, a woman is wearing a patterned shawl over her shoulders and appears to be holding a small object in her left hand.
  2. In the center, a man in a white suit with a tie is gesturing towards the painting, possibly explaining or discussing it.
  3. On the right, another man with a beard and wearing a jacket over a light-colored outfit stands with his hands in his pockets, looking towards the painting.

The painting itself is abstract, with a central dark form that could be interpreted as a face or a mask. The wall is dark, and there is a window with vertical blinds on the left side of the image. A table in the foreground has some items on it, including a book or catalog with a picture on the cover. The image has a vintage quality, suggesting it might be from an earlier time period.

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

The image is a black and white photograph depicting three individuals standing in front of a large framed artwork. The central figure appears to be presenting or explaining the artwork to the other two individuals. The artwork itself is abstract, featuring a large, dark central form with lighter surrounding areas and intricate details around the edges of the frame. The individuals are dressed in formal and semi-formal attire. The setting appears to be an art gallery or exhibition space, as suggested by the modern, clean interior and the wall-mounted outlet visible in the lower part of the image. The photograph has a vintage feel, possibly from the mid-20th century, indicated by the style of clothing and the photo framing.

Text analysis

Amazon

57527.
NAGON
..

Google

ee
ee