Human Generated Data

Title

Untitled (family portrait: parents and son in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16534

Human Generated Data

Title

Untitled (family portrait: parents and son in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16534

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Human 99.4
Furniture 99.1
Clothing 92.8
Apparel 92.8
Clinic 80.4
Suit 73.3
Coat 73.3
Overcoat 73.3
Room 69.4
Indoors 69.4
People 68.9
Flower 67.7
Blossom 67.7
Plant 67.7
Flooring 65
Portrait 64.1
Face 64.1
Photography 64.1
Photo 64.1
LCD Screen 61.2
Electronics 61.2
Screen 61.2
Monitor 61.2
Display 61.2
Sitting 60.5
Stage 59.6
Female 57.2
Flower Arrangement 56.3
Shelf 55.5

Clarifai
created on 2023-10-29

people 99.9
group 98.7
adult 98.5
man 98.1
woman 94.4
furniture 93.9
chair 93.7
group together 91.8
monochrome 90.9
leader 88.7
sit 88.1
interaction 87.5
indoors 87.5
sitting 87.4
three 87.3
medical practitioner 87.3
actor 87.1
education 84.3
room 82.9
two 79.1

Imagga
created on 2022-02-12

person 55.3
teacher 49.5
man 40.3
professional 39.1
adult 39
people 36.8
educator 35.9
male 35.5
patient 32.1
room 29.1
smiling 28.2
women 26.9
happy 25.1
business 24.9
businessman 24.7
home 23.9
meeting 22.6
men 22.3
indoors 22
office 21.7
lifestyle 21.7
case 21.4
together 21
businesswoman 20.9
sick person 20.8
group 20.2
nurse 19.8
sitting 19.8
executive 18.8
smile 18.5
portrait 17.5
table 17.3
corporate 17.2
talking 17.1
cheerful 17.1
team 17
desk 17
couple 16.6
work 16.5
happiness 16.5
life 16.2
businesspeople 16.1
teamwork 15.8
worker 14.4
job 14.2
mature 14
colleagues 13.6
casual 13.6
modern 13.3
interior 13.3
working 13.3
indoor 12.8
laptop 12.8
communication 12.6
house 12.5
manager 12.1
two 11.9
kin 11.8
40s 11.7
family 11.6
holding 11.6
mother 11.1
20s 11
suit 10.9
new 10.5
health 10.4
computer 10.4
senior 10.3
classroom 9.9
hospital 9.9
associates 9.8
casual clothing 9.8
30s 9.6
togetherness 9.4
ideas 9.4
chair 9.2
successful 9.2
board 9
dancer 8.9
conference 8.8
full length 8.7
cooperation 8.7
boss 8.6
loving 8.6
face 8.5
adults 8.5
enjoyment 8.5
attractive 8.4
presentation 8.4
color 8.4
grandfather 8.3
phone 8.3
care 8.2
student 8.2
lady 8.1
success 8.1
looking 8
coworkers 7.9
boy 7.8
discussion 7.8
pretty 7.7
four 7.7
father 7.7
comfortable 7.6
performer 7.6
ethnic 7.6
fun 7.5
holiday 7.2
day 7.1
medical 7.1

Google
created on 2022-02-12

Microsoft
created on 2022-02-12

text 99.6
wall 95.2
person 81.9
furniture 75.8
clothing 72.1
man 60.2
old 42.5
room 40.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Female, 99.1%
Happy 95.5%
Surprised 2%
Calm 1.1%
Sad 0.6%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%

Feature analysis

Amazon

Person
Chair

Clarifai

Man
Clothing
Footwear
Book
Human face
Furniture

AWS Rekognition

Person 99.4%

Categories

Imagga
created on 2022-02-12

interior objects 86.9%
paintings art 12.4%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

a drawing of the family.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of men sitting in chairs in a room

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image is a negative photograph showing three individuals seated in a formal living room setting. Two men, dressed in light suits, are sitting on chairs, while a woman, dressed in a dress and necklace, is seated on a stool. The room contains decorative elements, including a fireplace, sconce lighting with candles, a bookshelf filled with books, and a table with flowers and other items on it. The background features wall details and an open doorway leading to another area, which appears decorated with patterned wallpaper. The overall ambiance suggests a refined and comfortable indoor environment.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image appears to be a negative photograph of a living room or sitting area. In the center, there are three people seated around a fireplace. The two men are wearing light-colored suits, and the woman is in a dark dress. The rest of the room is decorated with a bookshelf filled with books on the left and a framed picture or painting above it. A pair of wall-mounted candle holders is visible above the fireplace. The flooring is carpeted, and there is an open doorway leading to another room on the right.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph of a formal living room or sitting area. There are two people seated in chairs, a man and a woman, both dressed in formal attire. The man is wearing a white suit, while the woman is wearing a dress. Behind them, there are two chandeliers hanging from the ceiling and a bookshelf visible in the background. The overall scene suggests a sense of elegance and formality.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from the 1950s or early 1960s, showing a well-appointed living room or office setting. Three people are seated in the room - two men wearing white suits and a woman in a dark dress with what appears to be a pearl necklace. The room features elegant wall sconces, a fireplace, and bookshelves along one wall. The furniture appears to be mid-century modern in style, with clean lines and simple forms. The lighting and composition of the photograph is professional, suggesting this may have been a formal or promotional photo. The overall atmosphere appears warm and welcoming despite the formal attire of the subjects.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of three people sitting in a living room. The image is faded, making it difficult to discern details.

  • Man on the Left
    • Sitting in a chair
    • Wearing a white suit with a dark shirt and tie
    • Balding with a receding hairline
    • Legs crossed
  • Man in the Middle
    • Sitting on the arm of a chair
    • Wearing a white suit with a dark shirt and tie
    • Short hair
    • Legs crossed
  • Woman on the Right
    • Sitting in a chair
    • Wearing a dark dress and pearl necklace
    • Blonde hair
    • Legs crossed

The background of the image shows a living room with a fireplace, bookshelf, and window. The overall atmosphere of the image is one of relaxation and conversation, as the three individuals appear to be engaged in discussion.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of three individuals in a living room setting. The scene appears to be from the 1950s or 1960s, based on the clothing and decor.

In the foreground, there are two men and one woman seated in chairs. The man on the left wears a white suit with a dark shirt and tie, while the man in the middle is dressed in an all-white outfit. The woman on the right sits in a chair, wearing a dark dress and heels.

Behind them, a fireplace is visible, accompanied by two wall-mounted candle holders above it. To the left of the fireplace, a bookshelf is partially visible, suggesting a cozy and intellectual atmosphere. The overall ambiance of the image exudes a sense of sophistication and refinement, characteristic of the era in which it was taken.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image shows a black-and-white photo of three people sitting in a room. The room has a fireplace, a shelf with books, and a picture frame on the wall. The three people are sitting on chairs and appear to be posing for a photo. The man on the left is wearing glasses and a white coat, while the man in the middle is wearing a white suit and a tie. The woman on the right is wearing a dress and a necklace. The image has a watermark in the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image is a black-and-white photograph of three people sitting in a room. The room has a carpeted floor and a bookshelf filled with books. The man on the left is sitting on a chair, and the other two are sitting on the right side of the room. The room has a fireplace with a mantel, and a candle holder is hanging on the wall above the fireplace.

Google Gemini

Created by gemini-2.0-flash on 2025-05-20

Here is a description of the image:

The image is a black and white negative featuring three people in an indoor setting. On the left, a man is seated in an armchair, dressed in a suit with his legs crossed. His expression is neutral. In the center, a man wearing a suit is seated on a small stool or ottoman. His posture is upright, and he is looking towards the camera with a slight smile. To his right, a woman is seated on another stool, wearing a dress and a necklace. She is also smiling and looking at the camera.

Behind the figures, there is a fireplace with decorative sconces mounted on the wall above it. To the left of the man in the armchair, there is a bookshelf filled with books and a decorative arrangement of flowers. In the background, there is an open doorway leading to another room, with patterned wallpaper visible through the doorway. The composition is balanced, with the figures arranged in a triangular formation. The overall tone of the image is formal and posed.

Created by gemini-2.0-flash-lite on 2025-05-20

Here's a description of the image:

The image appears to be a negative photograph, showing a mid-century interior scene with three people.

Composition:

  • Three Figures: A man sits in an armchair on the left, another man sits in the middle, and a woman sits on a stool on the right.
  • Setting: The scene is set within a living room. There is a fireplace visible in the background, along with wall sconces. A bookshelf is on the left side of the image. An open doorway can be seen in the right background.
  • Negative effect: Due to the negative effect, lighter elements in the original image appear dark, and dark elements appear light. This gives a unique, almost ethereal quality to the scene.

People:

  • Attire: The two men appear to be wearing light-colored suits. The woman is wearing a dress.

Overall Impression:

The image evokes a sense of a social gathering or a posed portrait, likely from the mid-20th century, given the clothing styles and interior design elements. The negative effect adds a layer of artistic interest to the scene.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a black-and-white photograph of three individuals seated in a living room setting. The room features a fireplace with a mantel, above which hangs a painting. There are two wall sconces on either side of the painting.

To the left, an older man is seated in an armchair, wearing a light-colored suit and tie. He appears relaxed and is looking towards the camera. To the right of the fireplace, a younger man is seated on a modern chair, also wearing a light-colored suit and tie. He is leaning forward with his hands on his knees and smiling at the camera.

Next to the younger man, an older woman is seated in a similar modern chair. She is wearing a dress and a necklace, and she is also smiling at the camera. Behind them, there is a doorway leading to another room. On the left side of the image, there is a bookshelf filled with books and a small table with a vase and a framed picture.

The overall atmosphere of the photograph is warm and familial, suggesting a comfortable and well-decorated home. The image appears to be a posed family portrait, capturing a moment of togetherness.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-17

The image is a black-and-white photograph depicting a group of three individuals seated in a formal living room setting. The room is decorated with a sophisticated and elegant interior, featuring a fireplace with a mirror above it, and wall-mounted sconces with candles. There are books on a shelf to the left, and a vase with flowers on a side table, adding to the refined ambiance.

The individuals are dressed in formal attire. Two of the men are wearing white suits, while the woman is dressed in a dark, elegant outfit, likely a dress, and she is wearing a pearl necklace. The men are seated on armchairs, and the woman is seated on a stool or lower chair to their right. The men appear to be engaged in conversation, with one gesturing with his hand, while the woman is smiling and looking towards the men. The overall mood of the image is formal and relaxed, suggesting a social or business meeting in a comfortable and stylish environment.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-17

This black-and-white photograph captures a formal and elegant setting with three individuals seated in a well-furnished room. The man on the left and the man in the center are dressed in white suits and ties, while the woman on the right is wearing a dark dress. They are seated on chairs in front of a fireplace, with the man in the center sitting on the armrest of the woman's chair. The room features a bookshelf filled with books, a framed picture on the wall, and wall-mounted candle-like fixtures. The overall atmosphere suggests a sophisticated and possibly professional or celebratory occasion.

Text analysis

Amazon

5
3
Desure
KODAK-AEITW
HO

Google

MJI7--YT37A°2 - - AGON
MJI7--YT37A°2
-
AGON