Human Generated Data

Title

Untitled (couple and boy)

Date

1970s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2958

Human Generated Data

Title

Untitled (couple and boy)

People

Artist: Unidentified Artist,

Date

1970s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2958

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Accessories 99.8
Accessory 99.8
Clothing 99.7
Apparel 99.7
Human 99.3
Overcoat 97.6
Coat 97.6
Evening Dress 96
Robe 96
Fashion 96
Gown 96
Tuxedo 81.6
Blazer 78.1
Jacket 78.1
Sleeve 73.9
Female 67.6
Long Sleeve 67.5
People 63.4
Sitting 57.3
Wedding 57.2
Plant 56.4
Wedding Gown 55.2

Clarifai
created on 2023-10-29

portrait 99.4
woman 99.3
girl 99.3
people 99.1
facial expression 98.2
adult 97.9
man 97.7
wedding 96.9
group 95.9
model 95.6
wear 94
two 93.7
love 92.8
fashion 92.5
three 91.9
actress 91.6
dress 91.3
brunette 90.5
family 89.5
offspring 89.5

Imagga
created on 2022-02-26

businessman 64.7
team 61.1
corporate 59.5
business 59.1
office 55.6
teamwork 51.2
businesswoman 50.2
group 49.3
man 49.2
meeting 47.3
executive 46.9
businesspeople 46.7
male 45.6
people 41.4
suit 41.2
professional 40.2
groom 39.4
secretary 37.9
men 36.2
person 35.8
colleagues 35.1
businessmen 33.3
confident 32.9
success 32.3
work 29.9
partnership 29.9
successful 29.4
happy 28.9
partners 27.3
smiling 26.1
leadership 26
job 25.7
coworkers 25.6
manager 25.2
staff 25
company 24.3
adult 24.1
corporation 23.2
standing 21.8
smile 21.5
partner 20.4
together 20.2
workplace 20.1
communication 19.4
building 19.1
portrait 18.8
entrepreneur 18.5
cooperation 18.4
career 18
employee 17.8
associates 17.8
looking 17.7
women 17.5
worker 17.3
working 16.9
30s 16.4
boss 16.3
formal 16.3
colleague 15.9
diverse 15.7
diversity 15.4
confidence 15.4
desk 15.2
attractive 14.7
sitting 14.7
discussion 13.7
workers 13.6
handsome 13.4
indoor 12.8
businesswomen 12.8
handshake 12.8
40s 12.7
mid adult 12.6
tie 12.4
20s 12
happiness 11.8
businessperson 11.7
indoors 11.5
director 11.3
computer 11.3
adviser 11.1
busy 10.6
cheerful 10.6
females 10.4
smart 10.4
mature 10.3
friendly 10.1
jacket 9.9
judge 9.9
executives 9.9
conference 9.8
deal 9.8
agreement 9.7
employment 9.7
planning 9.7
lawyer 9.7
couple 9.6
table 9.6
lifestyle 9.4
expression 9.4
three 9.3
camera 9.3
laptop 9.1
holding 9.1
environment 9.1
black 9
collaboration 8.9
discussing 8.9
25 30 years 8.8
males 8.8
modern 8.4
presentation 8.4
look 7.9
crew 7.9
employer 7.9
30 35 years 7.9
shake 7.9
face 7.8
pretty 7.7
project 7.7
two 7.7
horizontal 7.6
baron 7.5
commerce 7.5
document 7.4
positive 7.4
occupation 7.4
lady 7.3
paper 7.1

Google
created on 2022-02-26

Sleeve 87.2
Tie 87.2
Gesture 85.3
Collar 84.1
Suit 82.3
Happy 79.8
Formal wear 78.4
Blazer 78.3
Fashion design 77.7
Event 73.4
White-collar worker 69.8
Jewellery 69.6
Vintage clothing 69.1
Magenta 63.9
Waist 62.9
Pattern 61.5
Fashion accessory 61.1
Bow tie 58.4
Classic 57.6
Tuxedo 57.2

Microsoft
created on 2022-02-26

person 99.9
wall 97.9
clothing 94.8
human face 93.2
indoor 89.3
posing 87.4
smile 77.7
standing 77.3
tie 76.8
suit 72.6
coat 58.8
woman 57.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 97.7%
Surprised 1.1%
Happy 0.4%
Confused 0.2%
Sad 0.2%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-51
Gender Male, 100%
Confused 33.2%
Calm 27.8%
Disgusted 17.4%
Angry 12.9%
Happy 3.1%
Sad 2.5%
Surprised 1.8%
Fear 1.4%

AWS Rekognition

Age 4-10
Gender Male, 100%
Calm 99%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Sad 0.2%
Disgusted 0.1%
Happy 0%
Fear 0%

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Suit

Clarifai

No features identified

AWS Rekognition

Tie 99.8%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 96.8%

AWS Rekognition

Suit 97.6%

AWS Rekognition

Suit 81%

Categories

Imagga
created on 2022-02-26

events parties 90.8%
people portraits 9.2%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-24

a photograph of a man and woman standing next to each other

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image shows three people dressed formally. On the left, an individual is wearing a long red dress with a pearl necklace. In the center, another person is dressed in a dark suit with a blue tie and a white boutonniere. To the right, a young individual is wearing a formal black jacket, white ruffled shirt, and matching shorts with a small floral accessory. The background features a window with a view of an outdoor scene with trees and open space, likely during winter given the visible snow on the ground.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a formal portrait of a small group of three people in front of a window. One person is wearing a long-sleeved, maroon dress with a pearl necklace, while another person is adorned in a classic dark suit with a white dress shirt and dark tie, complemented by a boutonnière on the lapel. The third individual is dressed in a black suit with a white ruffled shirt and a small boutonnière. The setting outside the window seems to be a winter or early spring landscape, with trees that have no leaves and a light covering of snow on the ground. The lighting in the image is bright and natural, suggesting daytime. The group appears well-dressed and poised, likely for a formal event.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a family portrait of three individuals - a woman in a red dress, a man in a suit, and a young boy. The woman appears to be the mother, the man the father, and the boy their son. They are standing together in what looks like a formal setting, possibly at a wedding or other special event. The background suggests a scenic outdoor location, with a snowy landscape visible through a window or doorway behind them.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a formal family portrait from what looks like the 1970s, based on the styling and clothing. The image shows a woman in a burgundy dress with a pearl necklace, a man in a dark suit with a boutonnière, and a young child in what appears to be formal attire. They are posed in front of what looks like a window or doorway with white columns, and there appears to be a winter landscape visible in the background. The photograph has that slightly faded quality characteristic of photos from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image depicts a family of three posing for a photograph. The woman, positioned on the left, wears a long-sleeved, maroon dress with a high neckline and a matching belt around her waist. Her dark hair is styled straight down her back, and she adorns a pearl necklace. The man, seated in the middle, is attired in a black suit, complemented by a white shirt, blue tie, and a white flower on his lapel. His dark hair is neatly combed back. The boy, standing on the right, is dressed in a black suit jacket, paired with a white shirt and a white flower on his lapel. He has short, dark hair.

In the background, a window offers a view of a serene landscape, featuring trees and a body of water. The overall atmosphere suggests that the family is attending a formal event, likely a wedding, given the attire and the presence of a flower on the man's lapel.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image depicts a family of three, comprising a woman, a man, and a young boy. The woman is attired in a long-sleeved red dress, complemented by a pearl necklace featuring a gold pendant. Her dark hair is styled in a straight manner.

The man, positioned beside the woman, wears a black suit with a white shirt and a dark blue tie. A white flower adorns his left lapel, and he has short gray hair. His right hand rests on the shoulder of the young boy standing to his right.

The boy is dressed in a black suit with a white shirt and a white flower on his left lapel. His dark hair is styled in a short, curly manner. The background of the image features a window with a view of a winter landscape, characterized by snow-covered ground and bare trees.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

A family is posing for a photograph in a studio. The woman is standing in front of the man and the boy, and they are all looking at the camera. The woman is wearing a necklace and earrings. The man is wearing a tie, and the boy is wearing a white shirt. Behind them is a window with a white curtain. Outside the window, there are trees and a mountain.

Created by amazon.nova-pro-v1:0 on 2025-06-05

A woman, a man, and a boy are standing in front of a window. The woman is wearing a maroon dress, a pearl necklace, and earrings. The man is wearing a black suit, a tie, and a flower brooch. The boy is wearing a black suit, a white inner shirt, and a flower brooch. The man's hand is on the boy's shoulder. The boy is sitting on a chair.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-01

Here's a description of the image:

Overall Impression:

The image is a medium-shot color photograph, likely taken indoors, possibly in front of a window. It depicts a family portrait, likely from the late 1960s or early 1970s based on the clothing styles and overall aesthetic.

People:

  • Woman: She is standing on the left. She is wearing a long, dark red dress with long sleeves and a belt. She has long dark hair and a pearl necklace.
  • Man: He is in the middle. He's wearing a dark suit, a white shirt, and a dark tie. He has a small boutonniere.
  • Boy: He is on the right, wearing a black suit with a white ruffled shirt. He is looking directly at the camera.

Setting and Background:

The background seems to be a view through a window, with some trees and a body of water visible. The lighting appears to be soft, suggesting natural light.

Overall Feeling:

The photograph has a formal, yet slightly melancholic feeling, perhaps because of the expressions on their faces. It's a snapshot of a family, likely taken at a special event.

Created by gemini-2.0-flash on 2025-06-01

The image is a family portrait of a woman, a man, and a young boy. They are standing indoors, likely at an event, as suggested by their formal attire.

The woman, who appears to be the mother, stands on the left. She is wearing a long-sleeved, maroon-colored dress and a pearl necklace. Her hair is dark and styled in a simple, elegant manner.

The man, presumably the father, is in the center. He is wearing a dark suit with a navy tie and a small white boutonniere on his lapel. His hair is neatly combed, and he has a serious expression as he looks to the right.

The young boy, who seems to be their son, stands on the right side of the image. He is dressed in a dark suit with a white shirt that has ruffles at the collar. A small white flower is pinned to his jacket. He looks straight ahead with a solemn expression.

The background is blurred, but it seems like they are standing near a window with a view of trees and perhaps a body of water in the distance. The lighting is somewhat soft and diffused, typical of an indoor setting.

Overall, the image conveys a sense of formality and perhaps a special occasion, suggesting a family portrait taken at a wedding or similar event. The style of the clothing and the overall aesthetic suggest it was taken in the 1970s.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a family portrait of three individuals, likely taken during a formal event or special occasion. The setting appears to be indoors with a window in the background, revealing a scenic outdoor view with trees and possibly a body of water.

  1. Left Individual (Woman):

    • She is wearing a long, burgundy dress with long sleeves and a high neckline.
    • Her hair is styled in a long, straight manner, parted in the middle, which was a popular style in the 1970s.
    • She is accessorized with a pearl necklace and earrings.
  2. Center Individual (Man):

    • He is dressed in a formal black suit with a white shirt and a dark tie.
    • He has a white flower pinned to his lapel, indicating that this might be a wedding or another formal event.
    • His hair is short and neatly combed, and he has a mustache.
  3. Right Individual (Child):

    • The child is wearing a formal black suit with a white ruffled shirt and a white flower pinned to the lapel, similar to the man's attire.
    • The child's hair is short and neatly combed.

The overall atmosphere of the image suggests a formal or ceremonial occasion, possibly a wedding, given the attire and the flowers pinned to the lapels. The image has a vintage feel, likely from the 1970s based on the clothing styles and hairstyles.

Qwen