Human Generated Data

Title

Untitled (family portrait in living room, one woman and five men)

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10365

Human Generated Data

Title

Untitled (family portrait in living room, one woman and five men)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10365

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Accessories 99.2
Accessory 99.2
Overcoat 98.8
Clothing 98.8
Coat 98.8
Apparel 98.8
Human 98.2
Sitting 98.1
Crowd 91.5
People 79.4
Jury 65.8
Face 62.9
Audience 59.5
Press Conference 59.2
Attorney 57.7

Clarifai
created on 2023-10-27

group 99.8
people 99.8
portrait 99.6
group together 99.3
three 98.4
man 98.2
four 98.1
leader 97.3
adult 96.7
several 95.3
five 95
administration 94.3
chair 86
wedding 84
handshake 83.7
elderly 80.9
partnership 78
award 77.5
monochrome 76.1
diplomat 75.5

Imagga
created on 2022-01-23

businessman 54.8
office 53
business 49.8
man 48.4
team 44.8
male 42.6
businesswoman 37.3
person 37.1
corporate 35.2
people 35.2
businesspeople 35.1
executive 34.9
meeting 34.9
group 33.9
teamwork 32.5
men 30.1
professional 29.1
suit 29.1
colleagues 27.2
adult 25.6
work 25.1
happy 25.1
confident 24.6
businessmen 24.4
secretary 23.4
partnership 22.1
smiling 21
manager 18.6
partners 18.5
tie 18
handsome 17.8
success 17.7
job 17.7
staff 17.2
worker 17
desk 17
portrait 16.8
together 16.7
standing 16.5
successful 16.5
corporation 16.4
career 16.1
working 15.9
coworkers 15.7
golfer 15.5
partner 15.5
30s 15.4
sitting 14.6
looking 14.4
table 13.9
associates 13.8
occupation 13.8
indoor 13.7
kin 13.7
colleague 13.7
laptop 13.7
smile 13.5
leadership 13.5
communication 13.4
boss 13.4
company 13
baron 12.6
cooperation 12.6
formal 12.4
workplace 12.4
indoors 12.3
cheerful 12.2
computer 12
player 12
20s 11.9
entrepreneur 11.9
discussing 11.8
businesswomen 11.8
discussion 11.7
groom 11.6
busy 11.6
jacket 11.6
mature 11.2
expression 11.1
employee 10.8
conference 10.8
mid adult 10.6
talking 10.5
lawyer 10.4
building 10.3
senior 10.3
attractive 9.8
40s 9.7
director 9.7
necktie 9.7
contestant 9.4
lifestyle 9.4
two 9.3
face 9.2
modern 9.1
25 30 years 8.8
bow tie 8.8
agreement 8.7
couple 8.7
employment 8.7
diversity 8.7
confidence 8.6
guy 8.5
presentation 8.4
horizontal 8.4
women 7.9
collaboration 7.9
crew 7.9
paper 7.8
happiness 7.8
diverse 7.8
businessperson 7.8
deal 7.8
collar 7.7
planner 7.6
females 7.6
doctor 7.5
clothing 7.1

Google
created on 2022-01-23

Photograph 94.3
Coat 90.5
Suit 84.2
Blazer 77.9
Collar 77.9
Tie 75.4
Snapshot 74.3
Event 72.1
White-collar worker 70
Vintage clothing 68.2
Team 67.3
History 65
Chair 62.1
Formal wear 59.8
Monochrome 59.5
Sitting 58.1
Classic 57
Font 50.6
Collaboration 50.4

Microsoft
created on 2022-01-23

person 100
wall 99.7
clothing 96.5
man 95.5
smile 95
text 94.9
human face 90.5
standing 83.2
suit 83.2
black 81.1
posing 77.1
people 76.7
group 61.7
old 52
dressed 38.1
clothes 26

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 72-82
Gender Male, 99.9%
Calm 99.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 59-67
Gender Female, 97.8%
Calm 99.2%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 82.2%
Happy 6.6%
Surprised 3.4%
Confused 2%
Angry 2%
Sad 1.6%
Fear 1.2%
Disgusted 1%

AWS Rekognition

Age 48-54
Gender Male, 100%
Happy 88.8%
Surprised 5.1%
Calm 3.1%
Angry 1.1%
Fear 0.8%
Disgusted 0.6%
Confused 0.3%
Sad 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Happy 64.1%
Surprised 15.7%
Calm 9.1%
Confused 4.4%
Angry 3.1%
Fear 2.5%
Disgusted 0.9%
Sad 0.3%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 93.5%
Happy 3.9%
Confused 1.1%
Surprised 0.8%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%
Sad 0.1%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Suit
Person

Clarifai

No features identified

AWS Rekognition

Tie 99.2%

AWS Rekognition

Tie 97%

AWS Rekognition

Tie 96.6%

AWS Rekognition

Tie 95.7%

AWS Rekognition

Tie 76.8%

AWS Rekognition

Suit 98.8%

AWS Rekognition

Suit 97.4%

AWS Rekognition

Suit 97.2%

AWS Rekognition

Suit 96.4%

AWS Rekognition

Suit 86%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 94.7%

AWS Rekognition

Person 94.5%

AWS Rekognition

Person 92.8%

AWS Rekognition

Person 80.7%

AWS Rekognition

Person 72.6%

Categories

Imagga
created on 2022-01-23

people portraits 98.8%
paintings art 1.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-23

a photograph of a group of people standing around a man in a suit

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This image shows a formal group portrait featuring six individuals arranged in two rows. Three men in suits stand in the back row, with two dressed in ties and one in a bow tie. In the front row, two men in suits flank a woman dressed in a black dress and wearing a necklace. A painting depicting a landscape with mountains and trees hangs on the wall in the background, alongside curtains on the left side of the image. The overall setting suggests a formal or family gathering.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a vintage family portrait featuring six individuals: three seated in the front and three standing behind them. The individuals are dressed formally, with the men wearing suits and ties or bow ties, and the woman in the front row wearing a black dress with a necklace. There is a painting hanging on the wall in the background, depicting a landscape scene with mountains and trees. The setting appears to be indoors, likely in a living room or similar space, with curtains and a piece of furniture visible on the left side of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-21

The image shows a group portrait of six older men, likely from the mid-20th century based on their attire and the style of the photograph. The men are dressed in suits and ties, suggesting a formal or professional setting. They appear to be seated or standing in a room with a curtain or wall behind them, and there is a framed landscape painting visible on the wall. The men have serious expressions on their faces, indicating this may have been an official or business-related photograph. Without being able to identify the individuals, the image conveys a sense of formality and professionalism among the group.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-21

This is a black and white photograph that appears to be from around the 1950s or 1960s. It shows a formal group portrait of six people - three standing in the back row and three seated in the front row. They are all dressed formally, with the men wearing suits and ties. The two people on the right in the front row appear to be elderly individuals. There's a framed landscape painting visible on the wall behind them showing what looks like a mountain scene. The photo has the formal, staged quality typical of professional or organizational photographs from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of six people posing for a photo.

The group consists of three men standing in the back row and three men and one woman sitting in the front row. The men are all wearing suits and ties, while the woman is wearing a dark dress with a necklace. The man on the far left of the front row is sitting in a wheelchair.

The background of the image features a wall with a picture hanging on it, and a curtain to the left of the group. The overall atmosphere of the image suggests that it was taken in a formal setting, possibly for a family photo or a professional portrait.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a family of seven, with three men standing in the back row and four people seated in the front row. The men in the back row are dressed in suits and ties, while the individuals in the front row are also formally attired.

The background features a wall adorned with a framed picture, and a curtain is visible to the left of the standing men. The overall atmosphere suggests a formal family portrait, likely taken in the mid-20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

A black-and-white photo of a family with six people. Three of them are standing behind the other three, who are sitting on a chair. The three standing are wearing suits and ties. The woman sitting in the middle is wearing a necklace and a bracelet. The man sitting on the right is wearing a bow tie. The man sitting on the left is wearing glasses. Behind them is a picture frame on the wall.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white image shows a group of people posing for a photograph. The group consists of three men, two women, and an elderly man. The three men are standing behind the two women and the elderly man, who are seated. The elderly man is wearing a bow tie, while the other men are wearing ties. The two women are wearing glasses, and one of them is wearing a necklace. Behind them is a curtain and a painting.

Google Gemini

Created by gemini-2.0-flash on 2025-05-19

Here is a description of the image:

The image is a black-and-white studio portrait of a group of six people. It appears to be from the mid-20th century, based on the clothing and photographic style.

In the front row, there is a man seated in a wheelchair on the left, wearing a suit, tie, and glasses. He has a handkerchief in his suit pocket. To his right is an elderly woman wearing a dark dress, a pearl necklace, and glasses. Her hands are clasped in her lap. Next to her, on the right side of the image, is an elderly man in a suit with a bow tie and glasses.

In the back row, three men are standing. On the left, the man is wearing a suit and tie. In the center, the man is wearing a patterned jacket, a button-down shirt, and a tie. On the right, the man is wearing a suit and tie.

The background features a wall with a patterned curtain on the left. There is a picture hanging on the wall above the standing man on the right. The picture appears to be a landscape or western-themed painting. A portion of a chair is visible on the right side.

The overall impression is that this is a formal family portrait, possibly taken on a special occasion.

Created by gemini-2.0-flash-lite on 2025-05-19

Here's a description of the image:

The image is a black and white photograph of a group of six people, likely a family. They are posed indoors, with a simple wall in the background.

Here's a breakdown of the people:

  • Front Row:
    • A man is seated in a chair, wearing a suit and glasses. He is looking at the camera.
    • A woman seated in a wheelchair. She's wearing a dress and a pearl necklace.
    • An older man wearing a suit and a bow tie. He has glasses and a friendly expression.
  • Back Row:
    • Three men are standing behind them. They are wearing suits.

The photograph appears to be from a past era, based on the clothing and the overall style of the image. A small painting of a scene is hanging on the wall.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a vintage black-and-white photograph featuring a group of six individuals. The group consists of four men and two women, all dressed formally. The men are wearing suits and ties, while the women are in dresses.

The photograph is arranged in two rows:

  • Back Row: There are three men standing. The man on the left is wearing a dark suit with a white shirt and a tie. The man in the center is also in a suit with a lighter shade and a tie. The man on the right is in a dark suit with a white shirt and a tie, and he is standing near a framed picture on the wall.

  • Front Row: There are three individuals seated. The man on the left is wearing a suit with a white shirt and a tie. The woman in the center is wearing a dark dress and glasses. The man on the right is in a dark suit with a white shirt and a bow tie.

The background appears to be an indoor setting with a plain wall and a framed picture of a landscape scene. The overall atmosphere of the photograph suggests a formal or special occasion, possibly a family gathering or a commemorative event.

Qwen

No captions written