Human Generated Data

Title

Kristine L. Forsgard (b. 1953) and Stephen A. Mitchell (b.1951)

Date

2000

People

Artist: C. Kenneth Fan, American born 1967

Sitter: Stephen A. Mitchell, born 1951

Sitter: Kristine L. Forsgard, born 1953

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Commissioned by Eliot House, H746

Human Generated Data

Title

Kristine L. Forsgard (b. 1953) and Stephen A. Mitchell (b.1951)

People

Artist: C. Kenneth Fan, American born 1967

Sitter: Stephen A. Mitchell, born 1951

Sitter: Kristine L. Forsgard, born 1953

Date

2000

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Commissioned by Eliot House, H746

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Blazer 100
Clothing 100
Coat 100
Jacket 100
Art 100
Painting 100
Face 99.5
Head 99.5
Photography 99.5
Portrait 99.5
Person 99.3
Adult 99.3
Female 99.3
Woman 99.3
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Person 96.3
Adult 96.3
Female 96.3
Woman 96.3
Formal Wear 92.1
Person 87.6
Suit 84.9
Dress 78
Grass 56.6
Plant 56.6
Accessories 56.5
Tie 56.5
Furniture 55.7
Blouse 55.2

Clarifai
created on 2018-06-05

people 99.1
adult 97.2
man 96.4
two 96.2
woman 96
leader 96
furniture 94.9
home 94.6
room 94.2
administration 91.8
chair 91.7
indoors 91.4
facial expression 91.2
wear 89
politician 86.7
one 86.4
portrait 86.4
curtain 85
family 84.9
group 83.9

Imagga
created on 2018-06-05

groom 73.2
man 45
businessman 41.5
office 39
meeting 37.7
business 37.1
executive 36.7
male 36.3
people 34.6
businesswoman 32.7
professional 32.3
corporate 30.9
suit 29.9
team 28.7
happy 28.2
smiling 26
work 25.9
group 25.8
businesspeople 25.6
person 25.5
adult 25.1
working 24.8
teamwork 24.1
workplace 23.8
manager 23.3
sitting 23.2
confident 21.8
colleagues 21.4
smile 20.7
communication 20.2
together 20.2
men 18
partners 17.5
successful 17.4
women 16.6
couple 16.6
cheerful 16.3
desk 16.2
success 16.1
secretary 15.4
staff 15.3
job 15
holding 14.9
table 14.8
standing 14.8
laptop 14.6
portrait 14.2
friendly 13.7
tie 13.3
coworkers 12.8
partnership 12.5
boss 12.4
talking 12.4
kimono 12.3
lifestyle 12.3
company 12.1
computer 12.1
modern 11.9
indoor 11.9
discussing 11.8
happiness 11.8
partner 11.6
worker 11
businessmen 10.7
corporation 10.6
monk 10.6
indoors 10.5
career 10.4
contemporary 10.3
love 10.3
mature 10.2
robe 9.8
project 9.6
collar 9.6
education 9.5
oriental 9.3
positive 9.2
pretty 9.1
attractive 9.1
dress 9
handsome 8.9
interaction 8.9
explaining 8.9
interior 8.8
looking 8.8
colleague 8.8
busy 8.7
diversity 8.7
leadership 8.6
paper 8.6
notebook 8.6
two 8.5
senior 8.4
service 8.3
life 8.3
occupation 8.3
diverse 7.8
discussion 7.8
planning 7.7
bride 7.7
garment 7.7
formal 7.6
females 7.6
judge 7.6
smart 7.5
presentation 7.4
technology 7.4
building 7.2

Google
created on 2018-06-05

painting 94.4
art 91.1
modern art 86.3
picture frame 85.6
artwork 66.5
paint 59.7
art gallery 56.5
window 54.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Female, 75.7%
Calm 87.9%
Happy 8.6%
Surprised 6.9%
Fear 6%
Sad 2.3%
Confused 0.7%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 16-24
Gender Female, 96.9%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.3%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Female
Woman
Male
Man
Person 99.3%
Person 98.8%
Person 96.3%
Person 87.6%
Adult 99.3%
Adult 98.8%
Adult 96.3%
Female 99.3%
Female 96.3%
Woman 99.3%
Woman 96.3%
Male 98.8%
Man 98.8%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man and woman in a painting -100%

OpenAI GPT

Created by gpt-4 on 2024-01-24

This is an image of a framed painting depicting four figures in an interior setting, likely a room that opens onto a view of the outdoors. Two figures, one on each side, appear to be adults dressed in formal attire--the figure on the right in a blue suit with a flower pinned to the lapel and the figure on the left in a warm-hued blazer. In the center background, there is a third figure standing by an open window with a drawn red curtain, overlooking a landscape with greenery and a bridge. The painting also includes a desk in the foreground adorned with a globe, a potted orchid, and a classical column-like object. There is an animal, possibly a dog, in the scene as well. The bridge seen through the window arches over a body of water and the environment suggests a serene, pastoral setting.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image appears to be a painting or portrait of two people, a man and a woman, standing in front of a window with red curtains and a scenic landscape visible outside. The man is wearing a blue suit with a red tie, while the woman is wearing a beige coat. They seem to be posing together, with the woman holding an object that appears to be a helmet. The painting has a formal, staged quality to it, suggesting it may be an official portrait or representation of the two individuals.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

The image depicts a framed painting of a family scene, with the frame positioned on a wooden surface. The painting features a man and woman standing in front of a window, accompanied by a child and a dog sitting on the windowsill. The man is dressed in a blue suit, while the woman wears a yellow sweater. The child is attired in a red shirt, and the dog is black.

In the background, a bridge spans a body of water, set against a blue sky. The overall atmosphere of the painting exudes warmth and coziness, suggesting a sense of comfort and togetherness among the family members.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a framed painting of a family scene, featuring a man and woman standing in front of a window, with a child and dog sitting on the floor behind them. The man is dressed in a blue suit and red tie, while the woman wears a yellow sweater. The child is wearing a red shirt, and the dog is black.

In the background, a bridge over a body of water can be seen outside the window, set against a blue sky. The room itself is decorated with red curtains, a globe, and a plant with white flowers. The painting is presented in a black frame, which is hung on a wall with a brown textured surface.

Overall, the image showcases a heartwarming family scene, with the adults standing proudly in front of the window, while the child and dog sit together on the floor, creating a sense of warmth and togetherness.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-05

The picture frame is placed on a wooden surface. The picture inside the frame is of a man and a woman standing next to each other, with a little girl sitting on a chair in front of a desk. The man is holding a piece of paper, and the woman is holding a globe. Behind them is a window with red curtains. Outside the window is a grassy field with a bridge and a building.

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image shows a painting of two people standing in front of a window with a view of a river and a bridge. The man is wearing a blue suit and a red tie, while the woman is wearing a white blouse. The painting is framed in a black frame and is placed on a wooden surface. The painting also includes a globe, a potted plant, and a black dog.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The image is a close-up of a framed painting. The painting depicts a man and a woman standing in front of a window with red curtains. The window overlooks a green field with a red bridge in the background. The man is wearing a blue suit with a red tie and holding a white envelope. The woman is wearing a light yellow sweater. On the desk in front of them, there is a globe, a girl with a dog, and a potted plant with white flowers. The background on the right side of the painting is dark with a bookcase and gold décor.

Created by gemini-2.0-flash-lite on 2025-04-27

Here's a description of the image:

Overall Impression:

The image is a framed painting that appears to be a family portrait or a scene depicting a domestic setting. It is rendered in a realistic style, with attention to detail and a sense of depth.

Composition and Setting:

  • Foreground: The painting focuses on a couple, likely the parents, standing behind a dark wooden desk or table.
  • Background: Through a large window framed by red curtains, we see a vibrant outdoor scene. This includes a bright blue sky, a green landscape with a bridge, and additional figures.

Figures:

  • Central Figures: A man in a blue suit and a woman wearing a yellow sweater are the main subjects, likely the parents. They are standing next to each other.
  • Other Figures: There's a girl sitting at the desk, along with a small black dog. Another person can be seen standing in the background.
  • Details: The woman has a globe on the desk. The man is holding a white paper. Flowers are in a pot on the desk.

Style and Color:

  • Artistic Style: The painting appears to be in a realistic style, with careful attention to facial features, clothing textures, and the overall composition.
  • Color Palette: The painting uses a variety of colors, with the blue and green tones of the window contrasting with the red curtains.

Overall Tone:

The painting has a calm and orderly tone, capturing a moment that may be related to family life.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a painting depicting a man and a woman standing in a room with a large window behind them. The window is adorned with red curtains and offers a view of a scenic outdoor landscape featuring green fields, a body of water, and a bridge in the distance.

The man, positioned on the right side of the painting, is dressed in a blue suit with a red tie and a white shirt. He has short brown hair and is holding a piece of paper or document in his hand. There is a yellow flower pinned to his lapel.

The woman, on the left side, has long brown hair and is wearing a light yellow top and a gray skirt. She is standing beside a small table with a globe on it. In front of her, there is a black dog sitting on the floor.

The room has a wooden floor and a few decorative elements, including a vase with white flowers on the right side of the painting and some books on a shelf in the background. The overall scene suggests a formal or semi-formal setting, possibly an office or a study.