Human Generated Data

Title

Joost Schmidt and Mrs. Scheper at a Costume Party

Date

c. 1929

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Howard Dearstyne, BR50.21

Human Generated Data

Title

Joost Schmidt and Mrs. Scheper at a Costume Party

People

Artist: Unidentified Artist,

Date

c. 1929

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Howard Dearstyne, BR50.21

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.6
Human 99.6
Person 99.6
Face 96.9
Clothing 82
Apparel 82
People 74.9
Performer 65.1
Portrait 63.6
Photography 63.6
Photo 63.6

Clarifai
created on 2023-10-25

people 99.9
portrait 99.8
adult 99.1
wear 97.3
two 97.2
man 97.1
facial expression 96.9
one 95.9
music 95.8
outerwear 93.8
woman 93.4
facial hair 90
retro 89.7
art 88.9
veil 87.7
musician 87.6
administration 87.6
lid 86.8
eyewear 85.1
singer 84.7

Imagga
created on 2022-01-09

man 43.7
male 42.6
person 38.5
portrait 33.7
businessman 33.6
business 32.8
office 31.8
people 30.7
director 30.3
suit 29.6
corporate 26.7
adult 26
executive 25.2
professional 24.3
happy 23.2
bow tie 21.5
phone 20.3
looking 20
tie 19.9
face 19.9
attractive 19.6
manager 19.6
smiling 19.5
necktie 19.4
work 18.9
handsome 18.7
smile 18.5
expression 17.9
glasses 16.7
look 16.7
successful 16.5
senior 15.9
job 15.9
mature 15.8
businesswoman 15.5
success 15.3
desk 15.1
confident 14.6
talk 14.4
shirt 14
old 13.9
call 13.8
sitting 13.8
lifestyle 13.7
clothing 13.3
businesspeople 13.3
indoor 12.8
communication 12.6
elderly 12.5
cell 12.4
mustache 12.3
mobile 12.3
telephone 12.1
computer 12
guy 11.9
modern 11.9
laptop 11.9
happiness 11.8
worker 11.6
couple 11.3
black 11.1
casual 11
alone 11
hand 10.6
working 10.6
talking 10.5
love 10.3
garment 10.2
friendly 10.1
holding 9.9
cheerful 9.8
human 9.8
masculine 9.7
cellphone 9.7
hair 9.5
eyes 9.5
buddy 9.4
room 9.1
entrepreneur 9.1
family 8.9
salesman 8.9
cellular 8.8
conversation 8.7
older 8.7
secretary 8.7
hands 8.7
sales 8.7
serious 8.6
thinking 8.6
jacket 8.5
one person 8.5
attire 8.5
finance 8.5
pretty 8.4
company 8.4
gray 8.1
home 8
to 8
indoors 7.9
table 7.8
head 7.6
fashion 7.5
meeting 7.5
one 7.5
occupation 7.3
stylish 7.2
women 7.1
wig 7

Google
created on 2022-01-09

Sleeve 86.9
Coat 85.4
Collar 79.8
Art 78.1
Beard 72.6
Vintage clothing 70.2
Eyewear 68.9
Room 67.5
Monochrome photography 66.2
Event 65.6
Font 64.6
Classic 63.2
History 61.3
Suit 60.9
Moustache 60.9
Monochrome 59.9
Visual arts 58.2
Formal wear 57.7
Photographic paper 57.3
Portrait 55.9

Microsoft
created on 2022-01-09

wall 99.9
human face 99.6
person 99.6
clothing 96.6
text 94.4
woman 94.1
indoor 92.5
smile 88.3
portrait 88.3
black 71.8
old 64.4
man 63
posing 50.2
picture frame 6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Female, 99.8%
Calm 95.5%
Confused 2%
Surprised 0.7%
Sad 0.6%
Angry 0.6%
Disgusted 0.3%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Confused 45.1%
Calm 30.4%
Angry 11.2%
Fear 5.2%
Sad 3.8%
Surprised 1.8%
Disgusted 1.4%
Happy 1.1%

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.6%
Person 99.6%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and woman sitting next to each other -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image depicts two individuals in vintage-style clothing. The person on the left is wearing a white outfit with gloves and a large ornate hat featuring embellishments and decorative elements. The individual on the right is dressed in formal attire, including a coat and cravat or tie. The setting appears to be indoors, with neutral lighting and minimal background details.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts two individuals standing closely together. The person on the left is wearing a wide-brimmed hat adorned with ribbons and possibly floral decorations. They are dressed in a light-colored top with a dark tie or ribbon around the neck. The individual on the right is wearing dark, formal attire, consisting of a suit jacket and collared shirt. The setting appears to be indoors with a plain wall in the background, and there is a shadow cast on the wall that suggests lighting from the side or above.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows two people, a woman and a man, posing for a photograph. The woman is wearing a bonnet and appears to be from an earlier time period. The man has a serious expression and is wearing a dark suit. They are standing together in what seems to be an indoor setting. The image has a black and white tone, suggesting it is an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be historical in nature. It shows two people sitting together - one wearing a white shirt with what appears to be a dark tie or ribbon, and the other in darker clothing. The image has the grainy, slightly soft quality typical of early photography. The lighting creates strong contrasts between light and shadow, giving the photograph a dramatic, moody quality. The composition is fairly simple and direct, with both subjects facing forward in what seems to be an interior setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man and woman, likely from the 19th or early 20th century.

The woman sits on the left, wearing a large hat with a wide brim and a dark ribbon tied around the crown. Her hair is pulled back, and she wears a white blouse with a high neckline. She appears to be looking at something off-camera to her left.

The man sits on the right, wearing a dark suit jacket with a high collar and a white shirt underneath. He has a long beard and mustache, and his hair is cut short. His arms are crossed, and he looks directly at the camera with a serious expression.

The background of the image is a plain wall, with shadows cast by the subjects. The overall atmosphere of the image suggests a formal portrait, possibly taken in a studio or at home. The woman's attire and the man's beard and mustache suggest that they may be from a rural or middle-class background.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man and woman. The woman is on the left, wearing a white dress with a high neckline and long sleeves. She has a dark hat with a wide brim and a ribbon tied under her chin. The man is on the right, dressed in dark clothing with a high collar and a tie. His hair is short, and he has a beard. The background is a plain wall, and the overall atmosphere suggests that the photo was taken indoors. The style of their clothing and the quality of the photograph suggest that it may be from the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of two people sitting close to each other. The woman is wearing a hat and a white blouse with a black ribbon tied around her neck. The man is wearing a suit and has a beard and mustache. They are both looking in the same direction, and the man is wearing a serious expression. The background is blurry, and there is a shadow of a person on the right side of the image.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white photo features a man and a woman standing close to each other. The woman is wearing a hat and a white blouse. She is also wearing a necklace. The man is wearing a coat, a shirt, and a tie. He has a beard and mustache. His arms are crossed. The woman is looking at the man, and the man is looking to the side. The photo is bordered with a white border.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

The image is a black and white photograph of two people. On the left is a woman wearing a large, dark hat adorned with decorative elements and a dark ribbon. She's wearing a light-colored top. Her expression is serious.

To the right is a man with a short, dark beard and a stern face. He is wearing a dark jacket and his arms are crossed. A shadow can be seen on the wall behind them. The photograph appears to be an older print, likely from the early to mid 20th century.

Created by gemini-2.0-flash on 2025-05-17

This is a black and white photo of a woman and a man standing next to each other, posed in front of a blank wall. The woman, who is on the left of the frame, is wearing a large brimmed hat with a ribbon detail and a light-colored, short-sleeved shirt. She is looking off to the left of the frame with a serious expression. The man is on the right, wearing a dark suit jacket with his arms crossed. He has a full beard and is squinting slightly as he looks straight ahead. The light in the photograph casts a shadow of his head on the wall behind him, making the shape of his profile visible.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a vintage black-and-white photograph featuring two individuals, a man and a woman, posing together. The woman is wearing a large, dark hat with decorative elements and a light-colored blouse. She has a scarf tied around her neck. The man is dressed in a dark suit with a white shirt and a dark tie. He has a beard and is smoking a pipe. The background is plain, likely a studio backdrop, and the photo has a slightly blurred quality, which is typical of older photographs. The overall atmosphere suggests that this photo was taken some time ago, possibly in the early to mid-20th century.