Human Generated Data

Title

Charles Martin Tornow Loeffler (1861-1935) (copy photograph of a painting by John Singer Sargent, 1903, Rhode Island School of Design)

Date

c. 1903

People

Artist: Sarah Choate Sears, American 1858 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Montgomery S. Bradley and Cameron Bradley, P1984.62

Human Generated Data

Title

Charles Martin Tornow Loeffler (1861-1935) (copy photograph of a painting by John Singer Sargent, 1903, Rhode Island School of Design)

People

Artist: Sarah Choate Sears, American 1858 - 1935

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Montgomery S. Bradley and Cameron Bradley, P1984.62

Machine Generated Data

Tags

Amazon
created on 2023-08-30

Art 100
Painting 100
Face 99.9
Head 99.9
Photography 99.9
Portrait 99.9
Person 99
Adult 99
Male 99
Man 99
Clothing 56.5
Coat 56.5

Clarifai
created on 2023-11-01

people 99.9
portrait 99.7
one 99.4
leader 99.2
adult 98.9
man 98.6
chair 98.1
administration 97.5
elderly 96.1
art 96
scientist 94.8
politician 93.2
poet 91.7
furniture 89.2
facial hair 88.9
wear 88.1
engraving 87.3
writer 85.8
print 85.3
old 85

Imagga
created on 2018-12-27

man 37.6
old 29.9
male 29.8
person 24.8
people 24
grandfather 23.5
portrait 23.3
senior 21.5
adult 20.7
black 16.3
prison 15
suit 14.8
handsome 14.3
passenger 13.7
face 13.5
business 12.8
work 12.6
couple 12.2
mature 12.1
old-timer 12
men 12
human 12
looking 12
one 11.9
elderly 11.5
businessman 11.5
grandma 11.4
correctional institution 11.3
happy 10.6
statue 10.6
serious 10.5
hair 10.3
elegant 10.3
love 10.3
lifestyle 10.1
dark 10
holding 9.9
retired 9.7
building 9.7
look 9.6
god 9.6
ancient 9.5
room 9.3
smile 9.3
spectator 9.2
close 9.1
office 9.1
working 8.8
professional 8.7
spiritual 8.6
architecture 8.6
husband 8.6
executive 8.6
wife 8.5
expression 8.5
penal institution 8.4
attractive 8.4
head 8.4
inside 8.3
beard 8.1
religion 8.1
history 8
painter 7.8
hands 7.8
pray 7.7
corporate 7.7
sitting 7.7
retirement 7.7
sculpture 7.6
casual 7.6
call 7.6
hand 7.6
tie 7.6
fashion 7.5
religious 7.5
vintage 7.4
light 7.3
aged 7.2
smiling 7.2
gray 7.2
art 7.2
eye 7.1
romance 7.1
interior 7.1
job 7.1
together 7

Microsoft
created on 2018-12-27

person 96.2
man 92
portrait 92
black and white 50.9
art 29.4
monochrome 19.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 98%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 0.4%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Person 99%
Adult 99%
Male 99%
Man 99%

Captions

Microsoft
created by unknown on 2018-12-27

a man sitting in a chair 78.7%
a man sitting on a bench 51.5%
a man sitting on a chair 51.4%

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a black and white photo of a man in a suit and tie -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This is a black-and-white portrait featuring a seated individual dressed in formal attire, including a suit and bow tie. The person is holding a string instrument, likely a cello, which is partially visible in the foreground. The painting showcases a detailed depiction of the clothing and posture, emphasizing the elegance of the subject. Handwritten text appears in the upper right portion of the image, though it is somewhat faded and difficult to decipher, adding a historical or personalized element to the portrait. The composition suggests an environment of art and refinement.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a black and white portrait of a man holding a cello. The man is wearing formal attire, consisting of a dark jacket, white shirt, and a bow tie. The background of the image is dark and slightly textured, providing contrast to the subject. The man's hands are clasped around the neck of the cello, suggesting a sense of elegance and musical affinity. The photograph appears to be an artistic rendering, with a classic and sophisticated feel. Handwritten inscriptions can be seen faintly at the top of the portrait. The edges of the image include some white paper strips and are pinned down, indicating that this might be a copy or a photograph of an original artwork.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black and white photograph of a painting of a man holding a violin. The painting is in a portrait orientation, with the man positioned centrally. He is wearing a dark suit jacket, a white collared shirt, and a dark tie. His head is turned to the right, and he is holding the violin in his left hand, with the bow resting on his shoulder. The background of the painting is dark, with some lighter shading around the subject's head and shoulders.

The photograph itself appears to be a scan or photocopy of the original painting, as it has a rough texture and some creases. There are also some white lines visible on the edges of the photograph, which may be from the scanning process or from the original photograph being taped to a board. Overall, the image provides a clear view of the painting, showcasing the artist's skillful use of light and shadow to create a sense of depth and dimensionality.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a painting of a man holding a violin. The man is wearing a dark suit with a white shirt and a dark tie. He has a bald head and a mustache. The background of the painting is dark, and there are some illegible words written in the top-right corner.

The photograph appears to be taken from an angle, as the edges of the painting are not straight. There are also some white pieces of paper or tape visible around the edges of the painting, which may have been used to hold it in place or to mark its position. Overall, the image suggests that the painting is being studied or examined, possibly for artistic or historical purposes.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

This image is a black-and-white portrait of a man holding a cello. The man is bald and has a mustache. He is dressed in a suit and tie, and his right hand is holding the cello while his left hand is resting on the cello's neck. The cello has a black bow, and the man's face is illuminated by a light source, casting a shadow on the wall behind him. The image has a vintage filter applied, giving it an old-fashioned look.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image shows a portrait of a man. He is sitting and holding a cello. He is wearing a black suit with a white shirt underneath. He also has a black tie. He is looking to the right. He has a receding hairline and a mustache. He is illuminated by a light source coming from the right side. The background is dark and has a few white lines.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-30

Here's a description of the image:

The image is a black and white photograph of what appears to be a painting. It depicts a man in a suit, holding a violin. He is bald with a white beard and mustache. The man is looking to his right. He is posed in front of a dark background. The painting itself seems to be mounted or held in place, visible by the edges of the photo. There is handwriting in the upper right corner.

Created by gemini-2.0-flash on 2025-05-30

The image is a black-and-white portrait of a man, likely painted. He is balding with a neat, pointed beard. He's wearing a dark suit with a tie. His right hand rests on what appears to be a violin or viola, which he is holding upright. The background is dark, creating a high contrast with the man's face and clothing. The image appears to be a photograph of the painting, as evidenced by the edges of the canvas visible around the portrait and the tacks holding it in place. There's also some handwriting visible in the upper portion of the image, likely the name or signature of the artist or subject.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white portrait of a man who appears to be holding a cello. The man is dressed in formal attire, including a dark suit and tie. He has a bald head and a mustache. The portrait is set against a dark background, which highlights the man and the cello he is holding. The image has a vintage feel to it, suggesting it might be an old photograph or a painting. There are some visible tears and creases in the image, indicating it might be damaged or aged. The man's expression is calm and composed, and he seems to be looking slightly to the side. The overall mood of the image is serious and dignified.