Human Generated Data

Title

Elbridge Gerry (1744-1814)

Date

c. 1845-1847

People

Artist: Nathaniel Jocelyn, American 1796 - 1881

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, 1943.1816

Human Generated Data

Title

Elbridge Gerry (1744-1814)

People

Artist: Nathaniel Jocelyn, American 1796 - 1881

Date

c. 1845-1847

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, 1943.1816

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 95.9
Human 91.5

Clarifai
created on 2018-03-16

people 99.6
one 99.5
portrait 99.5
adult 97.8
man 97.1
elderly 97
leader 96.9
writer 91.4
politician 91
wear 90.8
administration 89.4
menswear 84.2
neckwear 81
facial expression 80.4
outerwear 78.9
pensive 76.9
bald 76.4
outfit 73.8
side view 73
actor 69.2

Imagga
created on 2018-03-16

executive 73.1
businessman 67.2
man 59.9
suit 57.9
baron 53.6
male 52.6
business 46.3
handsome 45.6
person 41.2
professional 38.8
judge 38
portrait 37
corporate 36.2
confident 35.6
senior 34.8
manager 33.6
men 32.7
tie 32.3
adult 31.8
mature 29.8
people 28.5
elderly 27.8
boss 27.8
office 26.6
old 25.1
looking 24.8
work 22.8
black 22.3
secretary 20.6
job 20.4
success 20.2
businesspeople 20
glasses 19.5
successful 19.3
necktie 19.2
expression 18.8
face 18.5
older 18.5
worker 17.9
smiling 17.4
standing 16.6
occupation 16.5
smile 16.4
happy 16.3
formal 16.3
one 15.7
modern 15.5
leadership 15.4
60s 14.7
businessperson 14.7
hand 14.5
serious 14.3
shirt 14
studio 13.7
hair 13.5
friendly 12.8
gray hair 12.8
lawyer 12.8
leader 12.6
working 12.4
lifestyle 12.3
one person 12.3
human 12
jacket 11.7
corporation 11.6
bow tie 11.4
smart 11.3
casual 11
40s 10.7
cheerful 10.6
confidence 10.6
desk 10.4
grandfather 10.3
company 10.3
clothing 10.2
garment 10.1
alone 10.1
laptop 10
businessmen 9.8
teacher 9.6
computer 9.6
collar 9.6
sitting 9.5
power 9.3
guy 9.2
look 8.8
couple 8.7
hands 8.7
busy 8.7
education 8.7
retirement 8.7
only 8.6
thinking 8.6
career 8.5
gray 8.1
close 8
color 7.8
mid adult 7.7
head 7.6
communication 7.6
cutout 7.4
aged 7.3

Google
created on 2018-03-16

portrait 94.1
gentleman 85.7
elder 73.6
painting 68.7
art 54.3
senior citizen 53.7
stock photography 50.3

Microsoft
created on 2018-03-16

person 99.4
man 99.2
suit 94.4
old 78.5
older 67.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 57-77
Gender Male, 98.9%
Calm 61.4%
Sad 7%
Confused 11.6%
Happy 9.8%
Disgusted 1.1%
Angry 5.8%
Surprised 3.3%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting

Clarifai

Human face
Man
Human nose
Human hand
Human eye
Human mouth

AWS Rekognition

Person 91.5%

AWS Rekognition

Painting 71.1%

Clarifai

Human face 93.1%

Clarifai

Man 86.9%

Clarifai

Human nose 39.3%

Clarifai

Human hand 34.7%

Clarifai

Human eye 34%

Clarifai

Human eye 33.7%

Clarifai

Human mouth 33.2%

Categories

Imagga
created on 2018-03-16

people portraits 99.3%
events parties 0.7%

Captions

Microsoft
created by unknown on 2018-03-16

a man wearing a suit and tie 98.8%
a man in a suit and tie 98.7%
a man wearing a suit 98.2%

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a portrait of a man in a black suit and white shirt

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a man with white hair and a black suit

OpenAI GPT

Created by gpt-4 on 2024-12-03

This image appears to be a classic style portrait of an individual dressed in formal attire, which suggests a style from a past era. The individual is shown wearing what appears to be a black coat with a high collar, and underneath, a white shirt with a cravat. The attire indicates a sense of formality and suggests that the portrait may have been painted to convey a certain level of prestige or importance. The individual's hair is white and styled in a manner consistent with fashion from the late 18th to early 19th century. The background is unadorned and dark, which serves to highlight the subject's figure.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This is a formal portrait painting from what appears to be the late 18th or early 19th century. The subject is an elderly gentleman with white hair, wearing a black coat and white cravat or necktie. He is shown in a three-quarter view pose against a dark background. The painting style is characteristic of formal portraiture from this period, with careful attention paid to the subject's facial features and clothing details. The subject has a dignified, contemplative expression and appears to be seated in what might be a red-upholstered chair, though only a small portion of it is visible. The painting technique demonstrates the refined style typical of this era's formal portraiture.

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a formal portrait painting from what appears to be the late 18th or early 19th century. The subject is an elderly gentleman with white hair, wearing a black coat and a white cravat or neck cloth. He is seated and positioned at a slight angle, with his arms crossed. The painting has a dark, muted background typical of formal portraits from this period. The style is realistic and shows fine attention to detail, particularly in the facial features and the fabric textures. The subject's expression appears thoughtful and dignified, characteristic of formal portraiture of that era.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait of a well-known historical figure. It depicts an older man with white hair and a serious expression, wearing a black coat and white cravat. The man seems to be sitting upright, with his arms crossed. The background is dark, drawing the viewer's attention to the subject's face and upper body. The portrait has a formal, dignified style typical of 19th century portraiture.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image presents a portrait of an older man, likely from the 18th or early 19th century, dressed in formal attire. He wears a black coat over a white shirt with a high collar and a white cravat, which was a common style during that era. His hair is white and styled in a manner typical of the time period.

The background of the portrait is a dark brown color, which helps to accentuate the subject's features and clothing. The overall atmosphere of the image suggests that it is a formal portrait, possibly taken for official or professional purposes.

The man's facial expression is serious and dignified, which was also characteristic of portraits from this time period. His eyes are cast downward, giving the impression that he is lost in thought or contemplation. The portrait appears to be a painting, rather than a photograph, due to the smooth texture and lack of detail in the background.

Overall, the image provides a glimpse into the fashion and cultural norms of the past, and offers a sense of the dignity and formality that was expected of individuals during this time period.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a portrait of an older man with white hair, dressed in 18th or 19th-century attire. He is wearing a black coat over a white shirt and a cravat, with his arms crossed. The background of the painting is dark, suggesting that it may have been taken in a studio setting.

The man's facial expression is serious, and he appears to be looking directly at the viewer. His white hair is neatly styled, and his eyes are cast downward slightly, giving him a contemplative appearance. The overall atmosphere of the painting is one of dignity and respectability.

The style of the painting suggests that it was created during the late 18th or early 19th century, when portraiture was a popular form of art. The use of oil paints and the attention to detail in the subject's clothing and accessories are characteristic of this period.

Overall, the image presents a dignified and serious portrait of an older man, likely created to capture his likeness and convey his social status.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is an old portrait of an older man with white hair. He is wearing a black coat with a white inner shirt and a white necktie. He is sitting on a chair with his arms crossed and looking to the right. The background of the portrait is dark, and the light is focused on the man's face. The portrait has a vintage look, and it seems to be from the 19th century.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image features a man with white hair and a white beard. He is wearing a black coat over a white shirt. The man is seated, and his arms are crossed, suggesting a relaxed and confident demeanor. The man's facial expression is neutral, and his eyes are looking to the left. The background of the image is dark, and there is a red object on the right side.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here is a description of the image:

The image is an oil painting of an older gentleman. He has white hair styled in a short, slightly curled fashion and fair skin with visible lines and wrinkles. His eyes are a light color, and his expression is one of composed seriousness.

He is wearing a dark suit with a wide lapel, and underneath, a white shirt with a high collar and a neatly tied white cravat or necktie. His arms are crossed in front of him, giving him a confident and slightly formal demeanor.

The background is a muted grey-brown color, providing a neutral backdrop that keeps the focus on the subject. There is a hint of red towards the right edge of the frame, suggesting the presence of a chair or some other furniture that is largely out of view. The overall style of the painting is reminiscent of 18th or early 19th-century portraiture.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

The image is a formal portrait of an older man, likely from the late 18th or early 19th century. He is depicted from the chest up, with a serious but not unkind expression.

Here are some key details:

  • Appearance: He has white hair that is styled in a slightly bouffant manner, typical of the era. His complexion is fair with a slight rosiness, and his eyes are bright.
  • Clothing: He is wearing a dark, possibly black, double-breasted coat and a high-collared white shirt, accented with a cravat. The outfit suggests a person of status.
  • Pose: He is shown with his arms crossed, which contributes to the air of self-assurance and authority.
  • Background: The background is a plain, dark gray or brown, which helps to focus attention on the subject. A corner of what appears to be a red chair can be seen on the right side.
  • Artistic style: The painting style appears to be realistic, with an emphasis on capturing the details of the subject's face and clothing. The lighting is soft, highlighting the subtle shades of his skin and the textures of his clothing.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a portrait of an older man with white hair, dressed in formal attire typical of the late 18th or early 19th century. He is depicted from the waist up, facing slightly to the right. The man has a serious and contemplative expression, with a slight smile. He is wearing a dark, possibly black, coat over a white shirt with a white cravat. The background is dark and plain, which helps to focus attention on the subject. The portrait is painted in a realistic style, capturing the details of the man's face and clothing with precision. The overall mood of the painting is formal and dignified.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

This image is a portrait of an elderly man, likely from the 18th or early 19th century, judging by the style of clothing and the painting technique. The man is dressed in formal attire, wearing a dark coat over a white cravat or neckcloth, which was common in that era. His hair is white and styled in a manner typical of the time. The background is simple and dark, which helps to emphasize the subject. The painting style suggests a realistic approach, with attention to detail in the man's facial features and his clothing. The posture, with arms crossed, gives an impression of confidence and composure. The overall aesthetic of the portrait is formal and dignified.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This image is a portrait of an elderly man with white hair. He is dressed in formal attire, wearing a black coat with a white shirt and a black bow tie. His arms are crossed, and his expression is calm and composed. The background is dark, which helps to emphasize the subject. The painting style suggests it is a classic portrait, likely from the 19th century.