Human Generated Data

Title

Captain Thomas Daggett (c. 1683-1730)

Date

c. 1720-1730

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Francis Rogers, 1958.178

Human Generated Data

Title

Captain Thomas Daggett (c. 1683-1730)

People

Artist: Unidentified Artist,

Date

c. 1720-1730

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Francis Rogers, 1958.178

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 97.3
Human 90.5

Clarifai
created on 2018-03-23

people 99.7
portrait 99.3
adult 98.5
one 98.4
wear 97.9
jacket 97.5
outerwear 95.5
necklace 93.5
lid 93.3
man 91.5
coat 89.3
musician 87.7
music 86.8
sweater 85.5
neckwear 84.3
facial expression 83.4
leader 82.5
veil 82.1
scarf 81.2
singer 77.9

Imagga
created on 2018-03-23

chain mail 53.2
person 44.4
man 44.3
body armor 42.6
portrait 37.5
armor 36.7
male 36.2
people 29.6
adult 28.6
face 24.8
senior 24.4
handsome 24.1
protective covering 22.8
black 22.2
expression 22.2
suit 21.3
businessman 18.5
hair 18.2
old 18.1
smile 16.4
covering 16.1
professional 15.8
happy 15.7
attractive 15.4
speaker 15.1
fashion 15.1
eyes 14.6
business 14.6
mature 13.9
hand 13.7
dark 13.4
model 13.2
shirt 13.1
guy 13
smiling 13
executive 12.8
one 12.7
comedian 12.5
elderly 12.4
tie 12.3
look 12.3
performer 12.1
glasses 12
looking 12
head 11.8
posing 11.5
articulator 11.5
office 11.2
clothing 11.1
ruler 11.1
beard 10.9
serious 10.5
work 10.2
lifestyle 10.1
confident 10
studio 9.9
pretty 9.8
worker 9.8
success 9.7
sexy 9.6
men 9.4
casual 9.3
gray 9
human 9
entertainer 9
lady 8.9
body 8.8
communicator 8.7
hands 8.7
elegant 8.6
successful 8.2
friendly 8.2
alone 8.2
jacket 8.2
style 8.2
aged 8.1
necktie 8
working 8
older 7.8
weapon 7.7
youth 7.7
power 7.6
closeup 7.4
occupation 7.3
sensual 7.3

Google
created on 2018-03-23

portrait 92.4
gentleman 84.3
painting 78.6
elder 60.7
facial hair 58.7
art 57.3

Microsoft
created on 2018-03-23

person 98.1
wearing 80.3
posing 45
coat 44.9
dressed 29.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 35-52
Gender Female, 57.8%
Sad 11.4%
Disgusted 1%
Confused 3.1%
Surprised 1.8%
Calm 75.3%
Angry 6.9%
Happy 0.6%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting

Clarifai

Human face
Clothing
Fashion accessory
Human mouth
Human eye
Human nose
Human arm
Human hand

AWS Rekognition

Person 90.5%

AWS Rekognition

Painting 64.9%

Clarifai

Human face 94.9%

Clarifai

Clothing 87.9%

Clarifai

Fashion accessory 42%

Clarifai

Fashion accessory 38.1%

Clarifai

Human mouth 41.4%

Clarifai

Human eye 40.6%

Clarifai

Human eye 37.5%

Clarifai

Human nose 38.5%

Clarifai

Human arm 36.7%

Clarifai

Human arm 33.8%

Clarifai

Human hand 35.6%

Categories

Imagga
created on 2018-03-23

events parties 58.9%
people portraits 40.8%
food drinks 0.2%
interior objects 0.1%

Captions

Microsoft
created by unknown on 2018-03-23

a man wearing a suit and tie 91.9%
a man wearing a costume posing for the camera 79.8%
a man wearing a bow tie 79.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a portrait of a man in a brown coat

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a man with a long white wig

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image depicts a portrait of an individual from a historical period wearing a formal, dark-colored coat that extends to mid-thigh. The subject also sports an elaborate white cravat, and their hair appears to be styled into long, cascading curls typical of the wigs worn in the 17th or 18th centuries. They are holding what seems to be a walking cane in their right hand, with a ring visible on the pinky finger of the same hand. They also have elegant white cuffs at the wrists, protruding from the sleeves of the coat. The overall style of the attire suggests formality and is indicative of high social status during the period from which the portrait seems to originate.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a classical 18th-century portrait painting depicting a figure in formal attire typical of that era. The subject is wearing a brown coat and a white cravat with elaborate ruffles. Most striking is the elaborate white powdered wig with tight curls that was fashionable among wealthy and important men of that period. The background is dark, creating a dramatic contrast with the pale skin tones and white wig. The painting style is typical of formal portraits from this time period, with careful attention paid to details like the fabric textures and the subject's features. It appears to be an oil painting on canvas, executed in the formal style that was popular for portraiture during the colonial period in America or similar era in Europe.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a portrait of a man wearing a brown coat and a white ruffled collar. He has a serious expression on his face and his hair is styled in a curly, powdered wig, which was a fashionable hairstyle during the 17th and 18th centuries. The man appears to be holding some kind of stick or cane in his hand. The painting has a dark background, highlighting the subject and drawing the viewer's attention to his face and attire.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-26

This is a formal 18th-century portrait painting featuring a figure in traditional colonial-era attire. The subject wears a brown coat and a white ruffled cravat or jabot at the neck. Most notably, they are wearing a dramatic powdered wig in the style of the period - long, curled, and white in color. The wig is quite elaborate with tight curls framing the face and flowing down the sides. The painting has a dark background typical of formal portraits from this era, and appears to be painted in oils. The subject is holding what appears to be a walking stick or cane, and there's a hint of some object or furniture in the background. The style and clothing are characteristic of wealthy or important members of colonial society in the early to mid-1700s.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

This image is a painting of a man from the 18th century.

The man has fair skin and is wearing a brown coat with a white cravat and a large, curly white wig. He is holding a black object, possibly a book or a cane, in his right hand. The man is also wearing a ring on his right hand.

The background of the painting is dark, which suggests that it was painted in a studio setting. The overall style of the painting is reminiscent of 18th-century portraiture, with attention to detail and a focus on capturing the subject's likeness.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a portrait of Johann Sebastian Bach, a renowned German composer and organist. The painting is rendered in oil on canvas and features Bach wearing a brown coat with a white ruffled collar and cuffs, complemented by a large, curly white wig. He holds a long, slender object in his left hand, possibly a musical instrument or a tool used for his work.

In the background, a dark, muted tone provides a subtle contrast to the subject's attire. A small, indistinct object is visible on the left side of the painting, adding depth to the composition without drawing attention away from Bach's central figure.

Overall, the portrait presents a dignified and introspective portrayal of Bach, capturing his essence as a master of Baroque music.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is a portrait of a man with a serious expression. He is dressed in a brown coat and a white scarf around his neck. He is also wearing a white wig with a curled style. The man is holding a pen in his right hand, and he is looking to the right. Behind him, there is a blurred background of what seems to be a globe.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image shows a portrait of a man with a serious expression. He is wearing a brown coat with a white collar and a white necktie. He has a large wig with a white ribbon and a golden ring on his left hand. The background is dark, and there is a globe on the left side of the portrait. The painting style is reminiscent of the 18th century.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here's a description of the image:

This is a portrait of a man in a brown coat and large, white, curly wig. The style of dress, wig, and coloring indicate that the painting is likely from the 18th century.

The man is depicted from the chest up. He has fair skin, slightly ruddy cheeks, and is looking directly at the viewer. The wig is large and full, curling around his face and down to his shoulders. A white cravat or neckcloth is tied around his neck. His brown coat appears to be made of a substantial fabric, and the cuffs of his sleeves have white ruffles. He is wearing a large gold ring on the ring finger of his left hand.

He is holding the neckcloth in his left hand. Behind him is a globe. The background is a dark, solid color that makes the subject stand out. The style of the painting is somewhat formal and likely meant to convey status and wealth.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

The image is a portrait painting of a man from the 18th century. He's wearing a brown coat with a white cravat and a long, white wig, characteristic of the period. He has a serious expression and is holding a folded piece of fabric, possibly part of his cravat or a scarf. His left hand is visible, with a ring on his finger. The background is a dark, neutral color, emphasizing the man's face and attire. The style is typical of portraiture from that era, with detailed features and an emphasis on the subject's clothing and accessories.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a portrait painting of a man dressed in historical attire. Here are some detailed observations:

  1. Attire:

    • The man is wearing a long, curly white wig, which was a common fashion in the 17th and 18th centuries.
    • He is dressed in a dark brown or black robe, which suggests he may be a judge, lawyer, or cleric.
    • A white cravat is visible around his neck, adding to the formal appearance.
    • He is also wearing a white shirt with ruffled cuffs, which are visible at his wrists.
  2. Accessories:

    • The man is holding a quill pen in his right hand, indicating he might be a writer, scholar, or involved in legal or administrative work.
    • There is a ring on his right hand, which might signify his status or profession.
  3. Background:

    • The background is dark and plain, which is typical for portraits of this period to keep the focus on the subject.
    • There is a small, partially visible object on the left side, which might be a book or a document holder, further suggesting a scholarly or professional context.
  4. Expression and Pose:

    • The man has a serious and composed expression, looking directly at the viewer.
    • His pose is formal and upright, reflecting the dignity and importance associated with his role or status.

Overall, the portrait depicts a man of apparent significance, likely from the 17th or 18th century, engaged in a professional or scholarly occupation.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-24

This image is a portrait painting of a man, likely from the 18th century, judging by the style of clothing and the wig. The man is dressed in formal attire, featuring a brown coat with a white collar and a large, elaborate white wig styled in curls. He is holding a cane in his left hand, with his right hand resting on the cane. The background is dark, which helps to emphasize the figure and his attire. The painting style is characteristic of European portraiture from the Baroque or Rococo period.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-24

This image is a portrait painting of a man dressed in 18th-century clothing. He is wearing a brown coat with a white cravat tied around his neck. The man has a powdered wig, which was fashionable during that era. He is holding what appears to be a small dagger or a similar object in his right hand. The background is dark, which helps to emphasize the subject. The overall style of the painting suggests it is from the Georgian period.

Text analysis

Google

ไ ก็
ก็