Human Generated Data

Title

The Reverend John Cotton of Newton

Date

c. 1735-1750

People

Artist: Attributed to John Smibert, American 1688 - 1751

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Richard M. and Laura T. Ames, 2023.480

Human Generated Data

Title

The Reverend John Cotton of Newton

People

Artist: Attributed to John Smibert, American 1688 - 1751

Date

c. 1735-1750

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Richard M. and Laura T. Ames, 2023.480

Machine Generated Data

Tags

Amazon
created on 2023-12-12

Art 100
Painting 100
Face 99.8
Head 99.8
Photography 99.8
Portrait 99.8
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Clothing 81.8
Coat 81.8

Clarifai
created on 2023-12-12

portrait 99.8
people 99.4
one 99.3
adult 98.8
man 98.5
art 96.6
elderly 95.9
leader 93.3
woman 93.3
wear 92.4
painting 90.4
religion 89.2
veil 89
sculpture 88.4
sword 88.1
indoors 87.3
music 83.7
jacket 80.5
facial hair 80.2
writer 80

Imagga
created on 2023-12-12

portrait 42.1
person 41
grandma 40
man 35.6
adult 34.4
senior 31.9
people 30.7
face 29.1
old 27.9
black 26.4
male 26.2
elderly 23.9
hair 23
expression 22.2
happy 21.3
mature 19.5
retired 18.4
handsome 17.8
attractive 17.5
looking 16.8
business 15.8
smile 15.7
lady 15.4
retirement 15.4
alone 14.6
lifestyle 14.5
wig 14.3
one 14.2
businessman 14.1
eyes 13.8
grandmother 13.7
dark 13.4
pretty 13.3
glasses 13
baron 12.8
gray 12.6
age 12.4
look 12.3
shirt 12.1
men 12
elder 11.8
aged 11.8
smiling 11.6
serious 11.4
fashion 11.3
elegant 11.1
rustic 11.1
attire 11
model 10.9
professional 10.7
hairpiece 10.7
older 10.7
human 10.5
clothing 10.4
suit 10.2
happiness 10.2
casual 10.2
studio 9.9
citizen 9.9
sexy 9.6
head 9.2
confident 9.1
health 9
closeup 8.8
work 8.6
grandfather 8.6
mother 8.6
hand 8.4
executive 8.1
eye 8
pensioner 7.9
cute 7.9
wrinkles 7.9
standing 7.8
hands 7.8
fun 7.5
manager 7.4
blond 7.4
success 7.2
body 7.2
love 7.1

Google
created on 2023-12-12

Microsoft
created on 2023-12-12

painting 99
human face 96.9
person 96.3
art 94.8
drawing 94.7
portrait 91
sketch 81.7
clothing 69.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 67-75
Gender Male, 100%
Calm 99.4%
Confused 0.1%
Surprised 0.1%
Happy 0%
Sad 0%
Angry 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 63
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Coat
Person 99.4%
Adult 99.4%
Male 99.4%
Man 99.4%
Coat 81.8%

Categories

Imagga

events parties 75.5%
people portraits 24.3%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-02

This is a classical portrait of a person dressed in traditional 18th-century attire. The individual is wearing a prominent white powdered wig with tight curls, a common fashion during that period. The clothing includes a dark, formal coat with a high collar, buttoned down the front, paired with a white cravat or neckcloth that is elegantly tied and drapes down in front. The backdrop is dark and plain, drawing attention to the detailed and formal attire of the subject.

Created by gpt-4 on 2024-12-03

The painting depicts a person dressed in attire typical of a past era, likely the 17th or 18th century, considering the style of the haircut and clothing. The individual is wearing a dark, formal coat with buttons and what appears to be a white cravat or neckcloth at the collar. The hair is styled in a manner that suggests wig-wearing customs of the period, with curls cascading down sides. The background is dark and somewhat indistinct, serving to highlight the figure in the foreground. The image presents a dignified and perhaps authoritative pose, common in portraiture of the time to convey stature and respectability.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a classical portrait painting, likely from the 18th century, showing a figure in formal attire characteristic of that era. The subject wears a dark coat and a white cravat or necktie, and has a distinctive grey powdered wig with elaborate curls, which was fashionable for men of status during that period. The painting is executed in a traditional style against a dark background, creating a dramatic contrast with the subject's clothing and wig. The painting technique and style are typical of formal portraiture from the Georgian or late Stuart period in British art.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait of a man with curly white hair wearing a black robe and a white collar. His facial expression is serious, and he has a thoughtful or contemplative look. The portrait is painted in a classic style, suggesting it may be from a historical period. The dark background contrasts with the light coloring of the man's face and clothing, drawing the viewer's attention to the central figure.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

The image is a portrait of an older man with long, curly white hair and a black jacket with a white cravat. The man is depicted in a formal pose, with his head turned slightly to the right. He has a serious expression on his face, with a slight furrowed brow and a pursed mouth. His eyes are cast downward, giving the impression that he is lost in thought. The man's hair is long and curly, falling down his back in loose waves. It is a pure white color, with no visible signs of gray or brown. His jacket is black, with a high collar and a white cravat tied loosely around his neck. The cravat is made of a smooth, silky material and is tied in a simple knot at the front of his neck. The background of the image is dark and indistinct, with no visible details or features. It appears to be a plain black or dark brown color, which helps to focus attention on the man's face and clothing. Overall, the image presents a dignified and formal portrait of an older man, with a sense of gravity and seriousness.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image presents a portrait of a man with curly hair, rendered in a style reminiscent of 18th-century European art. The subject is depicted from the chest up, facing forward with a neutral expression. His attire consists of a black jacket with a high collar and a white cravat, which adds a touch of elegance to the overall appearance. The man's curly hair is a notable feature, with its light color contrasting against the darker background. The painting itself appears to be an oil on canvas work, with visible brushstrokes and texture that contribute to its aged and worn appearance. The dark background, likely a deep brown or black, serves to accentuate the subject's features and create a sense of depth. Overall, the portrait exudes a sense of refinement and sophistication, characteristic of the artistic styles prevalent during the 18th century. The subject's expression is calm and introspective, inviting the viewer to ponder his thoughts and emotions. The image is a testament to the skill of the artist who created it, capturing the essence of the subject with remarkable detail and nuance.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a portrait of a man, possibly a historical figure or a notable individual from the past. The man is dressed in a black suit with a white collar and a white necktie, giving him a formal and dignified appearance. His hair is styled in a powdered wig, which was a common fashion trend during the 18th century. The portrait is painted in a realistic style, with attention to detail in the man's facial features and clothing. The background of the portrait is dark, which helps to highlight the subject and draw the viewer's attention to the man's face. Overall, the image portrays a man of importance or status, possibly a politician, a judge, or a member of the aristocracy.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is an oil painting of a man. The painting depicts the man's head and shoulders. The man has a full head of white hair, styled in a wig. He is wearing a black jacket with a white scarf around his neck. The man's eyes are looking to the left of the image. The background of the painting is dark. The painting is framed in a golden frame.

Text analysis

Google

Mak