Human Generated Data

Title

Three Male Heads from “The Capitulation of Madrid, December 4, 1808

Date

after 1810

People

Artist: Antoine-Jean Gros, French 1771 - 1835

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Arthur K. and Mariot F. Solomon Collection, 2021.193

Human Generated Data

Title

Three Male Heads from “The Capitulation of Madrid, December 4, 1808

People

Artist: Antoine-Jean Gros, French 1771 - 1835

Date

after 1810

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Arthur K. and Mariot F. Solomon Collection, 2021.193

Machine Generated Data

Tags

Amazon
created on 2021-10-01

Person 97.9
Human 97.9
Painting 97.9
Art 97.9
Person 97.1
Face 83.2
Portrait 67.5
Photography 67.5
Photo 67.5

Clarifai
created on 2023-10-13

people 99.9
painting 99.8
facial hair 99.6
portrait 98.4
man 98.4
mustache 97.3
adult 97
religion 94.9
art 93.8
one 93.3
goatee 90.2
Renaissance 85
veil 84.9
leader 84.5
facial expression 83.1
wear 80
three 77.3
two 76.6
group 76.4
lid 76.2

Imagga
created on 2021-10-01

man 37.6
person 33
face 32.7
couple 30.5
male 29.8
portrait 29.1
people 29
love 26
hair 25.4
adult 25.3
attractive 21.7
beard 21.2
model 18.7
together 17.5
sexy 16.9
mustache 16.7
smile 16.4
happy 16.3
handsome 16
looking 16
black 15.6
romance 15.2
fashion 15.1
pretty 14.7
wig 14.7
eyes 14.6
two 14.4
happiness 14.1
double 13.9
husband 13.8
costume 13.7
expression 13.7
casual 13.6
human 13.5
head 13.4
married 13.4
senior 13.1
one 12.7
guy 12.6
wife 12.3
smiling 12.3
look 12.3
clothing 12
men 12
hat 12
emotion 12
style 11.9
old 11.8
attire 11.6
romantic 11.6
marriage 11.4
hairpiece 11
dark 10.9
studio 10.6
skin 10.6
boy 10.4
women 10.3
girls 10
grandma 10
covering 9.9
fun 9.7
depression 9.7
close 9.7
sensual 9.1
sensuality 9.1
outdoors 9
lady 8.9
family 8.9
posing 8.9
lifestyle 8.7
cute 8.6
mask 8.5
youth 8.5
relationship 8.4
mature 8.4
make 8.2
pose 8.2
grandfather 7.9
sadness 7.8
mysterious 7.8
world 7.7
elderly 7.7
erotic 7.6
glasses 7.4
crazy 7.3
gray 7.2
eye 7.1
mother 7.1

Google
created on 2021-10-01

Forehead 98.5
Nose 98.4
Hair 98.3
Cheek 97.9
Hairstyle 95.1
Eyebrow 94.3
Beard 89.5
Jaw 88.1
Art 85.8
Painting 85.8
Facial hair 85.3
Moustache 75.9
Visual arts 71.3
Illustration 70.9
Drawing 69.6
Event 66.2
Self-portrait 64.4
Vintage clothing 64.4
Eyelash 63.8
Room 62.3

Microsoft
created on 2021-10-01

man 99.6
painting 98.9
human face 98.6
drawing 98.4
sketch 96
person 95.2
art 89.9
text 80.6
portrait 75.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 99.6%
Calm 87.8%
Surprised 8.5%
Confused 1.3%
Angry 0.8%
Sad 0.6%
Disgusted 0.6%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 13-25
Gender Male, 94.7%
Fear 56.5%
Sad 14.1%
Confused 10.7%
Surprised 9.3%
Calm 5.9%
Angry 1.9%
Disgusted 1%
Happy 0.6%

AWS Rekognition

Age 22-34
Gender Male, 97.7%
Calm 83.6%
Sad 6.3%
Surprised 4.4%
Fear 1.7%
Confused 1.3%
Angry 1.1%
Disgusted 0.8%
Happy 0.8%

AWS Rekognition

Age 22-34
Gender Male, 99.5%
Calm 91.9%
Surprised 4.6%
Confused 1.1%
Angry 0.6%
Sad 0.6%
Disgusted 0.6%
Fear 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 97.9%
Person 97.1%
Painting 97.9%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-11-15

The image appears to be a classical painting depicting a person in profile from the neck up. The individual has dark hair that is tousled and appears texturally detailed. The ear is visible and well-defined, and there is a hint of a dark garment or cloak draped around the shoulders, signifying a style that may be from a past era. The painting style suggests fine brushwork with attention to shading and contours to create a lifelike representation. The colors are subdued, with earthy tones and a soft background that does not distract from the subject. Two squares have been placed over the painting, obscuring some details and focusing the viewer's attention on the remaining visible portions.

Created by gpt-4o-2024-05-13 on 2025-01-01

This image depicts an oil painting with a classic, Renaissance-era style. The painting features individuals with detailed textures in their hair and clothing. The left side shows a person with dark, slightly wavy hair and a beard, turning their head to the side. The right side portrays a person wearing a hooded garment, which casts shadows over their head and shoulders. The backdrop is a muted, grey-blue background that does not distract from the central figures. The painting utilizes rich, earthy tones, contributing to its historical and dramatic feel.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a classical oil painting showing three figures in a close-up portrait style composition. The painting features dramatic lighting and rich brown tones. The leftmost figure has distinctive dark, tousled hair and facial hair, shown in profile with strong features. In the middle, there's a figure wearing what appears to be a red head covering. The rightmost figure wears a brown cap or hat and has a more subdued, melancholic expression. The painting style appears to be from the Baroque or Romantic period, with its emphasis on emotional expression and dramatic lighting. The brushwork is loose but skillful, particularly in rendering the facial features and clothing textures.

Created by claude-3-haiku-20240307 on 2024-11-14

The image appears to depict two male figures, both with distinct facial features and expressions. The man on the left has a more youthful, intense gaze, while the man on the right appears older and more weathered, with a pensive, thoughtful expression. The painting style is expressive and emotive, with bold brushstrokes and a warm, earthy color palette. The composition draws the viewer's attention to the interplay between the two figures, suggesting a narrative or interaction between them.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

The image depicts a painting of three men, each with distinct facial expressions and attire. The man on the left has dark hair and wears a black shirt, while the man in the middle sports a red hat and a brown coat. The man on the right is dressed in a brown hat and a brown coat. The background of the painting is a muted gray color, which helps to focus attention on the three men. The overall atmosphere of the image suggests that it may be a historical or artistic representation of a scene from the past.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a painting of three men, each with distinct facial expressions. The man on the left has dark hair and a beard, wearing a dark shirt, and appears to be looking at the man in the middle with a serious or concerned expression. The man in the middle is wearing a red bandana and has a beard, and his face is partially obscured by the man on the left. He also seems to be looking at the man on the left with a serious or concerned expression. The man on the right has dark hair and is wearing a brown hooded cloak, and he appears to be looking at the man in the middle with a serious or concerned expression. The background of the painting is a muted gray color, which helps to focus attention on the three men. The overall atmosphere of the painting suggests that the three men are engaged in a serious conversation or discussion, possibly about a matter of great importance. The use of muted colors and the serious expressions on the men's faces contribute to a sense of gravity and intensity in the painting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a painting depicting three men, all of whom have beards and are wearing hats. The man on the left has a mustache and is looking at the man in the middle, who is wearing a red hat. The man on the right is wearing a brown hat and is looking at the man in the middle. The painting is in a style that is reminiscent of a portrait painting.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts three men with beards. The man on the left is wearing a black shirt and a brown coat. He is looking at the man in the middle, who is wearing a red hat and a brown coat. The man on the right is wearing a brown hat and a brown coat. He is looking at the man in the middle. The background is blurry, and it seems to be a gray wall.