Human Generated Data

Title

Self-Portrait

Date

1876

People

Artist: Pierre-Auguste Renoir, French 1841 - 1919

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest from the Collection of Maurice Wertheim, Class of 1906, 1951.61

Human Generated Data

Title

Self-Portrait

People

Artist: Pierre-Auguste Renoir, French 1841 - 1919

Date

1876

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest from the Collection of Maurice Wertheim, Class of 1906, 1951.61

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Painting 99.7
Art 99.7
Human 82.3
Person 82.3
Photo 56.8
Face 56.8
Photography 56.8
Portrait 56.8

Clarifai
created on 2018-03-16

painting 99.9
people 99.6
Impressionism 99.3
art 99.2
illustration 96.6
adult 93.3
man 92.8
one 92.5
print 91.9
wear 91.2
portrait 90
lid 88.9
smoke 86.5
painter 85.5
veil 81.2
artistic 70.5
pastel 70.3
mustache 66.6
palette 66.5
retro 66.4

Imagga
created on 2018-03-16

person 33.6
hat 25.4
portrait 25.2
fashion 24.9
people 24.5
attractive 24.5
man 24.2
face 23.4
model 23.3
adult 23.3
rustic 21.5
male 21.3
sexy 19.3
hair 17.4
dress 17.2
posing 16.9
costume 16.1
covering 15.5
pretty 15.4
dark 15
old 13.2
eyes 12.9
sensual 12.7
lady 12.2
human 12
clothing 12
evil 11.7
horror 11.6
black 11.6
mystery 11.5
guy 11.3
one 11.2
wall 11.1
make 10.9
handsome 10.7
happy 10.6
jacket 10.5
body 10.4
book jacket 10.4
lifestyle 10.1
cute 10
water 10
sensuality 10
fantasy 9.9
witch 9.8
style 9.6
brunette 9.6
sorcerer 9.5
skin 9.5
rain 9.4
expression 9.4
studio 9.1
pose 9.1
outdoors 9
boy 8.7
fear 8.7
erotic 8.6
seductive 8.6
outdoor 8.4
mature 8.4
emotion 8.3
art 8.2
cowboy 8.1
looking 8
look 7.9
couple 7.8
forest 7.8
rock 7.8
mysterious 7.8
elegant 7.7
elegance 7.6
senior 7.5
movie 7.5
makeup 7.3
smiling 7.2
active 7.2
cloak 7.2
romantic 7.1
smile 7.1
women 7.1
love 7.1
summer 7.1
spring 7.1

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

drawing 72.2
abstract 52.3
painting 16.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 69.1%
Calm 66.1%
Angry 1.5%
Disgusted 20.3%
Happy 2.5%
Confused 3.9%
Surprised 5.2%
Sad 0.5%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.7%
Person 82.3%

Captions

Microsoft
created on 2018-03-16

a close up of a person 63.8%
a man and a woman taking a selfie 10.4%
a person taking a selfie 10.3%

OpenAI GPT

Created by gpt-4 on 2024-01-27

This image depicts a painting with a figure dressed in a dark coat with a hint of a greenish hue, and an apparent white collar or scarf giving a contrast to the darkness of the coat. The background is divided into two distinct sections with contrasting colors and textures: The left side features bold, dark blue brush strokes, while the right side displays a gentler mix of green and pink vertical strokes that suggest a different, lighter space or possibly a wall. The brushwork throughout is loose, with visible, expressive strokes conveying movement and depth. The general feel is impressionistic, capturing a moment with an emphasis on the interplay of color and light.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image appears to be a portrait painting of a man. The painting depicts the man in a thoughtful pose, wearing a hat and coat, with a pensive expression on his face. The background is composed of loose, expressive brushstrokes in shades of blue and green, creating a sense of movement and atmosphere around the subject.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image is a painting of a man in a hat, created by Pierre-Auguste Renoir. The man is depicted wearing a dark-colored hat and coat, with a white shirt and black tie visible underneath. He has a short beard and mustache, and his hair is dark brown. The background of the painting is a muted greenish-gray color, with some brushstrokes visible. The overall effect is one of softness and subtlety, with the focus on the subject's face and expression. The painting appears to be an example of Impressionist art, characterized by its use of light colors and loose brushstrokes.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a portrait painting of a man, likely created in the late 19th or early 20th century. The painting is in the style of Impressionism, characterized by soft brushstrokes and a focus on capturing the play of light and color. The man in the painting is depicted wearing a dark suit and hat, with a white shirt and tie visible beneath his jacket. He is looking directly at the viewer with a serious expression, and his face is rendered in fine detail. The background of the painting is a muted greenish-brown color, which provides a subtle contrast to the darker tones of the subject's clothing. Overall, the painting is a beautiful example of Impressionist art, with its focus on capturing the subtleties of light and color and its use of soft, expressive brushstrokes.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a painting of a man wearing a hat and a suit. The painting is done in a realistic style, with a focus on capturing the subject's likeness and personality. The man is depicted in a three-quarter view, with his head turned slightly to the right. He has a mustache and a beard, and his eyes are looking straight ahead. The painting is done in a palette of warm colors, with the man's suit being a deep blue or green, and the background being a mix of browns and greens. The painting appears to be a portrait, possibly of a historical figure or a notable person from the artist's time.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image depicts a man wearing a hat and a suit, painted in a style that resembles impressionism. The man's face is painted with a few strokes of paint, giving it a somewhat blurry and abstract appearance. The man's eyes are painted in a way that suggests he is looking at something in front of him. The background is painted in a way that suggests it is a wall, with a few strokes of paint that give it a somewhat blurry and abstract appearance.