Human Generated Data

Title

Self-Portrait

Date

c. 1893-1899

People

Artist: James Abbott McNeill Whistler, American 1834 - 1903

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.930

Human Generated Data

Title

Self-Portrait

People

Artist: James Abbott McNeill Whistler, American 1834 - 1903

Date

c. 1893-1899

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.930

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 96.9
Painting 96.4
Person 93.6
Human 93.6

Clarifai
created on 2020-04-23

portrait 99.7
art 98.8
one 98.4
people 97.7
painting 97.5
wear 97.4
man 96.9
vintage 96.6
old 94.9
adult 93.1
texture 91
retro 90.9
book bindings 89.3
paper 85.7
antique 85.5
bill 82
dark 80.9
color 79.4
dirty 78.6
music 75.9

Imagga
created on 2020-04-23

man 34.2
male 32.7
person 23.9
black 23.1
old 22.3
people 20.1
adult 19.5
portrait 19.4
prison 19.3
correctional institution 15.5
dark 15
cell 14.3
businessman 14.1
face 13.5
working 13.2
wall 12.8
aged 12.7
grunge 11.9
happy 11.9
blackboard 11.7
penal institution 11.6
serious 11.4
room 11.2
men 11.1
suit 11.1
business 10.9
vintage 10.7
handsome 10.7
retro 10.6
computer 10.5
screen 10.4
looking 10.4
ancient 10.4
laptop 10.3
office 10
jacket 9.9
couple 9.6
antique 9.5
work 9.4
texture 9
human 9
covering 8.9
home 8.9
indoors 8.8
professional 8.7
light 8.7
book jacket 8.6
guy 8.6
clothing 8.4
senior 8.4
mature 8.4
window screen 8.3
alone 8.2
religion 8.1
boy 8.1
grandfather 8
book 8
executive 7.8
standing 7.8
art 7.8
institution 7.7
attractive 7.7
hand 7.6
tie 7.6
career 7.6
fashion 7.5
religious 7.5
close 7.4
elevator 7.4
double 7.3
design 7.3
smiling 7.2
lifestyle 7.2
protective covering 7.2
smile 7.1

Google
created on 2020-04-23

Portrait 90.5
Painting 84.8
Picture frame 78.6
Self-portrait 68.2
Art 58.1

Microsoft
created on 2020-04-23

human face 97.7
text 97.6
painting 96.2
person 93.5
portrait 88.4
electronics 83.4
drawing 73.1
old 67.7
clothing 66.4
loudspeaker 32.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-52
Gender Male, 99.8%
Angry 0.2%
Calm 93.6%
Disgusted 0.3%
Happy 0.8%
Fear 0.1%
Confused 0.3%
Surprised 0.4%
Sad 4.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 96.4%
Person 93.6%

Categories

Captions

Microsoft
created on 2020-04-23

an old photo of a man 70.8%
an old photo of a speaker 65.2%
a black and white photo of a man 62.1%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The image depicts a portrait of a person dressed in dark, formal clothing. The background is also dark, contributing to a moody and somber atmosphere in the painting. The figure stands with one hand on their hip, giving a sense of casual poise and confidence. The overall style suggests a classical approach to portraiture.

Created by gpt-4 on 2024-01-25

This image appears to be an old, dark-toned portrait showing an individual dressed in attire from a bygone era. The painting exhibits signs of age with its dusky hues and some visible wear, suggesting it may be a historical artifact. The subject is posed in a classic stance, standing upright and is seemingly depicted in subdued lighting, which adds to the somber and vintage quality of the painting.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image appears to be a portrait painting of a man with a pensive, contemplative expression on his face. The painting is rendered in dark, muted tones, with the subject's features emerging from the shadowy background. The man's gaze is directed away from the viewer, suggesting an introspective mood. The overall composition and style of the painting evoke a sense of somber introspection and emotional depth.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

This image appears to be a painting of a person, possibly a self-portrait, rendered in muted tones and featuring a dark background. The subject is depicted from the chest up, with their head turned slightly to the right. They have short hair and are wearing a dark-colored shirt or jacket. The painting's style suggests it may be an unfinished work or a study, as the details are not fully defined and the brushstrokes appear loose and expressive. The overall effect is one of simplicity and introspection, with the subject's gaze directed inward rather than outward at the viewer. The painting's dark background and muted color palette contribute to a somber and contemplative mood, inviting the viewer to reflect on the subject's emotions and thoughts. Despite its unfinished nature, the painting conveys a sense of depth and nuance, making it a compelling and thought-provoking work of art.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a painting of a man, likely created in the 17th century. The man is positioned in the center of the canvas, facing to the right. He has short dark hair and is dressed in a dark-colored shirt or jacket. His facial expression appears to be neutral, with a slight smile. The background of the painting is a deep, rich brown color, which provides a striking contrast to the man's dark attire. The overall effect is one of simplicity and elegance, with the artist focusing on capturing the subject's likeness and expression rather than creating a complex or elaborate composition. The painting is rendered in a realistic style, with attention to detail and texture evident in the brushstrokes and color palette. The artist's use of chiaroscuro, a technique that uses strong contrasts between light and dark to create a sense of volume and depth, adds depth and dimensionality to the image. Overall, the painting is a beautiful example of Baroque art, characterized by its use of light and shadow, its attention to detail, and its focus on capturing the human form.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image shows a painting of a man's face in a dark room. The man is wearing a black shirt and has a serious expression on his face. The painting is in black and white, and the man's face is illuminated by a light source that is coming from the right side of the image. The man's eyes are closed, and his mouth is slightly open. The painting is framed in a wooden frame.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image shows a painting of a person in a dark room. The person is wearing a black shirt and has a serious expression on his face. He is looking to the right, and his right hand is on his chest. The person's face is illuminated by a light source, which casts a shadow on the left side of his face. The painting is done in a realistic style, with attention to detail and shading.