Human Generated Data

Title

J. R. Scrofoloso

Date

1907

People

Artist: Denman Waldo Ross, American 1853 - 1935

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.68

Human Generated Data

Title

J. R. Scrofoloso

People

Artist: Denman Waldo Ross, American 1853 - 1935

Date

1907

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.68

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 97.3
Person 91.8
Human 91.8
Painting 78.8
Face 64.9

Clarifai
created on 2020-04-23

people 99.1
person 98.3
popularity 97.8
famous 96.1
talent 94.6
portrait 94.4
man 92.7
event 92.7
face 91.2
pop 91.1
old 89.7
painting 86.5
art 85.3
hair 85.1
one 83.9
profile 81.8
entertainment 81.5
head 80.2
color 77.7
brunette 76.7

Imagga
created on 2020-04-23

portrait 33
man 31.6
person 30.8
face 29.8
hair 27
people 25.1
male 20.6
eyes 18.1
smile 17.8
adult 17.5
old 17.4
expression 17.1
pretty 16.8
senior 15.9
love 15.8
one 15.7
happy 15.7
head 15.1
attractive 14.7
looking 14.4
sculpture 14.3
grandma 14.3
model 14
beard 13.2
human 12.7
black 12.7
handsome 12.5
couple 12.2
look 11.4
fashion 11.3
art 10.6
lady 10.6
guy 10.5
nose 10.5
boy 10.4
men 10.3
close 10.3
mature 10.2
lifestyle 10.1
statue 10
sexy 9.6
happiness 9.4
rustic 9.2
gray 9
romance 8.9
shower 8.9
closeup 8.8
hands 8.7
water 8.7
marriage 8.5
studio 8.4
life 8.3
smiling 8
women 7.9
together 7.9
brunette 7.8
ancient 7.8
depression 7.8
mother 7.8
health 7.6
bust 7.6
casual 7.6
bath 7.6
hand 7.6
emotion 7.4
skin 7.3
wig 7.3

Google
created on 2020-04-23

Face 96.9
Portrait 95.2
Painting 93.7
Chin 93.1
Self-portrait 90.9
Head 89.8
Forehead 88.5
Cheek 87.7
Nose 84.2
Ear 83.1
Art 78.6
Jaw 75
Neck 71.7
Visual arts 64.9
Illustration 50.4

Microsoft
created on 2020-04-23

drawing 98.8
painting 98.4
sketch 98
human face 95.8
person 88.4
portrait 87.6
text 80

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 8-18
Gender Female, 57.1%
Fear 0%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Happy 0%
Calm 93%
Surprised 0.1%
Sad 6.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 91.8%
Painting 78.8%

Categories

Imagga

pets animals 99.4%

Captions

Microsoft
created on 2020-04-23

a person looking at the camera 66%
a close up of a person 65.9%
a person taking a selfie 46.9%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-04

This is an artwork featuring a person with short, textured hair, shown from the back. The color palette includes earthy tones, with the individual's hair showing various shades of brown and blond highlights. They are wearing a dark-colored garment. The background of the painting consists of a textured green surface. The artist’s signature and some text in the bottom right corner of the painting provide additional context.

Created by gpt-4 on 2024-12-03

The image features a figure viewed from behind and slightly from the side. The individual is wearing a dark jacket with buttons, and their head is turned in a way that the ear and the nape of the neck are visible. Part of the hair can be seen, depicting short, possibly dark-colored hair with strokes of lighter colors, suggesting highlights or reflected light. The painting's background has a greenish hue with textures that might suggest aged or cracked paint, a common feature in older paintings. The left bottom corner of the image contains what appears to be a signature, though the precise text is not legible in this view. These characteristics indicate the image is a painting, possibly created with oil paints, typical of traditional portrait styles.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a portrait painting showing the profile view of a young person against a green background. The subject is wearing a dark, high-collared garment and has short brown hair. The painting style appears to be late 19th or early 20th century, with visible craquelure (a network of fine cracks) in the paint surface. The artist has captured a sense of youth and innocence in the portrait, with delicate rendering of the pale skin tones and subtle modeling of the features. The composition is simple but effective, with the profile positioned against the plain background to create a striking silhouette.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait painting of a young boy with light-colored hair and features. He is depicted in profile, facing to the right, with a serious expression. The background is a mottled green color, which gives the painting an aged or cracked appearance. The boy's clothing appears to be a dark jacket or coat. Overall, the painting has a somber and reflective quality to it.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a painting of a young boy, likely a portrait. The boy is shown in profile, facing left, with short brown hair and wearing a dark-colored shirt or jacket. The background of the painting is a muted green color, which may be intended to represent a wall or other setting. The overall style of the painting suggests that it may be a work of realism, with attention to detail and a focus on capturing the subject's likeness. The use of muted colors and the simple composition also give the painting a sense of intimacy and quiet contemplation. It is worth noting that the painting appears to be an oil painting, given the texture and brushstrokes visible in the image. The artist's signature is visible at the bottom of the painting, but it is not legible. Overall, the image presents a thoughtful and introspective portrait of a young boy, captured in a moment of quiet reflection.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a portrait of a young man, likely a self-portrait by the artist. The subject is shown in profile, facing left, with a serious expression. He has short, light-colored hair and wears a dark-colored shirt or jacket. The background is a muted greenish-brown color, which may be a wall or a natural setting. The painting style is realistic, with attention to detail in the subject's features and clothing. The overall effect is one of quiet contemplation, as if the subject is lost in thought.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image shows a painting of a boy with a serious expression. The boy has short, dark hair and is wearing a dark shirt. The painting is done in a realistic style, with a focus on capturing the details of the boy's face and expression. The background is a plain green color, which serves to highlight the boy's features. The painting appears to be well-preserved, with no visible damage or wear.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a painting of a young boy's face. The boy has light brown hair and is wearing a black shirt. The painting is in a realistic style, with attention to detail in the boy's facial features and hair. The background of the painting is a solid green color, which contrasts with the boy's face and hair. The painting appears to be an oil painting on canvas.

Text analysis

Amazon

Vuri.s
e
Im Vuri.s
e 2Sla
2Sla
Im