Human Generated Data

Title

A Tejon Serrano

Date

1924

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.124.12

Human Generated Data

Title

A Tejon Serrano

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Date

1924

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.124.12

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Face 99.9
Human 99.9
Head 96.9
Person 93.4
Portrait 84.1
Photography 84.1
Photo 84.1
Man 62.2
Art 61
Wood 60.4

Clarifai
created on 2023-10-25

portrait 100
people 99.8
art 99.5
sepia 99.5
one 99.3
old 99
man 98
vintage 97.9
sepia pigment 97.7
adult 96.1
painting 93.5
antique 92.8
leader 92.6
facial hair 91.1
wear 90.5
veil 90.1
mustache 89.8
profile 89.1
retro 88.9
print 88.5

Imagga
created on 2022-01-09

portrait 40.8
man 38.4
grandma 37.1
face 30.6
male 30
person 27.7
adult 25.3
grandfather 25
people 24
old 23
senior 20.7
hair 20.6
statue 19.8
mature 19.6
one 19.4
close 18.3
serious 18.1
expression 17.9
beard 17.8
head 16
human 15.8
elderly 15.3
looking 15.2
men 14.6
sculpture 14.6
handsome 14.3
black 13.8
eyes 13.8
retired 13.6
guy 12.8
world 12.4
money 11.9
happy 11.9
currency 11.7
casual 11
model 10.9
retirement 10.6
age 10.5
boy 10.5
closeup 10.1
mug shot 10.1
cash 10.1
smile 10
aged 10
gray 9.9
sad 9.7
aging 9.6
nose 9.6
bill 9.5
thinking 9.5
dollar 9.3
look 8.8
depression 8.8
smiling 8.7
lifestyle 8.7
art 8.5
pensioner 8.5
bow tie 8.4
representation 8.4
emotion 8.3
skin 8.2
mother 8.1
photograph 7.8
spectacles 7.8
thoughtful 7.8
necktie 7.7
attractive 7.7
culture 7.7
hand 7.6
life 7.6
shirt 7.6
dark 7.5
bust 7.4
banking 7.4
bank 7.2
eye 7.2

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.1
text 97.7
human face 97.4
man 97.3
book 95.3
portrait 87.5
wrinkle 51
staring 17.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 99.5%
Sad 67.6%
Calm 25.9%
Disgusted 2.8%
Confused 1.6%
Fear 1%
Angry 0.5%
Surprised 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 93.4%

Categories

Imagga

paintings art 99.6%

Captions

Microsoft
created by unknown on 2022-01-09

a man holding a book 34.4%
a man looking at a book 34.3%
a man looking at the camera 34.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a man with a mustache and a beard -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image features sepia-toned shading and depicts the upper torso of a person wearing a collared shirt. The shirt appears to be made of a textured fabric, possibly cotton, with noticeable folds and creases. The background transitions into a soft blur, enhancing the depth of the composition. The person's hair displays distinct textures and shading, conveying a natural, slightly tousled appearance.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a sepia-toned portrait with a focus on the textures and details of the person's clothing and hair. The lighting highlights the person's hair texture, showing strands with a slight sheen. The clothing is a collared shirt, which appears to be made of a soft fabric that has gentle folds and shadows, suggesting a relaxed fit. The sepia tone gives the image a vintage aesthetic, with warm, brown hues and soft contrasts. The overall composition emphasizes detail and texture in the visible areas.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image is a sepia-toned photograph of an elderly man, likely a Native American, with short hair and wrinkles on his face. He is wearing a collared shirt.

  • The man has short hair that is slightly tousled.
    • His hair is light-colored and appears to be thinning at the temples.
    • There are no visible signs of facial hair or jewelry.
  • The man's face is wrinkled and aged, with deep lines around his eyes and mouth.
    • His eyes are dark and sunken, with a tired expression.
    • His nose is slightly crooked, and his lips are thin and pressed together.
  • The man is wearing a collared shirt that is buttoned up to the neck.
    • The shirt appears to be made of a lightweight material, possibly cotton or linen.
    • The collar is stiff and stands up straight, giving the man a somewhat formal appearance.

Overall, the image presents a somber and introspective portrait of an elderly man, with a focus on his weathered face and worn clothing. The sepia tone adds a sense of nostalgia and timelessness to the image, suggesting that it may have been taken many years ago.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

The image is a sepia-toned photograph of an elderly man, likely a Native American, with a serious expression. The man has short hair and wears a collared shirt. The background is dark, and the overall atmosphere suggests a formal portrait. The image appears to be an old photograph, possibly from the early 20th century, given the style and tone.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-30

The image is a black-and-white photograph of a person. The photograph is taken from the front, focusing on the person's face. The person is an old man with a wrinkled face, white hair, and a white beard. The man is wearing a shirt with a collar, and a scarf is wrapped around his neck. The man's eyes are slightly squinted, and his mouth is slightly open.

Created by amazon.nova-lite-v1:0 on 2025-05-30

The image is a sepia-toned portrait photograph of an elderly man. He has grayish hair that is short and messy, giving him a rugged appearance. His face is wrinkled and weathered, showing signs of age. The man's eyes are slightly squinting, and he has a serious expression. He is wearing a long-sleeved shirt that is slightly wrinkled and appears to be made of a light-colored fabric. The photograph has a vintage feel, with a slightly blurred background and a white border around the edges.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

The image is a sepia-toned portrait of a man with distinct indigenous features. His face is marked with the lines and wrinkles of age, conveying a sense of experience and history. The man's hair is thick and slightly tousled, framing his face. He is wearing a simple button-down shirt that is slightly unbuttoned at the collar.

The photograph is a close-up, focusing on the man's face and upper body. The background is a soft, blurred brown, which helps to highlight the subject of the portrait. The overall composition and use of sepia tones give the image a vintage or historical feel, suggesting it may be an older photograph or a stylized modern interpretation. At the bottom of the image, text appears, indicating it is "A TEJON SERRANO" and includes copyright and publishing information.

Created by gemini-2.0-flash-lite on 2025-05-17

Here is a description of the image:

The image is a sepia-toned portrait of a man, identified as "A. Tejon Serrano" at the bottom. The photograph is a close-up, focusing on the man's face and upper torso.

The man has weathered skin with prominent wrinkles, suggesting age and experience. His hair is short and light in color, with a slightly tousled texture. He is wearing a collared shirt. The lighting emphasizes the shadows and textures on his face, giving the photograph depth and character.

The photograph has a classic, almost antique feel, likely due to its monochrome coloring and the style of the photography. The background is a plain, blurry sepia color, making the man the clear focus of the image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a sepia-toned photograph of an elderly man. The photograph appears to be a portrait, focusing on the man's face and upper body. The man has a weathered and wrinkled face, indicating advanced age. He has short, tousled hair and is wearing a collared garment, possibly a shirt or coat. The background is blurred, drawing attention to the subject's face. The photograph has a vintage quality, suggesting it may be from the early 20th century. At the bottom of the image, there is text that reads "A Tejon Serrano," which likely refers to the subject's tribal affiliation or cultural background. The overall tone of the image is somber and reflective, capturing the dignity and character of the elderly man.

Text analysis

Amazon

513
TEJON
BERRANO
Plato 513
Plato
A TEJON BERRANO
A
anything
Boy
Son anything
IS
the
the Boy IS Best
Son
Best

Google

Plato 513 A TEJON BERRANO
Plato
513
A
TEJON
BERRANO