Human Generated Data

Title

Untitled (Jaspar Lancaster, rehabilitation client, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1598

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Jaspar Lancaster, rehabilitation client, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1598

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Sun Hat 100
Face 96.9
Head 96.9
Photography 96.9
Portrait 96.9
Cowboy Hat 55.9
Coat 55.5

Clarifai
created on 2018-05-11

people 99.9
lid 99.7
one 99.6
adult 98.9
veil 98.9
man 98.7
portrait 98.4
fedora 96.5
elderly 95.9
wear 95.5
leader 90
cowboy 90
cowboy hat 89.1
facial expression 87.9
two 87
actor 83.2
sit 82.7
indoors 81.4
retro 80.3
administration 77.9

Imagga
created on 2023-10-05

cowboy hat 100
hat 100
headdress 100
clothing 81.7
consumer goods 39.8
covering 39.4
portrait 31.7
person 30.2
cowboy 28.5
male 28.4
man 28.2
happy 25.1
face 23.5
smile 22.8
people 22.3
adult 20.7
western 19.4
boy 19.2
senior 18.8
shirt 18.7
model 18.7
hair 18.3
fashion 18.1
outdoors 17.9
smiling 16.7
pretty 16.1
sombrero 15.7
attractive 15.4
wearing 15.2
kid 15.1
black 15
child 15
handsome 14.3
lifestyle 13.7
sexy 13.7
cute 13.6
looking 13.6
hand 12.9
eyes 12.9
guy 12.9
expression 12.8
fun 12.7
style 12.6
old 12.6
posing 12.5
one 12
children 11.9
straw 11.6
outside 11.1
casual 11
leisure 10.8
cheerful 10.6
two 10.2
pose 10
cowgirl 9.9
human 9.8
brunette 9.6
happiness 9.4
blond 9
standing 8.7
men 8.6
gesture 8.6
youth 8.5
skin 8.5
dark 8.4
hold 8.3
gorgeous 8.2
country 7.9
denim 7.9
mysterious 7.8
play 7.8
summer 7.7
mystery 7.7
elderly 7.7
costume 7.6
serious 7.6
head 7.6
joy 7.5
mature 7.4
brown 7.4
lady 7.3
make 7.3
farm 7.1
romantic 7.1
love 7.1
travel 7
look 7

Microsoft
created on 2018-05-11

person 99.6
man 99.2
hat 80.9
old 79.2
headdress 75.7
older 36.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Hat
Adult
Male
Man
Person

Clarifai

Man
Human face
Sun hat
Plant
Human eye
Human nose
Human mouth

AWS Rekognition

Hat 99.5%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Male 99.4%

AWS Rekognition

Man 99.4%

AWS Rekognition

Person 99.4%

Clarifai

Man 93.8%

Clarifai

Human face 93.2%

Clarifai

Human face 35.9%

Clarifai

Sun hat 59.7%

Clarifai

Plant 47.7%

Clarifai

Human eye 41.9%

Clarifai

Human eye 41.5%

Clarifai

Human nose 40.1%

Clarifai

Human mouth 38.2%

Categories

Imagga
created on 2023-10-05

paintings art 62.8%
people portraits 35.9%

Captions

Microsoft
created by unknown on 2018-05-11

a man wearing a hat 96.3%
a man wearing a hat posing for the camera 95.6%
a man wearing a black hat 94.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man in a hat and a hat

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of a man wearing a straw hat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a person wearing a wide-brimmed straw hat with ventilation holes. The individual is dressed in a worn, light-colored jacket over a partially visible shirt or undershirt. In the background, there is a wire fence entwined with leafy vines, and what appears to be part of a wooden structure. The atmosphere suggests an outdoor or rustic setting.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a person wearing a straw hat with small circular holes on the crown. The individual is dressed in a light-colored collared jacket or shirt. In the background, there are leafy plants, possibly vines, draped over a wire fence, and wooden structures are visible behind the fence. The photograph appears to be in black and white, suggesting it may have been taken some time ago.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a man wearing a straw hat, standing in front of some foliage. The man has a serious expression on his face and appears to be an older gentleman. The image is in black and white, giving it a vintage feel. The background includes some leafy plants or vines, creating a natural setting for the portrait.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-18

The black and white photograph depicts a man wearing a straw hat and light-colored jacket or coat, standing in front of a fence or trellis with leaves or vines growing on it. The man has a serious or pensive expression on his face and appears to be middle-aged or older based on the lines and wrinkles visible. The image has an aged, vintage quality to it, suggesting it was taken some time ago.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, likely the 1930s or 1940s. The image shows a person wearing a light-colored work jacket and a wide-brimmed straw hat with small holes in the crown for ventilation. The subject is photographed outdoors, with foliage visible in the background, and there appears to be some kind of wire fencing or mesh behind them. The photograph has a documentary or journalistic quality typical of Depression-era photography. The lighting and composition create a striking portrait that captures the rural or agricultural setting of the time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man wearing a straw hat and a light-colored jacket, posing in front of a fence with leaves hanging from above.

The man has short dark hair and is looking at the camera with a neutral expression. He is wearing a wide-brimmed straw hat with holes in it, and a light-colored jacket that appears to be made of linen or cotton. The jacket is open, revealing a light-colored shirt underneath.

In the background, there is a wire fence with leaves hanging from above. The leaves are green and have a heart-shaped appearance. The overall atmosphere of the image suggests that the man is posing for a photo in a casual setting, possibly outdoors.

The image has a vintage feel to it, with a white border around the edges and a number "33" handwritten in the bottom-right corner. The overall effect is one of simplicity and elegance, with the man's neutral expression and the natural surroundings creating a sense of calm and serenity.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man wearing a straw hat and a light-colored jacket, standing in front of a wire fence with leaves hanging over it. The man has short dark hair and is looking at the camera with a neutral expression. He is wearing a wide-brimmed straw hat with a pointed top and a light-colored jacket that is unbuttoned, revealing his chest. The background of the image is a wire fence with leaves hanging over it, suggesting that the man is standing outdoors, possibly in a garden or a field. The overall atmosphere of the image is one of simplicity and rustic charm, with the man's casual attire and the natural surroundings creating a sense of ease and relaxation.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man wearing a straw hat and a white shirt. The man is standing in front of a fence, with plants hanging from it. The man has a serious expression on his face, and his shirt appears to be slightly wrinkled. The image has a vintage look, and it appears to be an old photograph.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man. He is wearing a hat with holes in it, and a shirt with a collar. He is standing in front of a fence that is covered in climbing plants. The man appears to be looking to his right. The photograph is cropped close to the man's head and shoulders, and the background is out of focus.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

Here's a description of the image:

The image is a black and white photograph of a middle-aged man wearing a straw hat. The man appears to be standing in front of a wire fence, with foliage visible in the background. He's wearing a light-colored jacket or shirt that is open at the collar. The man's expression is calm and somewhat thoughtful. His hat has a wide brim and a patterned design of holes at the top. The overall composition is a portrait, with the man being the primary subject. The image has a vintage feel, likely due to the black and white format. The number "33" is faintly visible at the bottom right corner of the image.

Created by gemini-2.0-flash-lite on 2025-05-29

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white portrait of a man. He is the central focus, positioned against a simple outdoor background. The photograph appears to be from an older time period, perhaps the mid-20th century.

Description of the Man:

  • Attire: He's wearing a light-colored, open-collared jacket or shirt. He's also wearing a wide-brimmed straw hat.
  • Facial Features: The man has a gentle expression, with a slight smile. He has a narrow face, with a thin nose and high cheekbones. His gaze is directed towards the camera.
  • Age/Appearance: He appears to be middle-aged or older. His features suggest a lifetime spent outdoors.

Background:

  • A wire fence is visible in the middle ground.
  • Behind the fence, there seems to be a wooden structure or building.
  • Above the man's head and on the upper left, there are leafy vines, adding some visual interest and possibly suggesting an outdoor or agricultural setting.

Mood & Context:

The image evokes a sense of quiet dignity and a connection to the land. The man's attire and the natural surroundings suggest a rural lifestyle or perhaps a depiction of someone working in the fields. It could be a portrait capturing the era's work and lifestyle.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph of a man standing outdoors. He is wearing a wide-brimmed straw hat with ventilation holes and a light-colored, long-sleeved jacket. The jacket appears to be somewhat worn and has visible signs of use, such as dirt or stains. The man's shirt is unbuttoned at the top, revealing his chest. He has a serious expression on his face and is looking directly at the camera.

Behind him, there is a wooden structure that appears to be part of a building or fence. There are also some hanging plants with heart-shaped leaves visible in the background. The photograph has a vintage feel, suggesting it might be from an earlier era. The number "33" is visible in the bottom right corner of the image, possibly indicating a catalog or reference number.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image is a black-and-white photograph of a man standing outdoors. He is wearing a straw hat with a wide brim and eyelets on the top, which suggests a design for ventilation. The man is dressed in a light-colored, long-sleeved shirt that appears slightly worn and dirty, indicating he might have been working in an outdoor setting. Behind him, there is a wire fence and green foliage, suggesting the photo was taken in a rural or garden-like environment. The overall mood of the photograph is casual and candid, possibly capturing a moment in the man's day. The number "33" is visible in the bottom right corner, which could indicate this is part of a series or collection of photographs.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This is a black-and-white photograph of a man wearing a straw hat and a light-colored, short-sleeved shirt. He is standing in front of a wall with some vines growing on it. The man appears to be outdoors, possibly in a rural or garden setting. The image has a vintage quality, suggesting it may be from an earlier time period. The number "33" is visible in the bottom right corner of the photograph.

Text analysis

Amazon

33