Human Generated Data

Title

Rehabilitation client, Boone County, Arkansas

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3060

Human Generated Data

Title

Rehabilitation client, Boone County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3060

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.5
Human 99.5
Cow 98.9
Cattle 98.9
Mammal 98.9
Animal 98.9
Donkey 93.8

Clarifai
created on 2023-10-15

people 99.6
vintage 98.9
cavalry 97.9
mammal 97.8
man 97.2
two 96.9
farm 95.4
portrait 95
retro 94.4
three 92.5
group 91.9
one 91.5
monochrome 91.2
cattle 90.5
old 90.5
barn 90.5
adult 89.7
animal 89.2
lid 88.1
shed 86.9

Imagga
created on 2021-12-15

horse 57.5
animal 49.2
farm 41.9
cowboy 35.7
mammal 34.4
horses 34.1
pasture 32.6
rural 30
grass 29.3
animals 28.7
ranch 27.3
field 25.1
brown 23.6
mare 22.6
equine 22.3
livestock 20.2
saddle 19.9
stock saddle 18.2
stallion 17.6
mane 17.6
countryside 17.4
pen 17.3
country 16.7
grazing 16.7
wild 16.6
meadow 15.2
outdoors 14.9
bull 14.8
outdoor 14.5
enclosure 13.9
fence 13.7
equestrian 13.7
bridle 13.7
wildlife 13.4
trees 13.3
stable 12.8
cattle 12.4
outside 12
seat 11.7
plow 11
head 10.9
male 10.5
laborer 10.4
sport 9.9
herd 9.8
landscape 9.7
summer 9.6
safari 9.6
dirt 9.5
support 9.2
black 9
sky 8.9
horn 8.9
graze 8.9
scenic 8.8
riding 8.8
mammals 8.8
forest 8.7
standing 8.7
tool 8.3
domestic 8.1
natural 8
cow 7.9
agriculture 7.9
ungulate 7.9
farmland 7.7
eating 7.6
sunset 7.2
feed 7.1
day 7.1
barn 7.1
autumn 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

grass 99.5
outdoor 99.5
text 93.6
standing 93.2
cow 92.9
cattle 89.9
animal 88.9
mammal 85.6
clothing 71.9
bull 71
person 69.7
man 60.1
working animal 51.7
donkey 22.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Male, 98.6%
Calm 94.4%
Sad 4%
Angry 1.2%
Surprised 0.1%
Happy 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Cow
Person 99.5%
Cow 98.9%

Captions

Microsoft
created by unknown on 2021-12-15

a man standing next to a cow 89.2%
a cow standing next to a fence 79%
a man standing in front of a cow 78.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a man in overalls and overalls stands next to a donkey -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts a rustic scene in front of a log cabin. A man is standing beside a donkey, which is wearing a harness and has a lead rope. The background shows the rough texture of the log cabin walls with practical objects such as a hanging lantern, a metal cup, and cloth. The ground appears unpaved and covered with dirt and rocks, creating an earthy atmosphere indicative of rural life.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a rustic scene with a donkey standing in front of a log cabin. The donkey is facing the camera, and its halter is held by a person wearing overalls and a hat. The cabin behind them has an exterior made of horizontal logs, with a door and a window visible. Beside the window, a cloth is hanging, and a lantern and a metal container are suspended from hooks on the wall. The overall atmosphere suggests a rural setting, likely from a bygone era where log cabins and simple living were commonplace.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a man standing next to a donkey in front of a rustic log cabin. The man is wearing a hat, overalls, and work boots, and has a weathered, rugged appearance. The donkey is standing next to him, its head turned towards the man. The background includes a wooden structure with various items hanging on the walls, suggesting a rural, rustic setting. The overall scene conveys a sense of rural life and the hard work associated with it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, showing a rural or farm scene. In the image, there's a donkey standing next to a person wearing overalls, a hat, and work clothes typical of a farmer or rural worker. The setting is in front of a log cabin or rustic building with visible log construction. There are some items hanging on the wall of the cabin, including what appears to be a lantern. The photograph has a documentary style common to Depression-era or early 20th century American rural photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man standing next to a donkey in front of a log cabin.

The man is wearing a hat, overalls, and a collared shirt. He is holding a rope in his right hand, which is attached to the donkey's halter. The donkey is standing to the left of the man, facing the camera. It has a dark coat with a lighter-colored muzzle and ears. The man and the donkey are standing on a dirt path in front of a log cabin. The cabin has a door and a window, and there are various items hanging from the walls, such as a lantern, a bucket, and a piece of clothing.

The overall atmosphere of the image suggests that it was taken in a rural or countryside setting, possibly during the early 20th century. The man and the donkey appear to be engaged in some kind of work or activity, possibly related to farming or animal husbandry.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a man standing beside a donkey in front of a log cabin. The man is dressed in overalls and a hat, while the donkey wears a bridle. The log cabin features a window on the left side and an open doorway on the right side, with various items hanging from the wall, including a lantern and a bucket. The ground beneath them appears to be dirt or gravel.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A black-and-white photograph features a man and a donkey standing in front of a wooden cabin. The man is wearing a hat and overalls and is holding a rope in his right hand. The donkey has a harness on its head and is standing next to the man. Behind them, there is a wooden door with a window, and a lamp is hanging on the wall. There are some logs and a piece of cloth hanging on the wall.

Created by amazon.nova-pro-v1:0 on 2025-06-08

A black-and-white image of a man standing next to a donkey. The man is wearing a hat and overalls, while the donkey is wearing a halter and lead rope. The man is holding the lead rope of the donkey. Behind them is a wooden structure with a door and a window. There are logs on the ground, and some are leaning against the wooden structure.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

This is a black and white photograph of a man and a mule standing in front of a log cabin. The man is wearing a hat and overalls, and he is holding the mule's reins. The cabin is simple and rustic, with a small window and a door. There is a lantern hanging on the wall of the cabin. The overall scene is one of rural life and simplicity.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

This is a black and white photograph depicting a man and a donkey posing together. The man is standing on the right side of the frame, directly in front of a wooden cabin. He's wearing overalls, a hat, and has a weathered face, suggesting a life of labor. The donkey stands on the left side of the frame, next to the man, and is harnessed. The donkey's ears are perked up. The background shows a log cabin with a window and door. Several utilitarian items are hanging near the door, including a lantern, a bucket, and what seems to be a rope. The overall impression is one of rural life, possibly dating back to the early to mid 20th century. The photo appears to be printed on paper, and the framing is evident.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph that appears to be from an earlier time period, possibly the early to mid-20th century. It depicts a man standing next to a donkey in front of a rustic wooden structure, which looks like a log cabin or barn.

The man is wearing a hat, a denim or work shirt, and overalls, typical attire for a farmer or laborer of that era. He is standing with his hands in his pockets, looking directly at the camera. The donkey is tethered with a rope and is standing calmly beside the man. The background shows various items hanging on the wall of the wooden structure, including what appears to be a lantern, a bucket, and some tools.

The setting suggests a rural environment, likely a farm or homestead. The overall atmosphere of the photograph conveys a sense of simplicity and hard work, characteristic of rural life during that time.