Human Generated Data

Title

Untitled (Moose Hall, Purseglove or Liberty, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1265

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Moose Hall, Purseglove or Liberty, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1265

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Face 100
Head 100
Photography 100
Portrait 100
Clothing 100
Shirt 100
Blouse 99.8
Smoke Pipe 99.3
Pants 99.1
Architecture 98.5
Building 98.5
Outdoors 98.5
Shelter 98.5
Wood 97.3
Person 97.2
Child 97.2
Female 97.2
Girl 97.2
Door 96.8
Person 96.7
Adult 96.7
Male 96.7
Man 96.7
People 95.3
Person 94.9
Child 94.9
Female 94.9
Girl 94.9
Hat 94.4
Housing 74.9
Nature 73.2
Countryside 72.7
House 57.9
Rural 57.8
Happy 57.4
Smile 57.4
Shorts 57.4
Hut 57.2
Sleeve 56.4
Home Decor 56
Accessories 55.9
Jewelry 55.9
Necklace 55.9
Body Part 55.7
Hand 55.7
Window 55.6
Indoors 55.5
Interior Design 55.5
Formal Wear 55.5
Tie 55.5
Dress 55

Clarifai
created on 2018-05-11

people 100
two 99
adult 98.9
child 98.6
wear 98.5
three 97.6
group 97.5
portrait 96.5
man 96.5
administration 95.4
group together 94.6
four 94.5
several 94
boy 93.8
five 93.7
woman 93.7
one 91.9
sibling 90.8
uniform 90.4
facial expression 89.5

Imagga
created on 2023-10-07

man 32.9
male 27.1
world 22.5
people 21.2
person 19.6
men 18.9
adult 17.6
old 15.3
bow tie 15.3
worker 15.2
standing 14.8
black 13.2
necktie 13.1
business 12.7
work 12.6
building 12.2
ancient 12.1
happy 11.9
portrait 11.6
waiter 11.2
clothing 10.2
city 10
office 9.7
entrance 9.7
urban 9.6
professional 9.5
statue 9.5
historical 9.4
hat 9.4
architecture 9.4
smile 9.3
industrial 9.1
employee 8.8
looking 8.8
home 8.8
mask 8.6
wall 8.5
industry 8.5
travel 8.4
door 8.4
vintage 8.3
dining-room attendant 8.2
one 8.2
businessman 7.9
couple 7.8
face 7.8
antique 7.8
suit 7.7
grandfather 7.7
grunge 7.7
house 7.5
human 7.5
outdoors 7.5
garment 7.5
historic 7.3
occupation 7.3
confident 7.3
equipment 7.3
aged 7.2
smiling 7.2
family 7.1
job 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 98.1
person 95.2
black 66.2
posing 35.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 26-36
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 6%
Confused 1.5%
Calm 1.3%
Disgusted 0.4%
Angry 0.3%
Happy 0.1%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Calm 63.6%
Happy 9.5%
Surprised 8.1%
Confused 7%
Disgusted 6.4%
Fear 6.4%
Sad 5.9%
Angry 1.7%

AWS Rekognition

Age 7-17
Gender Female, 100%
Sad 99.4%
Calm 34.6%
Surprised 6.9%
Fear 6%
Confused 0.4%
Happy 0.3%
Disgusted 0.3%
Angry 0.3%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Smoke Pipe
Person
Child
Female
Girl
Adult
Male
Man
Smoke Pipe 99.3%
Person 97.2%
Person 96.7%
Person 94.9%
Child 97.2%
Child 94.9%
Female 97.2%
Female 94.9%
Girl 97.2%
Girl 94.9%
Adult 96.7%
Male 96.7%
Man 96.7%

Categories

Imagga

people portraits 96.8%
paintings art 2.3%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a man and a woman standing in front of a house -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image shows a wooden structure with a visible doorway. A woman wearing a checkered blouse and a skirt is standing with her hand on her hip outside the doorway. Inside the doorway, a person is wearing a light-colored button-up shirt and a hat, standing partially visible. A child stands near the doorway, dressed in a sleeveless outfit. The structure's walls are made of horizontal wooden planks. The overall scene appears to depict a rural or modest setting.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts three people standing in or near the doorway of a wooden structure. On the left, a person is standing outside the doorway with their hands on their hips, wearing a checkered top and a skirt. In the doorway, there is a person in a long-sleeved shirt and dark pants, and a child wearing a sleeveless top. The wooden structure has horizontal planks with visible grain and texture, giving it a rustic appearance. The scene appears to be in black and white, suggesting it might be an older photograph.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows a black and white photograph of a family standing in the doorway of a wooden building. The adults appear to be a man and a woman, and there is also a young child visible. The building appears to be a simple, rustic structure with wooden walls. The people in the image have serious expressions on their faces, suggesting a sense of hardship or difficulty in their lives. The overall scene conveys a sense of poverty and the challenges faced by this family.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-16

The black and white photograph shows three African American individuals - a woman, a man, and a young child - standing in the doorway of a wooden structure, likely a small house or cabin. The woman is wearing a patterned blouse and the man is wearing a light-colored shirt. The young child is standing in front of them. The wooden structure appears weathered, with visible boards making up the walls. The photograph captures a slice of life from a past era, showing the family or group posed together at the entrance to their home.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white historical photograph showing three people standing in and around a doorway of what appears to be a wooden building or house. The structure has horizontal wooden siding. In the image, there's a woman wearing a checkered or patterned top and head covering on the left, an adult in a light-colored button-up shirt standing in the doorway, and a small child also visible in the doorway. The photo appears to be from an earlier era, possibly early-to-mid 20th century, and has the documentary style characteristic of that period's social photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a family standing in the doorway of a wooden house. The family consists of a man, a woman, and a child.

The woman is positioned on the left side of the doorway, wearing a headscarf and a checkered shirt. Her right hand rests on her hip, while her left arm is bent at the elbow, with her hand near her waist. The man stands behind her, wearing a collared shirt and a hat, with his left hand resting on the doorframe. The child, dressed in a white shirt, stands between the woman's legs, looking down.

The background of the image features the exterior wall of the wooden house, which appears to be made of horizontal wooden planks. The overall atmosphere of the image suggests that it was taken in a rural or countryside setting, possibly during the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black and white photograph of a family of three standing in the doorway of a wooden building. The woman on the left wears a headscarf and a checkered top, with her right hand resting on her hip. The man in the center sports a hat and a collared shirt, holding a pipe in his mouth. The child on the right, dressed in a white top, stands below the man.

The background of the image features the interior of the wooden building, which appears dark. The overall atmosphere of the photograph suggests that it was taken during the daytime, likely in a rural setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph of a family standing in front of a wooden house. The family consists of three individuals: a woman, a man, and a child. The woman is positioned on the left side of the image, while the man stands behind her, leaning against the doorway. The child is standing next to the man, facing the camera. The family members are all dressed in simple, modest clothing. The man is wearing a hat and holding a pipe in his mouth. The image conveys a sense of simplicity and intimacy, capturing a moment of family life in a rural or small-town setting.

Created by amazon.nova-pro-v1:0 on 2025-06-09

A black-and-white photo of a family standing at the doorway of a wooden house. The woman on the left is wearing a checkered blouse and a scarf. She is holding her waist with her right hand. The man in the middle is wearing a hat and a long-sleeve shirt, holding a pipe in his mouth. A child is standing in front of him, and she is wearing a necklace.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-09

Here's a description of the image:

Overall: The image is a black and white photograph capturing a moment in time, possibly from the mid-20th century. It depicts a family standing outside of a wooden building.

People:

  • A woman stands to the left of the frame. She is wearing a patterned blouse and a dark skirt, with a headscarf. She has a serious expression and her hand is on her hip.
  • A man stands in the doorway, holding a pipe in his mouth. He wears a shirt and is wearing a hat.
  • A young child peeks out from behind the man.

Setting: The setting appears to be the exterior of a wooden building with horizontal siding. The doorway is open, revealing a dark interior.

Atmosphere: The overall atmosphere is one of a historical document, offering a glimpse into the lives of a family. The expressions on the faces suggest a mixture of seriousness and perhaps a guardedness.

Created by gemini-2.0-flash on 2025-05-09

Here is a description of the image:

This is a black and white photograph of a family standing in a doorway of a wooden house. A woman stands to the left of the doorway. She is wearing a headscarf, a patterned blouse, and a dark skirt. Her arm is resting on her hip, and she appears to be looking off to the left side of the frame.

In the doorway, a man is standing. He is wearing a collared shirt and a hat, and he is holding a pipe. He is smiling slightly.

A young girl is standing in front of the man, partially obscured by the doorway. She is wearing a dress and has her fingers near her mouth.

The house is constructed of horizontal wooden planks. The doorway is framed by wooden beams. The overall impression of the photograph is one of a family portrait taken in a rural setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting three individuals standing in the doorway of a wooden structure. The structure appears to be a simple, rustic building with horizontal wooden planks forming the walls.

  1. Foreground:

    • A young girl stands prominently in the foreground on the left side of the image. She is wearing a light-colored, short-sleeved dress with a checkered pattern on the collar and shoulders. Her hair is pulled back, and she has a serious expression on her face.
  2. Background:

    • Behind the girl, there is an older man standing in the doorway. He is wearing a light-colored, long-sleeved shirt and dark pants. He has a hat on his head and appears to be looking directly at the camera.
    • A younger child, possibly a boy, is partially visible behind the man, peeking out from behind him. The child is wearing a light-colored shirt and has a curious or playful expression.

The overall setting suggests a rural or modest environment, possibly from an earlier time period given the style of clothing and the simplicity of the building. The expressions and postures of the individuals convey a sense of solemnity or seriousness.