Human Generated Data

Title

Social Settlements: United States. Alabama. Calhoun. "Calhoun Colored School": Calhoun Colored School, Calhoun, Ala.: "Raw Material."

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.241

Human Generated Data

Title

Social Settlements: United States. Alabama. Calhoun. "Calhoun Colored School": Calhoun Colored School, Calhoun, Ala.: "Raw Material."

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.241

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Person 99.4
Human 99.4
Person 99.1
Person 96.3
Person 95.7
Person 95.2
Text 93.6
Person 92.2
Person 91.3
Person 81.2
Advertisement 79.3
Poster 77.4
Person 76
Paper 67.8
Person 64.8
Art 63.3
Person 61.3
People 60.8
Photography 60.5
Photo 60.5
Portrait 60.2
Face 60.2

Clarifai
created on 2025-01-10

people 99.9
adult 99
wear 98.5
group 97.9
woman 97.5
man 97.1
child 96.8
print 96.4
two 96.1
art 95.9
one 95.7
many 89.7
painting 89.3
veil 89.2
war 89.1
lithograph 88.5
furniture 87
administration 85
portrait 82.8
three 82.6

Imagga
created on 2022-06-04

envelope 100
container 98.1
paper 44
old 37
vintage 33.9
texture 33.4
grunge 33.2
blank 31.8
antique 30.3
aged 29
retro 28.7
card 27.6
page 24.2
frame 23.4
dirty 22.6
design 22
ancient 21.6
empty 21.5
document 20.4
note 20.2
parchment 20.2
border 19.9
textured 19.3
damaged 18.1
space 17.9
pattern 17.8
message 17.4
material 17
book 16.6
art 16.3
letter 15.6
rough 15.5
drawing 15.3
worn 15.3
cardboard 14.4
text 14
stains 13.6
brown 13.3
artistic 13
wallpaper 13
symbol 12.8
manuscript 12.7
decorative 12.5
stained 12.5
old fashioned 12.4
grungy 12.3
canvas 12.3
sheet 12.2
wall 12
crumpled 11.7
surface 11.5
sign 11.3
sketch 11.2
greeting 11.1
book jacket 10.7
notebook 10.7
copy 10.6
board 10.4
floral 10.2
yellow 9.9
element 9.9
detail 9.7
decay 9.7
post 9.5
write 9.4
leaf 9.3
business 9.1
stamp 9.1
style 8.9
scratched 8.8
album 8.8
stain 8.7
fiber 8.7
obsolete 8.6
ornament 8.6
weathered 8.6
flower 8.5
jacket 8.4
grain 8.3
decoration 8.1
backgrounds 8.1
creative 8
postage 7.9
postal 7.9
shabby 7.9
grime 7.8
ragged 7.8
fracture 7.8
beige 7.7
postcard 7.7
money 7.7
mail 7.7
textures 7.6
communication 7.6
close 7.4
historic 7.3
wrapping 7.3
graphic 7.3
office 7.2

Google
created on 2022-06-04

Microsoft
created on 2022-06-04

gallery 99.5
room 98.2
scene 96.9
drawing 95.6
text 91.5
handwriting 90.7
sketch 75.5
letter 74
posing 61.3
old 43.3
envelope 35.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Happy 56.4%
Calm 38.7%
Surprised 6.5%
Fear 6%
Sad 2.7%
Angry 1.5%
Disgusted 0.7%
Confused 0.3%

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Calm 61.4%
Sad 39.6%
Surprised 7.2%
Fear 6.5%
Disgusted 3.7%
Confused 3.2%
Happy 2.8%
Angry 1.9%

AWS Rekognition

Age 23-31
Gender Male, 99.1%
Sad 99.8%
Calm 12.9%
Fear 7.7%
Surprised 6.8%
Happy 5%
Confused 3.3%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 16-24
Gender Female, 88.5%
Happy 72%
Fear 10.4%
Calm 8.5%
Surprised 7.4%
Sad 4.4%
Confused 1.2%
Disgusted 0.9%
Angry 0.8%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Sad 78.2%
Angry 41.5%
Disgusted 9.9%
Confused 7.8%
Surprised 6.7%
Fear 6.1%
Calm 3.2%
Happy 0.6%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 82.7%
Angry 11.5%
Surprised 6.5%
Fear 5.9%
Sad 4.1%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 4-12
Gender Male, 77.4%
Calm 95.8%
Surprised 6.3%
Fear 6.2%
Sad 2.8%
Angry 0.4%
Happy 0.4%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-24
Gender Female, 98.5%
Calm 71.7%
Sad 40.1%
Surprised 7.3%
Fear 5.9%
Angry 1%
Confused 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 10-18
Gender Male, 99.6%
Sad 100%
Surprised 6.3%
Fear 6.1%
Calm 3.7%
Confused 1.2%
Angry 0.7%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 4-10
Gender Male, 92.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 78.1%
Sad 18%
Surprised 6.3%
Fear 5.9%
Happy 3.6%
Disgusted 0.9%
Confused 0.7%
Angry 0.3%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 97%
Surprised 6.4%
Fear 6%
Sad 2.6%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 14-22
Gender Female, 52.9%
Sad 74.3%
Calm 47.9%
Confused 9.2%
Surprised 6.5%
Fear 6.1%
Angry 3.6%
Happy 2.1%
Disgusted 2%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 74.5%
Happy 13.2%
Angry 9.6%
Surprised 6.6%
Fear 6%
Sad 2.3%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Angry 36.4%
Fear 26%
Happy 13.2%
Calm 8.9%
Surprised 6.9%
Sad 5.7%
Disgusted 4.7%
Confused 2.7%

AWS Rekognition

Age 29-39
Gender Female, 56.8%
Calm 61.4%
Disgusted 10.6%
Surprised 10.5%
Sad 9.2%
Fear 6.7%
Angry 5.1%
Happy 2.8%
Confused 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.4%
Person 99.1%
Person 96.3%
Person 95.7%
Person 95.2%
Person 92.2%
Person 91.3%
Person 81.2%
Person 76%
Person 64.8%
Person 61.3%

Categories

Imagga

paintings art 99.8%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-29

a photograph of a group of people standing around a group of people -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image showcases two black-and-white photographs mounted on a gray background with the handwritten caption "Raw Material" beneath them.

  1. Left Photograph: A group of African American adults and children are gathered outdoors near a rustic building, likely a cabin or a house. The individuals are dressed in simple clothing typical of the late 19th or early 20th century. The group includes women, men, and children, with some sitting and others standing. The setting appears humble, possibly in a rural area.

  2. Right Photograph: A single African American girl stands alone outdoors in an open natural area. She is wearing a dress and appears to be barefoot, holding an object in her hands. She is facing to the side and gazing away from the camera.

Both images convey a historical context, possibly depicting life in a post-slavery or sharecropping environment in the United States. The photographs seem to document individuals as part of a narrative or study.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image contains two black and white photographs mounted on a gray background. On the left, there is a photograph showing a group of African American individuals, including children and adults. They are standing in front of a building with a sloped roof. The group is posed together and dressed in period clothing, suggesting the photo was taken in the early 20th century. This photograph is labeled with the numbers "S9 13" written above it.

On the right, there is a photograph of a young African American girl standing alone outdoors. She is wearing a dress and has her hands clasped in front of her. The background features some trees and open ground. This photograph is labeled with "S9 14" above it.

Below both photographs is the text "Raw Material" written on the gray background.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows two black and white photographs. The one on the left depicts a group of people, mostly women and children, standing or sitting outside a thatched-roof structure. They appear to be wearing traditional clothing. The image on the right shows a single person, likely a man, standing in a rural outdoor setting. The text below the images states "Raw Material", which suggests these images may have been used as source material or documentation of some kind.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This image appears to be a historical black and white photograph, likely from the early 20th century, consisting of two separate photos mounted on what looks like an album page. The page is titled "Raw Material."

The left photo shows a group of people, including adults and children, standing and sitting in front of what appears to be a wooden building or structure. Their clothing appears to be from an earlier era, with long dresses and work clothes visible.

The right photo shows a single person standing alone in what appears to be an outdoor, rural setting with some vegetation visible in the background. The person is wearing what looks like a dress or similar garment and appears to be photographed in profile.

The notation "593" appears to be written above both photographs, suggesting these may be part of a cataloged collection or archive.

The title "Raw Material" beneath these photographs suggests these may be documentation photos, possibly related to some kind of institutional or educational context, though without more context it's difficult to determine the specific purpose of these images.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image presents two black-and-white photographs of African American individuals, accompanied by handwritten notes and a caption. The photographs are displayed on a gray background.

Photograph 1:
The left photograph features a group of approximately 15 African American children and adults posing in front of a building with a shingled roof. The individuals are dressed in long-sleeved shirts and dresses, with some wearing hats. The photograph is labeled "5/9/13" in the top-left corner.

Photograph 2:
The right photograph depicts a young African American girl standing in a field, facing the camera. She is wearing a long dress and has her hair pulled back. The photograph is labeled "5/9/14" in the top-right corner.

Caption:
Below the photographs, the caption reads "'Raw Material'". This phrase is likely a reference to the individuals depicted in the photographs, who were likely being photographed for documentation or research purposes.

Handwritten Notes:
The photographs are accompanied by handwritten notes, which appear to be identification numbers or codes. These notes are written in pencil and are located in the top-left and top-right corners of each photograph.

Overall:
The image presents a poignant and thought-provoking portrayal of African American individuals during a specific time period. The photographs and caption suggest that the individuals were being documented or studied, and the handwritten notes provide additional context and information about the images.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

This image is a vintage black-and-white photograph of two scenes, presented side by side on a gray background. The left scene depicts a group of 16 people, including children and adults, gathered in front of a small house with a tiled roof. The right scene shows a young girl standing alone in a field, wearing a dress and boots.

Both scenes are labeled with handwritten notes, including "Raw Material" at the bottom center of the image. The overall atmosphere of the image suggests that it may be a historical or archival photograph, possibly from the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image consists of two photographs placed side by side. The photograph on the left depicts a group of people, possibly a family, standing and sitting in front of a building. The people are dressed in traditional clothing, with some wearing hats. The photograph on the right shows a single person, a young girl, standing in a field and holding a shovel. The background of the photograph is blurry, with trees and plants visible. The image has a monochromatic filter applied, giving it a vintage look. The bottom of the image has the words "Raw Material" written in a cursive font.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image consists of two black-and-white photographs. The left photograph shows a group of people, including adults and children, standing in front of a building. They are all dressed in traditional clothing, and some of them are wearing hats. The right photograph shows a woman standing in an outdoor area, holding a stick in her right hand, and looking to her left. Behind her, there are some trees and bushes.

Google Gemini

Created by gemini-2.0-flash on 2025-06-04

The image is a collage of two black and white photos mounted on a gray background. The first photo on the left shows a group of African American people, including women and children, standing outside what appears to be a house. Some of the children are sitting on the ground in the front. The second photo on the right features a young African American girl standing alone in a field, holding a stick. The background is blurred, suggesting it's a natural setting with trees. The text "Raw Material" is written below the photos in cursive.

Created by gemini-2.0-flash-lite on 2025-06-04

Here's a description of the image:

The image is a sepia-toned photograph mounted on a gray surface, likely an album page. It contains two distinct photographs, one on the left and one on the right.

  • Left Photo: Features a group of people, primarily African American, posing outdoors. There are adults and several children. They are dressed in what appears to be simple, possibly work-related, clothing. The background includes a building and vegetation. The photograph has a handwritten number "5,3,13" in the top left corner.

  • Right Photo: This photograph shows a young African American girl standing in a field. She is wearing a simple dress and is barefoot. The background consists of trees and vegetation. The photograph has a handwritten number "5,3,14" in the top left corner.

The text below the photographs reads: "Raw Material."

Overall, the image is a historical photograph, potentially from the late 19th or early 20th century, as indicated by the sepia tone and the clothing of the subjects. The phrase "Raw Material" suggests that the photographs have a symbolic meaning related to labor and social commentary of the time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image consists of two black-and-white photographs placed side by side on a gray background. Each photograph has a handwritten label at the top.

  1. Left Photograph:

    • Label: "SN 3 13"
    • Content: This photograph shows a group of people, likely a family, posing together outdoors. There are adults and children, all dressed in what appears to be simple, possibly work-related clothing. Some individuals are wearing hats and aprons, suggesting they might be farmworkers or laborers. The group is standing in front of a building that looks like a house or a small structure, with a visible door and window. The scene appears to be set in a rural area.
  2. Right Photograph:

    • Label: "SN 3 14"
    • Content: This photograph depicts a single individual, a woman, standing outdoors in a field. She is wearing a dress and boots and appears to be engaged in some form of agricultural work, possibly farming or gardening. The background shows trees and vegetation, indicating a rural setting.

Additional Text:

  • At the bottom center of the image, the text "Raw Material" is written, which might suggest that these photographs are part of a collection or series related to raw materials, possibly in the context of labor or agriculture.

Overall, the images seem to capture moments of rural life, possibly documenting agricultural workers or families in a historical context.

Text analysis

Amazon

13
14
3
"Raw
"Raw Material
sn
Material
S33

Google

"Raw Material."
"
Raw
Material
.