Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1254.3

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1254.3

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Apparel 99.3
Clothing 99.3
Human 97.8
Sleeve 93.2
Female 91.5
Home Decor 90.9
Face 87.4
Dress 84.5
Linen 73.7
Woman 73.6
Girl 69.8
Long Sleeve 68.3
People 65.1
Smile 64.3
Portrait 64.2
Photo 64.2
Photography 64.2
Hat 63
Outdoors 61.4

Clarifai
created on 2019-06-07

people 99.7
portrait 98.4
one 97.7
adult 96.7
wear 94.5
retro 93.4
lid 87.6
veil 86.5
administration 84.3
vintage 83.4
leader 83
art 80.3
old 79.4
woman 79
man 75.4
child 74.9
music 71.9
facial expression 70.4
coat 69.4
nostalgia 68.5

Imagga
created on 2019-06-07

statue 49.5
sculpture 34.5
art 25.9
religion 24.2
old 23.7
ancient 23.4
culture 21.4
history 19.7
stone 19.5
architecture 18.8
god 18.2
antique 17.9
portrait 16.8
church 16.7
decoration 16.6
historic 16.5
dress 16.3
religious 15.9
catholic 15.6
historical 15.1
face 14.9
cemetery 14.7
people 14
person 13.9
monument 13.1
marble 12.8
costume 12.6
lady 12.2
building 12.1
roman 11.8
vintage 11.6
figure 11.3
clothing 11.3
detail 11.3
child 11.2
man 10.8
outdoor 10.7
holy 10.6
spirituality 10.6
fashion 10.6
adult 10.4
head 10.1
temple 10
city 10
tourism 9.9
pray 9.7
style 9.6
saint 9.6
mother 9.6
faith 9.6
golden 9.5
symbol 9.4
famous 9.3
decorative 9.2
travel 9.2
sepia 8.7
museum 8.7
model 8.6
summer 8.4
carving 8
hair 7.9
design 7.9
male 7.9
angel 7.8
spiritual 7.7
classical 7.6
clothes 7.5
traditional 7.5
tourist 7.4
gold 7.4
landmark 7.2
doll 7.2
world 7.2

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

clothing 98.8
human face 98.7
smile 97.5
old 94.7
person 94.3
posing 77.5
woman 74.3
black 71.2
white 65.6
vintage 54.9
stone 5.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 81.9%
Disgusted 0.1%
Sad 0.1%
Happy 99.4%
Surprised 0.1%
Angry 0.1%
Calm 0%
Confused 0.2%

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Human face
Plant
Human eye
Human arm
Human nose
Human mouth

AWS Rekognition

Person 97.8%

Clarifai

Human face 94.6%

Clarifai

Plant 88.9%

Clarifai

Plant 46.9%

Clarifai

Human eye 46.2%

Clarifai

Human eye 35.9%

Clarifai

Human arm 44.9%

Clarifai

Human arm 41.8%

Clarifai

Human nose 42.6%

Clarifai

Human mouth 39.5%

Categories

Imagga
created on 2019-06-07

paintings art 99.8%

Captions

Microsoft
created by unknown on 2019-06-07

a vintage photo of a person 92.4%
a vintage photo of a girl 86%
a vintage photo of a person 85.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a woman in a hat and dress with a hat on

Created by general-english-image-caption-blip-2 on 2025-07-05

a woman in a hat and dress standing in front of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image depicts a person standing outdoors near a building with horizontal siding and a window visible in the background. The individual is dressed in historical attire, likely early 20th century, consisting of a long-sleeved striped blouse tucked into a belted skirt and an apron. A decorative hat with intricate detailing is worn. The setting appears grassy, suggesting the image was taken outside in a yard or garden area. The number "9819" is handwritten in the upper corner of the photo.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a historical photograph of a woman standing outdoors in front of a house with horizontal siding. She is wearing a period dress with a high collar and long sleeves, typical of the late 19th or early 20th century. Her outfit includes a high-waisted skirt and a blouse with a gathered waist. She is wearing a large hat adorned with decorative elements. The ground is covered with grass, and there is a rectangular window visible on the side of the house behind her. At the top right corner of the image, the numbers "98 19" are marked.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a young woman standing outdoors, wearing a long dress with a patterned design and a hat with a decorative brim. She is smiling and appears to be in a rural or outdoor setting, with a wooden structure visible in the background. The photograph has an aged, sepia-toned appearance, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a vintage black and white photograph, likely from the early 1900s based on the style of dress and photographic quality. The image shows someone wearing a long, light-colored dress with a fitted waist and full skirt typical of the era. The dress has long sleeves with a striped or checked pattern. They are wearing a wide-brimmed decorative hat and have their hair styled in the fashion of the period. The person is standing outside what appears to be a wooden house with horizontal siding, and there's a window visible in the background. They are captured in a cheerful moment, with a bright smile. The photograph has "G 8/19" written at the top, possibly indicating a date. The overall composition and style is characteristic of casual portrait photography from the early 20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a sepia-toned photograph of a woman standing in front of a house. The woman is wearing a long dress with a high neckline and long sleeves, and a wide-brimmed hat. She has dark hair that is styled in an updo, and she is smiling at the camera.

The background of the image shows a white house with horizontal siding and a window on the side. The ground in front of the house is covered in grass. The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly in the 1910s or 1920s.

The image appears to be a vintage photograph, possibly taken by a family member or friend. It may have been taken during a special occasion or event, such as a birthday or holiday. The woman's smile and the casual pose suggest that she is feeling relaxed and happy in the moment.

Overall, the image is a charming and nostalgic portrayal of a woman from a bygone era. It captures a moment in time and provides a glimpse into the past, inviting the viewer to imagine the story behind the photograph.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a sepia-toned photograph of a woman standing in front of a house. The woman is wearing a long-sleeved dress with a high neckline and a wide-brimmed hat adorned with decorative elements around the crown. Her dark hair is styled in an updo, and she has a slight smile on her face. She is holding the skirt of her dress with her left hand.

In the background, there is a house with horizontal siding and a window visible behind the woman. The ground beneath her feet appears to be grassy, suggesting that the photo was taken outdoors. The overall atmosphere of the image suggests that it was taken during the early 20th century, possibly in the 1910s or 1920s.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image is an old photograph of a woman standing outside. She is wearing a hat and a dress with long sleeves and a belt. The woman is smiling and seems to be posing for the camera. The background shows a house with a window and a door. The image has a sepia tone and is slightly blurry. The photo has a handwritten date of "9/19" on the top right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The vintage photograph depicts a woman standing outside a house, smiling and posing for the camera. She is wearing a hat, a long-sleeved blouse, and a skirt. The woman is standing on a grassy field, with the house behind her. The house has a window and a door, and the walls are painted in a light color. The woman's hair is tied up in a bun, and she is wearing a necklace.

Google Gemini

Created by gemini-2.0-flash on 2025-06-14

Here is a description of the image:

The image shows a woman standing in front of a building in what appears to be an outdoor setting. The woman is wearing a large hat and a striped, long-sleeved dress. The building behind her has horizontal siding and a window with a simple frame. The grass in the foreground suggests a yard. The image has an aged, sepia-toned appearance, indicating it is an old photograph. There are some imperfections on the image, such as marks and discoloration, adding to its vintage feel. A handwritten note is visible at the top.

Created by gemini-2.0-flash-lite on 2025-06-14

Here's a description of the image:

This is a vintage black and white photograph of a young woman. She's smiling broadly and looking towards the camera. The woman is dressed in a long-sleeved, striped blouse and a long skirt. A thin belt cinches her waist. She's wearing a large hat with a wide brim and has her hair piled up beneath it.

In the background, there's a house with horizontal siding and a window. She stands on the edge of a grassy area. The photo appears to be aged and the edges are a bit worn, giving it a classic, historical feel. There's some handwriting in the top right corner.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-13

The image is a vintage black-and-white photograph featuring a woman standing outdoors in front of a building. The building has horizontal siding and a window behind her. The woman is dressed in early 20th-century attire, which includes a long, light-colored dress with long sleeves and a high neckline. She is also wearing a wide-brimmed hat adorned with decorative elements. The woman is smiling and appears to be holding something in her left hand, possibly a glove or a small cloth. The photograph has some markings and annotations, including the numbers "9819" written at the top right corner. The overall setting and attire suggest that the photograph was taken in the early 1900s.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

This image is a sepia-toned photograph of a person standing outdoors in front of a building with vertical siding. The person is wearing a long-sleeved, long skirted dress with a fitted bodice and a wide-brimmed hat. The dress appears to be of a simple, modest design, with a belt at the waist. The person's hair is styled in an updo with decorative braids or ornaments. The background shows a door and a grassy area, suggesting a rural or suburban setting. The photograph has a vintage quality, with some wear and tear visible on the surface, including a few scuffs and a handwritten number "9819" in the upper right corner.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This is a vintage sepia-toned photograph of a woman standing outdoors. She is smiling and appears to be in a cheerful mood. The woman is wearing a long-sleeved, high-necked dress with a pleated bodice and a full skirt, typical of early 20th-century fashion. She has a large, wide-brimmed hat on her head, which is adorned with what looks like a decorative band. The background shows a house with a window and some grass or yard. The photograph has some wear and tear, with visible creases and small stains, indicating its age. There is a handwritten number "9819" at the top right corner of the image.