Human Generated Data

Title

Untitled (pagoda and smaller building to front, stone wall to right)

Date

c. 1870-c. 1890

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.72

Human Generated Data

Title

Untitled (pagoda and smaller building to front, stone wall to right)

People

Artist: Unidentified Artist,

Date

c. 1870-c. 1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.72

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99
Nature 91.6
Building 84.9
Art 84.1
Outdoors 82.8
Architecture 80.1
Housing 76.6
Soil 64.6
Tower 63.7
Landscape 59.1
Temple 58.1
Shrine 58.1
Worship 58.1
Clothing 55.6
Apparel 55.6

Clarifai
created on 2018-03-16

people 97.7
illustration 96.8
art 96.7
wear 96
print 95.9
paper 93.3
adult 92.2
painting 92
retro 91.6
vintage 90.9
no person 90.8
man 89.9
picture frame 88.8
antique 88.3
old 88.1
one 87.5
bill 87.3
desktop 84.9
text 81.5
group 81.2

Imagga
created on 2018-03-16

grunge 63.1
vintage 57.9
old 53.7
antique 49.4
texture 49.4
aged 48.9
envelope 45.6
paper 43.3
retro 42.6
frame 41.7
damaged 39.1
ancient 38.1
material 34
border 33.5
crumpled 31.1
container 30.9
dirty 29.8
parchment 29.8
stains 28.2
page 27.9
decay 27
grungy 26.6
space 25.6
wallpaper 25.3
wall 25.3
empty 24.9
text 24.5
grime 24.4
design 24.2
art 23.6
grain 23.1
historic 22.9
rusty 22.9
book 22.7
ragged 22.4
fracture 22.4
worn 22
rough 21
old fashioned 20.9
textures 20.9
structure 20.3
textured 20.2
graphic 19
manuscript 18.6
cardboard 18.3
spot 18.2
pattern 17.8
document 17.6
backdrop 16.5
your 16.4
blank 16.3
tracery 15.8
broad 15.7
mottled 15.6
succulent 15.6
stain 15.4
artistic 14.8
brown 14.7
shabby 14.7
torn 14.5
messy 14.5
decoration 14.2
binding 13.6
rust 13.5
drawing 13.3
backgrounds 13
floral 12.8
scratched 12.7
faded 12.7
crack 12.6
decorative 12.5
dirt 12.4
weathered 12.4
tattered 11.8
highly 11.8
graffito 11.8
crease 11.8
detailed 11.6
aging 11.5
obsolete 11.5
book jacket 11.5
canvas 11.4
letter 11
artwork 11
paint 10.9
scratch 10.7
album 10.7
burnt 10.7
sepia 10.7
architecture 10.3
flower 10
film 10
jacket 9.9
photographic 9.8
screen 9.8
ornament 9.5
sheet 9.4
leaf 9.3
product 9.3
board 9.2
stucco 9.2
black 9
color 8.9
slide 8.8
scrapbook 8.7
concrete 8.6
cover 8.3
style 8.2
world 8.2
history 8.1
detail 8.1
surface 7.9
distressed 7.9
frames 7.8
uneven 7.8
strip 7.8
movie 7.8
beige 7.7
collage 7.7
stained 7.7
element 7.4
covering 7.4
global 7.3
creation 7.3
gray 7.2
card 7.2

Google
created on 2018-03-16

text 85.2
picture frame 71.4
art 66.7
painting 59.3
artwork 57.7
history 53.6
visual arts 53.3
drawing 52.8

Microsoft
created on 2018-03-16

old 58.1

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 30-47
Gender Female, 50.3%
Angry 45.8%
Disgusted 46.5%
Happy 45.5%
Sad 45.8%
Calm 50.5%
Confused 45.3%
Surprised 45.7%

AWS Rekognition

Age 35-52
Gender Male, 50.8%
Happy 45%
Angry 45.1%
Disgusted 45%
Calm 45.2%
Sad 54.6%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Angry 49.6%
Disgusted 50.3%
Calm 49.5%
Happy 49.5%
Sad 49.6%
Surprised 49.5%
Confused 49.5%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting

Clarifai

Picture frame
Clothing
Human face
Footwear
Man
Tree
Person

AWS Rekognition

Person 99%

AWS Rekognition

Person 97%

AWS Rekognition

Person 77.1%

AWS Rekognition

Person 73.4%

AWS Rekognition

Painting 84.1%

Clarifai

Picture frame 79.6%

Clarifai

Picture frame 33.8%

Clarifai

Clothing 67.7%

Clarifai

Clothing 61.5%

Clarifai

Clothing 59.3%

Clarifai

Human face 60.9%

Clarifai

Human face 57.3%

Clarifai

Human face 42.8%

Clarifai

Human face 40.5%

Clarifai

Footwear 49.4%

Clarifai

Footwear 44.6%

Clarifai

Footwear 33.8%

Clarifai

Man 48.1%

Clarifai

Tree 43.8%

Clarifai

Tree 43%

Clarifai

Person 41.2%

Categories

Imagga
created on 2018-03-16

paintings art 100%

Captions

Microsoft
created by unknown on 2018-03-16

an old photo of a box 30.2%
an old photo of a person 26.6%
an old photo of a refrigerator 10.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-11

a photograph of a group of people sitting on a bench in front of a pagoda

Created by general-english-image-caption-blip-2 on 2025-06-28

a sepia - toned photo of a group of people sitting on a bench

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image consists of two photographs placed side by side on an aged, beige paper background, likely part of an album.

  • The left photo depicts a traditional multi-tiered building, possibly a pagoda or gate, situated on a hill surrounded by grass. The structure appears historical, with a stone path or road leading toward it. The scene is serene and suggests an outdoor setting with cloudy or hazy lighting.

  • The right photo shows a casual gathering of people in an outdoor setting. Four individuals are visible; one is seated on a reclining chair, another appears standing and wearing a light suit or uniform, and the others are seated nearby. A guitar leans against a chair, and there are sheets of paper or possibly music scattered on the ground. The group is surrounded by lush plants, including trees, contributing to a relaxed and shaded atmosphere.

These photos suggest a contrast: a formal architectural subject on the left and a leisurely, social scene on the right.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image shows an old photograph album page containing two separate photographs. The photograph on the left depicts a traditional Chinese building with multiple tiers and pagoda-style architecture, surrounded by what appears to be a grassy area and a low wall. The photograph on the right captures a group of people relaxing outdoors. There are four individuals; one standing in a white outfit, and three seated comfortably in a shaded area. One person is reclining in a chair, another person is seated on a wicker chair next to a guitar resting against it, and the third seated person is a woman in a traditional dress. Scattered on the ground are papers or maps. The overall image suggests a casual, social setting likely from the past, given the sepia tone and style of the photographs.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-25

This appears to be an old sepia-toned photograph, likely from the late 1800s or early 1900s, showing people relaxing on what looks like a porch or veranda. The image shows several people seated in rocking chairs and other furniture. In the background, there appears to be some kind of decorative or architectural element with a pagoda-like top. The photograph is mounted on what appears to be an album page with a cream or off-white color. The photograph has some aging and fading typical of vintage images from this era. The setting suggests this might be at a home, hotel, or resort where people would gather to socialize and relax outdoors while staying protected from the elements under the porch covering.

Created by claude-3-haiku-20240307 on 2024-12-30

This image appears to be a photograph displayed in an old album or scrapbook. It contains two distinct scenes.

The left image shows a tall, ornate structure that resembles a pagoda or similar architectural style, set against a background of open space or landscape.

The right image depicts a group of people, likely a social gathering or event, sitting and relaxing on a patio or outdoor terrace. The individuals appear to be dressed in clothing typical of a historical era, suggesting this is an older photograph.

The overall presentation of the image, with the two contrasting scenes side by side, suggests this may have been a travel or documentary-style photographic collection compiled by the owner of the album.

Created by claude-3-opus-20240229 on 2024-12-30

The image shows two sepia-toned photographs from the past, likely from the early 20th century based on the clothing and setting. The left photo depicts a Chinese-style pagoda or tower in a desolate landscape. The right photo shows a group of well-dressed people relaxing in what appears to be a courtyard or garden area with palm trees in the background. The people are seated on benches and chairs, and the photo has an old-fashioned, nostalgic feel to it, capturing a leisurely social gathering from a bygone era.

Created by claude-3-5-sonnet-20241022 on 2024-12-30

This appears to be a page from an old photo album containing two sepia-toned photographs. On the left is an image of what appears to be a Chinese or Asian-style pagoda or temple building with multiple tiers, sitting atop a hill or elevated area. On the right is a more intimate scene showing people relaxing on what appears to be a porch or veranda. There are several people seated and reclining in chairs, with some tropical-looking plants visible in the background. A guitar or similar string instrument can be seen in the scene. The photos appear to be from the late 19th or early 20th century based on their style and composition. Both images are mounted on what looks like a cream-colored album page with some wear around the edges.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

The image presents a sepia-toned photograph of an open book, featuring two distinct scenes. The left side showcases a pagoda-style building situated atop a hill, while the right side depicts a group of people lounging on a patio.

Left Scene:

  • A pagoda-style building is prominently displayed.
  • The building is positioned atop a hill.
  • The scene is rendered in sepia tones.

Right Scene:

  • A group of people are shown lounging on a patio.
  • The individuals are dressed in casual attire.
  • The scene is also depicted in sepia tones.

Book Details:

  • The book appears to be old and worn.
  • The pages are yellowed with age.
  • The book's cover is not visible in the image.

Overall, the image presents a nostalgic and vintage atmosphere, with the sepia tones evoking a sense of history and nostalgia.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image appears to be a page from an old photo album or scrapbook, featuring two sepia-toned photographs.

The left photograph shows a large, multi-story building with a pagoda-style roof, situated in a field or open area. The building is surrounded by a low wall, and there are trees in the background.

The right photograph depicts a group of people gathered around a table, with a guitar leaning against it. There are several individuals in the photo, but they are not clearly identifiable due to the low resolution and sepia tone. The atmosphere of the photo suggests a casual gathering or social event.

Overall, the image provides a glimpse into the past, capturing moments from a bygone era. The sepia tone and old-fashioned clothing give the photos a nostalgic feel, evoking memories of a simpler time.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-25

The image shows two photographs that are placed side by side. The photograph on the left is of a temple. The temple has a unique architecture, with a tower-like structure. The temple is surrounded by a field of grass. The photograph on the right is of a group of people. The group of people are sitting on a bench, and a person is sitting on a chair. Some people are holding a guitar.

Created by amazon.nova-lite-v1:0 on 2025-05-25

The image depicts an old photograph that has been scanned and appears somewhat faded and aged. The photograph is divided into two sections, with the left side showing a traditional Chinese pagoda structure standing prominently on a hill, surrounded by a grassy area. The right side of the photograph shows a group of people gathered in an outdoor setting. They are seated on a bench and a chair, and some are standing around, engaged in conversation. One person is holding a guitar, and there are various items on the ground, including newspapers and a bag. The photograph captures a moment of leisure and social interaction among the individuals.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall:

The image is a page from an old photo album. It features two photographs mounted within the album page. The album page itself is a yellowish-brown, suggesting age. The photos are sepia-toned, indicative of the photographic technology of the time.

Left-hand Photo:

  • Subject: A building, possibly a tower or pagoda, of what appears to be Asian architecture. It has multiple stories and a curved roof. The building is set against a backdrop of what looks like a fortified wall.
  • Setting: The building is situated on a grassy landscape.

Right-hand Photo:

  • Subject: A group of people, some dressed in what appears to be Western clothing. One person is seated and resting in a rocking chair. A woman is seated and another woman is holding a guitar. Someone is reading the newspaper,
  • Setting: It appears to be a veranda or outdoor area with some greenery.

Style and Era:

The image is undoubtedly old, probably from the late 19th or early 20th century. The photographic style, the sepia tone, the subjects, and the album format all point to this era. It hints at travel or a glimpse into a different culture or lifestyle of that period.

Created by gemini-2.0-flash on 2025-04-29

This is an old photograph, likely from an album, featuring two separate scenes.

On the left is a landscape. A multi-tiered, Asian-style tower stands prominently. It’s made of stone or brick and is surrounded by a high, defensive wall. The ground leading to the wall is covered in grass and some sparse shrubs, giving the impression of a historical site.

On the right is a more domestic scene. Several people are gathered on what appears to be the porch or steps of a house. One man is dressed in white and stands casually. Another man is relaxing in a rocking chair. A woman is seated nearby, also dressed in light clothing. A guitar leans against a chair. On the steps, another individual is seated, engrossed in reading a newspaper.

The photograph has a warm, sepia tone, common to older prints. The overall composition suggests a historical or documentary feel, with a glimpse into a different time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-26

The image appears to be an old, sepia-toned photograph album page featuring two distinct photographs.

  1. Left Photograph:

    • The photograph shows a traditional multi-tiered pagoda structure, likely of East Asian origin.
    • The pagoda is set in an open area, possibly a field or garden, with a clear sky in the background.
    • The structure has multiple levels with curved, upturned eaves, characteristic of traditional pagoda architecture.
    • There are some small, indistinct objects or structures in the foreground, possibly related to the pagoda or the surrounding landscape.
  2. Right Photograph:

    • This photograph depicts a group of people, possibly in a staged or theatrical setting.
    • The individuals are dressed in what appears to be traditional or period costumes.
    • One person is lying on a chaise longue, while others are standing or seated nearby.
    • The setting includes various props such as a fan, a musical instrument (possibly a violin or similar stringed instrument), and decorative elements like potted plants.
    • The overall scene suggests a performance or a posed photograph, possibly from a play or a cultural event.

The album page itself has an aged appearance, with visible wear and tear, indicating that it is likely quite old. The photographs are mounted on a textured, possibly cardboard or paper backing, typical of early photograph albums.

Qwen

No captions written