Human Generated Data

Title

Untitled (Jessie Tarbox Beals preparing to take photograph atop high ladder, main entrance of the Austrian Pavilion, 1904 St. Louis World's Fair)

Date

1904

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3162

Human Generated Data

Title

Untitled (Jessie Tarbox Beals preparing to take photograph atop high ladder, main entrance of the Austrian Pavilion, 1904 St. Louis World's Fair)

People

Artist: Unidentified Artist,

Date

1904

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3162

Machine Generated Data

Tags

Amazon
created on 2024-10-02

Photography 99.8
Adult 99
Male 99
Man 99
Person 99
Adult 98.7
Male 98.7
Man 98.7
Person 98.7
Adult 98.7
Person 98.7
Bride 98.7
Female 98.7
Wedding 98.7
Woman 98.7
Adult 98.6
Male 98.6
Man 98.6
Person 98.6
Person 97.6
Tripod 96.7
Adult 96.7
Person 96.7
Bride 96.7
Female 96.7
Woman 96.7
Clothing 96.4
Glove 96.4
Adult 95.8
Person 95.8
Bride 95.8
Female 95.8
Woman 95.8
Person 94.4
Person 94.3
Person 93.9
Person 90.7
Person 90.3
Person 89.8
Person 87.7
Person 86.9
Person 86.5
Person 85.9
Stilts 84
Person 81.8
Face 71.3
Head 71.3
Person 69.6
Hat 66.8
Person 65.6
Hat 64.9
Person 64.8
Hat 61.5
Photographer 57.7
Footwear 56.9
Shoe 56.9
Hat 56.6
Hat 56.2
Construction 55.7
Person 55.3
Art 55.3

Clarifai
created on 2024-10-02

people 100
group together 99.5
group 99.1
adult 97.6
two 97.5
many 97.3
child 97.1
three 95.8
street 95.3
four 94.5
several 94.2
wear 92.6
administration 92.5
man 92.2
woman 90.7
five 90.4
monochrome 89.1
one 88.4
leader 87.3
actor 86.2

Imagga
created on 2024-10-02

guillotine 58.9
instrument of execution 49.1
architecture 39.2
instrument 37.4
device 32
building 30.4
city 27.4
statue 22.6
world 21.9
church 21.3
travel 19
old 18.8
tourism 18.1
landmark 18
history 17.9
monument 17.7
sculpture 16.2
historic 15.6
ancient 15.6
town 14.8
religion 14.3
sky 13.4
buildings 13.2
urban 13.1
famous 13
tower 12.5
tourist 12.2
cathedral 12
stone 11.9
house 11.3
construction 11.1
art 10.4
bridge 10
medieval 9.6
attraction 9.6
place 9.3
street 9.2
black 9
catholic 8.7
st 8.7
culture 8.5
dark 8.3
night 8
structure 7.9
column 7.9
royal 7.7
england 7.6
cross 7.5
historical 7.5
exterior 7.4

Google
created on 2024-10-02

Clothing 98.8
Trousers 96.9
Outerwear 95.4
Photograph 94.3
White 92.2
Building 90.5
Black 90
Black-and-white 86.3
Style 84.1
Ladder 83.8
Monochrome 77.5
Monochrome photography 77.3
Snapshot 74.3
Window 74
Pole 72.1
Vintage clothing 72
Art 71.7
Sculpture 70.9
History 68.6
Event 68.5

Microsoft
created on 2024-10-02

building 99.3
clothing 98.5
footwear 96.4
outdoor 96.2
ladder 89.2
black and white 86.7
person 71.5
standing 70.9
street 68.6
people 68.4
ground 64

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-37
Gender Male, 99.2%
Calm 99%
Sad 0.6%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 25-33
Gender Female, 94.8%
Sad 90.5%
Calm 24.8%
Disgusted 4.2%
Fear 2%
Happy 0.6%
Confused 0.4%
Surprised 0.4%
Angry 0.4%

AWS Rekognition

Age 22-28
Gender Female, 99.4%
Calm 77.9%
Happy 3.9%
Surprised 1.1%
Sad 1.1%
Disgusted 0.7%
Angry 0.4%
Confused 0.4%
Fear 0.1%

AWS Rekognition

Age 31-39
Gender Male, 97.9%
Calm 29.1%
Happy 17.9%
Disgusted 0.3%
Sad 0.3%
Surprised 0.2%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 57-65
Gender Female, 98.2%
Calm 54.7%
Happy 5.9%
Sad 3.8%
Confused 1%
Surprised 0.7%
Disgusted 0.6%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 21-27
Gender Female, 97.5%
Calm 98.5%
Sad 0.9%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Calm 77.1%
Happy 4.9%
Sad 0.6%
Surprised 0.3%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 50-56
Gender Male, 98%
Calm 58.2%
Sad 6.7%
Happy 3.7%
Confused 1.1%
Angry 0.8%
Disgusted 0.4%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 29-37
Gender Female, 95.7%
Calm 95.5%
Sad 1.1%
Disgusted 0.8%
Angry 0.4%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 35-43
Gender Female, 81.7%
Calm 87%
Sad 5.8%
Disgusted 1.8%
Surprised 0.5%
Confused 0.4%
Fear 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 23-29
Gender Male, 67%
Calm 43.2%
Happy 13.6%
Angry 0.2%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 26-34
Gender Male, 95.2%
Sad 90.3%
Calm 27.3%
Disgusted 4.6%
Confused 0.8%
Happy 0.6%
Fear 0.3%
Surprised 0.3%
Angry 0.1%

AWS Rekognition

Age 24-30
Gender Female, 91.3%
Happy 55.8%
Calm 7.4%
Sad 3.7%
Disgusted 0.4%
Surprised 0.3%
Fear 0.1%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 29-37
Gender Male, 79.9%
Calm 54.8%
Happy 6.8%
Disgusted 2.3%
Surprised 0.7%
Angry 0.5%
Sad 0.3%
Confused 0.2%
Fear 0%

AWS Rekognition

Age 25-33
Gender Male, 58.4%
Calm 54.6%
Sad 6.2%
Disgusted 4%
Surprised 2.8%
Fear 2.4%
Happy 1.6%
Angry 1.4%
Confused 0.8%

AWS Rekognition

Age 25-33
Gender Male, 54.1%
Calm 29.9%
Happy 15.8%
Sad 2.9%
Surprised 1.2%
Fear 1.1%
Angry 0.4%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 24-30
Gender Female, 63.1%
Happy 98.4%
Calm 0.3%
Surprised 0.1%
Sad 0.1%
Fear 0%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 24-32
Gender Male, 95.5%
Calm 98.2%
Sad 0.6%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 30-38
Gender Male, 98.8%
Calm 18.5%
Fear 15.2%
Happy 11.6%
Surprised 7.6%
Disgusted 5.6%
Angry 4%
Sad 2.7%
Confused 0.7%

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Bride
Female
Woman
Glove
Hat
Shoe
Adult 99%
Adult 98.7%
Adult 98.7%
Adult 98.6%
Adult 96.7%
Adult 95.8%
Male 99%
Male 98.7%
Male 98.6%
Man 99%
Man 98.7%
Man 98.6%
Person 99%
Person 98.7%
Person 98.7%
Person 98.6%
Person 97.6%
Person 96.7%
Person 95.8%
Person 94.4%
Person 94.3%
Person 93.9%
Person 90.7%
Person 90.3%
Person 89.8%
Person 87.7%
Person 86.9%
Person 86.5%
Person 85.9%
Person 81.8%
Person 69.6%
Person 65.6%
Person 64.8%
Person 55.3%
Bride 98.7%
Bride 96.7%
Bride 95.8%
Female 98.7%
Female 96.7%
Female 95.8%
Woman 98.7%
Woman 96.7%
Woman 95.8%
Glove 96.4%
Hat 66.8%
Hat 64.9%
Hat 61.5%
Hat 56.6%
Hat 56.2%
Shoe 56.9%

Categories

Captions

Microsoft
created by 2021-05-01 on 2024-10-02

a person standing on a ladder 37.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-12

a photograph of a man is standing on a ladder ladder -100%

OpenAI GPT

Created by gpt-4 on 2024-10-02

The image depicts a historical scene taking place outdoors, possibly during an event or gathering. There are two ladders set up against a structure with ornate detailing, including a sculpture of a large, elevated figure dressed in a flowing gown and holding what appears to be a wreath. A person dressed in period attire is perched at the top of one of the ladders, holding a device that could be a camera or another piece of technology relevant to the time.

On the ground, several individuals observe the scene. Some of the onlookers are also dressed in period clothing, indicative of styles that suggest the late 19th to early 20th century. There is a sense of action and focus directed toward the endeavors of the individuals on the ladders.

The architectural features, as well as the attire of the onlookers, suggest a public place or a venue for a significant event. It appears to be a moment captured in time, providing a glimpse into the activities and social gatherings of the past.

Created by gpt-4o-2024-05-13 on 2025-01-02

The image shows a black and white photograph of a historical scene. Two individuals are standing on ladders, working on something at the top. One person is on the left ladder and the other on the right ladder. The scene seems to be in front of a building, with "AUST" visible on the wall, possibly a part of a sign. Below, there is a statue of a woman holding a wreath. Additional individuals are gathered around, dressed in formal attire appropriate for the early 20th century. Some people appear to be observing the activity while others are engaged in conversation. The overall atmosphere suggests a public event or ceremony.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a fascinating historical black and white photograph that appears to be from the early 1900s. It shows a daring photographer perched at the top of a tall ladder while taking a picture. The photographer is wearing period clothing including a long dress and hat typical of that era. Below, several people are helping to steady the ladder while a crowd looks on. In the background, there's an elegant building facade featuring a classical statue and decorative architectural elements. Part of the word "AUST" is visible on the building. The scene captures what must have been quite an extraordinary sight for its time - a photographer going to great lengths (literally) to get the perfect shot. The image provides an interesting glimpse into early photography practices and the lengths photographers would go to capture their subjects.

Created by claude-3-haiku-20240307 on 2024-10-02

The image appears to depict a scene from a theatrical production or event. In the center, there is a large, ornate statue or sculpture of a female figure, likely a goddess or allegorical representation. Several people, mostly men, are gathered around the sculpture, some on ladders or scaffolding, seemingly working on or adjusting the display. In the background, there are additional architectural elements and a sign that says "AUST", which may be part of a larger word or name. The overall setting suggests a public space, such as a theater or hall, where this type of artistic or decorative display would have been presented.

Text analysis

Amazon

AUST

Google

AUSTRIA AUST
AUSTRIA
AUST