Human Generated Data

Title

Untitled (woman looking at view of river from balcony of retirement home)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16095.3

Human Generated Data

Title

Untitled (woman looking at view of river from balcony of retirement home)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16095.3

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Handrail 99.9
Banister 99.9
Human 99.8
Railing 96.8
Patio 96.6
Porch 93.3
Pergola 78.7
Outdoors 63.5
Window 59

Clarifai
created on 2023-10-29

street 99.4
people 99.2
beach 98.9
city 98.4
sea 97.4
architecture 96.8
girl 96.7
travel 96.4
light 96.1
urban 95.7
ocean 95
bridge 94.6
man 94
landscape 93.6
wedding 93
water 92.5
sky 92.4
boat 91.1
summer 91
tree 90.8

Imagga
created on 2022-02-11

billboard 36.9
structure 35.1
signboard 28.8
building 25.7
city 24.9
sky 22
architecture 19.3
travel 18.3
urban 17.5
bridge 15.5
electronic equipment 14.9
monitor 14.9
night 14.2
buildings 14.2
clouds 12.7
transportation 12.5
equipment 12.5
tourism 12.4
light 12
landscape 11.9
transport 11.9
office 11.6
business 11.5
water 11.3
cockpit 11.1
industry 11.1
landmark 10.8
tower 10.7
glass 10.1
sunset 9.9
steel 9.7
sun 9.7
window 9.6
construction 9.4
house 9.2
car 9.1
road 9
center 8.9
sea 8.6
dusk 8.6
traffic 8.5
bay 8.5
destination 8.4
device 8.4
town 8.3
tourist 8.3
street 8.3
gate 7.9
cloud 7.7
old 7.7
outdoor 7.6
power 7.6
dark 7.5
evening 7.5
ocean 7.5
silhouette 7.4
famous 7.4
technology 7.4
vacation 7.4
coast 7.2
river 7.1

Google
created on 2022-02-11

Sky 94.5
Water 92.4
Cloud 91.6
Shade 84
Tree 83.6
Travel 81.6
Urban design 81.6
Rectangle 78.7
Leisure 78
Tints and shades 77.3
Fence 68.8
Lake 65.8
Glass 62.5
Room 61.3
Metal 60.4
Daylighting 59.7
Arch 58.9
Handrail 57.6
Tourism 55.6
Horizon 52.9

Microsoft
created on 2022-02-11

water 88.9
outdoor 88.5
sky 87.1
person 82.5
tree 79.6
lake 79
text 75.3
vacation 74.9
clothing 73.8
trip 59.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 30-40
Gender Female, 72.3%
Calm 68.5%
Surprised 12.7%
Happy 5.8%
Fear 4.5%
Sad 3.9%
Angry 3.1%
Disgusted 1.2%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 78.7%
Sad 71.7%
Calm 26.6%
Confused 0.4%
Fear 0.3%
Surprised 0.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 90.5%
Fear 82.4%
Sad 9.4%
Confused 2.7%
Calm 1.9%
Surprised 1.5%
Disgusted 1.2%
Angry 0.5%
Happy 0.4%

AWS Rekognition

Age 40-48
Gender Male, 99.8%
Calm 80.1%
Sad 7.3%
Happy 4.6%
Disgusted 2.8%
Fear 2%
Angry 1.4%
Confused 1.1%
Surprised 0.7%

AWS Rekognition

Age 27-37
Gender Male, 65.3%
Calm 83.4%
Happy 7.9%
Fear 3.5%
Sad 2.6%
Disgusted 1.2%
Confused 0.6%
Angry 0.6%
Surprised 0.4%

AWS Rekognition

Age 14-22
Gender Male, 99.3%
Angry 64.8%
Calm 24.2%
Sad 8.2%
Confused 1.2%
Happy 0.7%
Surprised 0.5%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 81%
Fear 47.6%
Calm 24.8%
Sad 13.6%
Confused 5.2%
Disgusted 4.4%
Surprised 2.1%
Happy 1.3%
Angry 1.1%

Feature analysis

Amazon

Person

Clarifai

No features identified

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 97%

AWS Rekognition

Person 96.2%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 91.2%

AWS Rekognition

Person 82.2%

AWS Rekognition

Person 81.8%

AWS Rekognition

Person 80.6%

AWS Rekognition

Person 74.1%

AWS Rekognition

Person 72.6%

AWS Rekognition

Person 67.2%

AWS Rekognition

Person 53.7%

AWS Rekognition

Person 42%

Categories

Imagga
created on 2022-02-11

nature landscape 45.5%
streetview architecture 15.2%
paintings art 14.5%
cars vehicles 10.9%
events parties 5.8%
food drinks 4.3%
text visuals 1.2%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-24

a photograph of a group of people sitting on a balcony

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image depicts a scenic location with a grassy lawn overlooking a wide river. The lawn is bordered by a walkway and fenced railing, and several groups of people are seated or gathered in the outdoor area. A group of individuals sits on benches, while others spend time under a blue umbrella or in clusters on the lawn. The surroundings are lush with trees, and the view of the river stretches into the distance, with some industrial or architectural structures visible on the horizon. The building on the left features balconies and an overhang, adding depth to the composition. The atmosphere is tranquil, suggesting leisure or relaxation.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image features an outdoor scene overlooking a river. In the foreground, there is a grassy lawn with several people sitting and enjoying the day. Some are situated around an area with a blue umbrella, while others sit on a bench along a pathway. The lawn is enclosed by a white railing, and a large building is visible on the left side of the image, with a walkway running alongside it. Trees line the background, and the river stretches out into the distance under a hazy sky.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows an outdoor seating area with a view of a river or body of water. There are several people sitting on benches, enjoying the scenic view. The area is surrounded by trees and has a balcony or deck that overlooks the water. The sky appears to be partly cloudy. The image captures a peaceful and serene outdoor setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This image shows what appears to be a terrace or outdoor seating area overlooking a large body of water, possibly a river or lake. The architecture suggests this might be part of a healthcare facility or retirement community. There's a concrete walkway with safety railings, and several people are seated along benches enjoying the view. The setting includes some landscaped areas with trees and grass between the building and the water. The perspective is taken from above, showing the angular architecture of what seems to be a multi-level structure. In the distance, you can see the waterway stretching toward the horizon with some buildings visible on the far shore. The sky is a light blue, suggesting this was taken on a clear day.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image depicts a serene scene of a group of elderly individuals gathered in a courtyard, overlooking a body of water.

In the foreground, a woman stands on a balcony, gazing out at the courtyard below. She is dressed in a dark blue dress and has her hands clasped together in front of her. The courtyard itself is surrounded by a low railing and features a lush green lawn, where several elderly individuals are seated in chairs or on benches. Some are engaged in conversation, while others appear to be enjoying the peaceful atmosphere.

Beyond the courtyard, a large body of water stretches out, with trees lining the shore. In the distance, a bridge can be seen spanning the water, adding to the tranquil ambiance of the scene. The sky above is a soft blue, dotted with a few wispy clouds, further enhancing the sense of serenity that pervades the image.

Overall, the image conveys a sense of calmness and contentment, as the elderly individuals seem to be enjoying each other's company in this idyllic setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image depicts a serene scene of a group of elderly individuals gathered in a courtyard, with a stunning view of a body of water in the background. The courtyard is surrounded by a building on one side and a railing on the other, creating a sense of enclosure and intimacy.

In the foreground, several people are seated on benches or chairs, engaged in conversation or simply enjoying the scenery. Some are dressed in casual attire, while others wear more formal clothing, suggesting that this may be a social gathering or event.

The courtyard itself is well-manicured, with lush green grass and a few trees scattered throughout. A blue umbrella provides shade for some of the seated individuals, adding a pop of color to the otherwise muted palette.

Beyond the courtyard, the body of water stretches out into the distance, meeting the horizon at a gentle curve. The sky above is a soft blue, with only a few wispy clouds visible. The overall atmosphere is one of tranquility and relaxation, as if the individuals in the courtyard are savoring a peaceful moment together.

Overall, the image conveys a sense of community and connection among the elderly individuals, as well as a deep appreciation for the natural beauty that surrounds them.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image shows a group of elderly people sitting on a bench on a balcony. The balcony has a metal railing and overlooks a grassy area with a view of the sea. Some people are sitting under an umbrella, and others are standing. In the distance, there is a tree and a boat on the sea. The image has a vintage filter and a watermark in the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-05-27

On a sunny day, a group of elderly people are sitting on a bench, and some are sitting on chairs under an umbrella on the balcony of a building. A woman is standing near the railings, and another woman is standing on the balcony. The balcony has a metal railing, and the building is surrounded by trees. In the distance, there is a water body, and the sky is clear with some clouds.

Google Gemini

Created by gemini-2.0-flash on 2025-05-20

The image shows an outdoor scene, seemingly from a balcony overlooking a well-maintained garden. From the balcony, there are two women visible. One is closer, wearing a blue-purple shirt, while the other one is in a blue dress. The garden below features a group of elderly individuals engaged in various activities. Some are seated on a bench, others are sitting in chairs under a blue umbrella, and a few are sitting on a bench. The garden is framed by a white metal railing and a pathway, beyond which lies a wide river. In the distance, an industrial structure can be seen on the opposite bank of the river. The sky above appears slightly hazy, suggesting a mild or partly cloudy day. The composition is taken from an elevated angle, giving a comprehensive view of the setting.

Created by gemini-2.0-flash-lite on 2025-05-20

Here's a description of the image:

Overall Scene: The image captures a sunny day at what appears to be a senior living facility or nursing home. A group of elderly people are enjoying the outdoors. The architecture has a mid-century modern aesthetic.

Foreground:

  • Two elderly women are standing on a balcony or patio, looking out. One is leaning on the railing, and the other is standing nearby.
  • White railings and a concrete walkway are visible.

Midground:

  • A well-maintained green lawn is the central feature of the exterior space.
  • Several groups of people are seated: some on benches and some under a blue and white umbrella at tables. They are likely residents enjoying the view.
  • A walkway or path is present alongside the lawn, with more people sitting in chairs.

Background:

  • A wide river or body of water stretches across the background.
  • The opposite bank of the river features a tree-lined area with industrial structures visible in the distance.
  • The sky is pale blue.
  • There is what appears to be a long bridge in the distance.

Architectural Details:

  • The building has a modern design with clean lines and a flat roof.
  • The cantilevered roof provides shade over the outdoor spaces.
  • Large windows line the building.

Atmosphere: The overall tone is serene and peaceful. The image conveys a sense of relaxation and enjoyment of nature in a comfortable setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts an outdoor scene at what appears to be a residential or recreational facility. The setting is elevated, offering a view of a river and distant cityscape in the background. The photograph is taken from a balcony or terrace, with a few individuals visible in the foreground.

Key details include:

  1. Foreground:

    • Two people are standing on a balcony or terrace, one wearing a blue outfit and the other in a light-colored top. They seem to be looking out towards the river and the people below.
    • The balcony has a white metal railing.
  2. Midground:

    • There is a well-maintained grassy area with a few small groups of people. Some are seated on benches, while others are standing or walking.
    • A small blue umbrella is set up on the grass, possibly providing shade for one of the groups.
  3. Background:

    • The river is calm and stretches across the image, with trees lining its banks.
    • In the distance, a city skyline is visible, with tall buildings and structures faintly discernible.

The overall atmosphere of the image is calm and relaxed, suggesting a leisurely day at a scenic location. The people appear to be enjoying the outdoor setting, possibly socializing or simply taking in the view. The photograph has a vintage feel, indicated by the color tones and the style of clothing worn by the individuals.

Qwen

Text analysis

Amazon

7E
.....
MACOM
فة ..... KIDA
فة
KIDA

Google

7E XACOX
7E
XACOX