Human Generated Data

Title

Untitled (couples, Long Beach)

Date

1978

People

Artist: Sharon Smith, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1722

Human Generated Data

Title

Untitled (couples, Long Beach)

People

Artist: Sharon Smith, American 20th century

Date

1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1722

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Collage 100
Advertisement 100
Poster 100
Person 97.9
Human 97.9
Person 97.8
Person 97.4
Person 97.1
Person 95.6
Person 95.5
Person 95.2
Person 95
Person 94.4
Person 92.8
Person 92.5
Person 89.4
Person 79.5
Person 79
Person 77.5
Sunglasses 76
Accessories 76
Accessory 76
Person 72.8
Person 71
Art 69.4
Person 63.4
Art Gallery 55.9
Person 46.9
Person 43.9
Person 42.5

Clarifai
created on 2023-10-29

collage 99.9
set 99.2
no person 98.2
card 97.7
collection 97.6
paper 97.4
people 97.1
flower 96.9
nature 95.9
woman 95.8
desktop 95.7
group 95.6
vector 95.4
portrait 95.2
beautiful 94.8
picture frame 94.7
painting 94.3
illustration 94.2
art 93.8
retro 93.7

Imagga
created on 2022-03-12

design 28.2
card 22.6
art 18.8
frame 18.7
decoration 18
floral 17.9
collection 16.2
flower 16.1
pattern 15.7
insulating material 15.7
banner 14.7
celebration 14.4
cartoon 14.3
symbol 14.1
business 14
old 13.9
set 13.6
retro 13.1
paper 12.9
gift 12.9
holiday 12.9
graphic 12.4
colorful 12.2
building material 12
template 11.9
letter 11.9
vintage 11.6
group 11.3
color 11.1
elegance 10.9
element 10.7
happy 10.7
mail 10.5
modern 10.5
shape 10.3
icon 10.3
blank 10.3
box 10.2
communication 10.1
decorative 10
fashion 9.8
sign 9.8
collage 9.6
stamp 9.6
leaf 9.3
greeting 9.3
birthday 9.3
fun 9
style 8.9
postage 8.9
invitation 8.7
cute 8.6
print 8.5
black 8.4
traditional 8.3
silhouette 8.3
creative 7.9
drawing 7.8
face 7.8
party 7.7
line 7.7
film 7.7
postcard 7.7
post 7.6
web 7.6
bird 7.4
envelope 7.3
people 7.3
women 7.1

Google
created on 2022-03-12

Facial expression 93.3
Mammal 86.4
Organism 86.3
Rectangle 84.8
Art 84.6
Font 83.9
Sleeve 78.1
Happy 71.1
Room 69.6
Visual arts 69.5
Collage 69.2
Pattern 64.3
Stock photography 61.6
Circle 57.3
Collection 53.4

Microsoft
created on 2022-03-12

gallery 98.9
person 90.1
cartoon 89.6
different 86.3
human face 82.3
room 69.1
white 67.8
clothing 63.3
painted 63.3
various 61
woman 58.2
poster 56.5
painting 55
several 33.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-47
Gender Female, 100%
Calm 83.6%
Happy 5.6%
Disgusted 4.4%
Angry 2%
Sad 1.4%
Confused 1.2%
Fear 1%
Surprised 0.9%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 93.5%
Sad 6.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Confused 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Female, 98.8%
Confused 57.3%
Angry 36.4%
Calm 2.5%
Disgusted 1.9%
Sad 1.1%
Surprised 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 35-43
Gender Male, 95.9%
Happy 98.4%
Calm 0.4%
Fear 0.3%
Surprised 0.3%
Sad 0.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 54-64
Gender Female, 99.4%
Happy 99.9%
Angry 0%
Surprised 0%
Calm 0%
Sad 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 6-12
Gender Male, 89.2%
Happy 99.6%
Confused 0.1%
Sad 0.1%
Disgusted 0%
Angry 0%
Calm 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Female, 98.9%
Happy 99.8%
Angry 0%
Surprised 0%
Confused 0%
Disgusted 0%
Sad 0%
Fear 0%
Calm 0%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 60.9%
Disgusted 13%
Confused 11.2%
Angry 10.9%
Sad 1.7%
Surprised 1%
Fear 0.9%
Happy 0.4%

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 99.5%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 30-40
Gender Female, 100%
Happy 91.4%
Confused 3.4%
Disgusted 2%
Angry 1.1%
Calm 1.1%
Sad 0.7%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Sad 27.3%
Calm 23.7%
Happy 22%
Angry 9.2%
Surprised 6.2%
Fear 5.5%
Disgusted 3.9%
Confused 2.2%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 100%
Angry 0%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Female, 87.8%
Happy 95.1%
Surprised 1.5%
Fear 0.9%
Calm 0.8%
Disgusted 0.7%
Angry 0.4%
Sad 0.3%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Female, 95%
Calm 49.8%
Surprised 10.7%
Fear 8.6%
Angry 8%
Disgusted 7.5%
Happy 6.1%
Sad 5.6%
Confused 3.7%

AWS Rekognition

Age 18-26
Gender Female, 94.8%
Happy 64.8%
Sad 24.3%
Fear 5.6%
Surprised 1.9%
Calm 1.3%
Angry 0.9%
Disgusted 0.6%
Confused 0.6%

AWS Rekognition

Age 10-18
Gender Female, 99.9%
Calm 49.6%
Happy 33.9%
Fear 8.1%
Confused 2.1%
Sad 2.1%
Surprised 1.9%
Disgusted 1.2%
Angry 0.9%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Angry 60.8%
Sad 21.5%
Calm 11%
Disgusted 3%
Fear 1.5%
Confused 0.8%
Happy 0.7%
Surprised 0.6%

AWS Rekognition

Age 43-51
Gender Female, 100%
Happy 99%
Disgusted 0.6%
Sad 0.1%
Angry 0.1%
Surprised 0%
Confused 0%
Calm 0%
Fear 0%

AWS Rekognition

Age 2-10
Gender Female, 75%
Calm 32.1%
Confused 24.2%
Happy 22.3%
Sad 5.8%
Fear 5.2%
Angry 4.3%
Surprised 3.9%
Disgusted 2.2%

AWS Rekognition

Age 49-57
Gender Male, 98.9%
Calm 99.7%
Happy 0.1%
Angry 0.1%
Fear 0%
Confused 0%
Sad 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Female, 99.1%
Angry 32.7%
Calm 19.9%
Sad 13.6%
Disgusted 11.9%
Surprised 7.2%
Happy 5.9%
Confused 4.9%
Fear 3.9%

AWS Rekognition

Age 33-41
Gender Female, 99.7%
Disgusted 35.4%
Angry 25.4%
Calm 23.5%
Confused 6%
Sad 5.5%
Surprised 1.8%
Happy 1.3%
Fear 1.2%

AWS Rekognition

Age 7-17
Gender Male, 99.7%
Happy 49.1%
Angry 26.2%
Sad 13.9%
Calm 6.1%
Surprised 1.4%
Disgusted 1.3%
Fear 1.2%
Confused 0.8%

AWS Rekognition

Age 19-27
Gender Female, 63.5%
Fear 52.4%
Happy 37.4%
Sad 7.5%
Disgusted 0.9%
Surprised 0.8%
Angry 0.5%
Calm 0.3%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 99%
Calm 98.2%
Happy 0.5%
Angry 0.4%
Sad 0.3%
Confused 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Female, 100%
Disgusted 80.8%
Happy 10.4%
Angry 3.4%
Calm 2.1%
Surprised 1.3%
Confused 0.9%
Fear 0.7%
Sad 0.5%

AWS Rekognition

Age 24-34
Gender Female, 93.4%
Calm 76.4%
Happy 8.2%
Angry 6.2%
Surprised 2.6%
Sad 2.6%
Fear 1.5%
Disgusted 1.4%
Confused 1.1%

AWS Rekognition

Age 37-45
Gender Male, 70.6%
Calm 91.8%
Angry 3.5%
Sad 1.5%
Happy 1%
Surprised 1%
Fear 0.5%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 16-24
Gender Female, 98.4%
Calm 74.6%
Happy 17%
Sad 3.8%
Angry 1.5%
Disgusted 0.9%
Confused 0.9%
Fear 0.8%
Surprised 0.5%

AWS Rekognition

Age 23-31
Gender Female, 88.9%
Calm 74.6%
Happy 9.6%
Angry 4.1%
Sad 3.6%
Surprised 2.8%
Disgusted 2%
Fear 1.8%
Confused 1.6%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person
Sunglasses
Person 97.9%
Person 97.8%
Person 97.4%
Person 97.1%
Person 95.6%
Person 95.5%
Person 95.2%
Person 95%
Person 94.4%
Person 92.8%
Person 92.5%
Person 89.4%
Person 79.5%
Person 79%
Person 77.5%
Person 72.8%
Person 71%
Person 63.4%
Person 46.9%
Person 43.9%
Person 42.5%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created by unknown on 2022-03-12

many different animals in a room 48.5%
a close up of many different things in the room 48.4%

Clarifai
created by general-english-image-caption-blip on 2025-05-24

a photograph of a group of people standing around a photo -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image is a collage consisting of nine square photographs arranged in a grid. Each photo depicts groups of people outdoors, likely enjoying leisure activities such as being on a beach or socializing. The scenes suggest warm weather due to the casual attire like swimsuits and summer clothing. The background elements include beach sand, umbrellas, and open skies, indicating a vacation or recreational setting.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a collage of nine square photographs arranged in a 3x3 grid. The photographs feature groups of people in various outdoor settings, likely taken during vacations or outdoor gatherings. In the top row, the leftmost image depicts a group of women on a beach, posing together. The center image shows four men standing on a sandy beach, dressed in swimwear. The right image features three people standing close together, dressed in casual clothes, with a body of water in the background.

In the middle row, the leftmost photo shows two people with their arms around each other. The center image captures a group seated under a beach umbrella, with some of them in swimwear. The right photo shows two people wearing sun hats.

In the bottom row, the leftmost photo shows two individuals in colorful swimwear. The center image depicts three people standing together, dressed in light summer clothes, with the ocean in the background. The right photo shows two people in floral swim attire. The overall composition suggests a theme of leisurely outdoor gatherings, possibly at the beach.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

This image appears to be a collage of several vintage-style photographs. The photographs depict various groups of people, primarily in casual beach or vacation settings. The individuals are dressed in clothing typical of the 1970s or 1980s, and the images have a warm, nostalgic color palette. The photographs capture moments of leisure, togetherness, and enjoyment, suggesting these are memories or snapshots from a shared experience or time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a collection of vintage photographs, likely from the 1970s or 1980s, arranged in a grid format. The photos appear to be beach or summer vacation snapshots, showing groups of people in swimwear and casual summer attire. The color palette has that characteristic vintage look with slightly faded, warm tones typical of photographs from that era. The subjects are wearing period-appropriate swimsuits and clothing, including patterned swim trunks, polka dot swimsuits, and casual beachwear. Some photos show larger groups while others are more intimate shots of two or three people. The beach setting is evident in several shots, with sand and what appears to be ocean or water in the background. The overall collection gives off a nostalgic summer vacation vibe typical of family photo albums from that time period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

The image presents a collection of nine photographs arranged in three rows and three columns, each showcasing a distinct group of people. The photographs are set against a white background, with a thin gray border surrounding the entire image.

Each photograph features a unique group of individuals, with some capturing moments of leisure and relaxation, while others appear to be more formal or posed. The groups vary in size, ranging from two to six people, and include both men and women. Some individuals are dressed in casual attire, such as swimsuits or shorts, while others wear more formal clothing, like dresses or suits.

The photographs themselves have a vintage quality, with a warm, faded tone that suggests they may have been taken several decades ago. The overall effect is one of nostalgia and retro charm, evoking a sense of a bygone era.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image presents a collection of nine photographs, arranged in three rows of three, showcasing various individuals and groups on a beach. The photographs are set against a light beige background, with a subtle gray border surrounding the entire image.

Photograph Details:

  • Each photograph is a small, square image with a vintage aesthetic, featuring individuals and groups in swimsuits, casual clothing, or beach attire.
  • The photographs depict a range of scenes, including:
    • Group portraits of people posing on the beach.
    • Individuals and couples enjoying the beach and water.
    • People engaging in activities such as swimming, sunbathing, and playing games.
  • The photographs appear to be taken during the daytime, with clear skies and sunny conditions visible in the background.

Overall Impression:

The image conveys a sense of relaxation and leisure, capturing the joy and camaraderie of people enjoying a day at the beach. The vintage aesthetic of the photographs adds a nostalgic touch, evoking memories of summertime fun and carefree moments.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image shows a collage of Polaroid photographs. The photographs are arranged in a grid, with each photo occupying its own space within the grid. The photos depict various people, including families, groups of friends, and individuals, engaged in different activities. Some of the photos show people smiling and posing for the camera, while others capture more candid moments. The photos are in different sizes and orientations, adding to the collage's visual interest. Overall, the image conveys a sense of nostalgia and captures the essence of a bygone era.

Created by amazon.nova-pro-v1:0 on 2025-05-24

A collection of Polaroid photographs is arranged in a grid pattern on a white background. Each Polaroid image captures a different moment or scene, showcasing various individuals and groups. The photos depict people in different settings, such as beaches, outdoor gatherings, and casual indoor moments. The subjects are dressed in a variety of outfits, including swimwear, casual clothing, and formal attire. The images convey a sense of nostalgia and capture the essence of different moments in time.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-22

Here's a description of the image:

Overall Impression: The image is a collage or a multiple-frame presentation of several photographs. They are arranged in a 3x3 grid, all inset into a large, off-white rectangular mat.

Details of the Photographs:

  • Subject Matter: The photographs seem to depict scenes of people enjoying leisure activities, likely on vacation or a day out. Many of them are on beaches. There are groups of people, couples, and individuals.
  • Photography Style: The style of the photographs indicates that they may be from the mid to late 20th century, likely from the 1970s or 1980s due to the clothing styles and the color processing. The images are all colorful and show a level of snapshot aesthetic.
  • Composition: The nine frames are individual photographs, each telling a small story or capturing a moment.
  • Color: The images are rich in color. They seem to be taken outside on a sunny day.

In summary: This image is a compilation of personal photographs, probably taken during a vacation or on a beach. The style of the photographs and the arrangement of the frames evoke a sense of nostalgia and a specific time period.

Created by gemini-2.0-flash on 2025-05-22

The image shows nine small, square photographs arranged in a 3x3 grid, mounted on a white square background. The white background is framed by a larger gray square, creating a border around the photos. The photographs appear to be vintage and depict various scenes of people at the beach or poolside, presumably taken during the summer.

The top-left photo features a group of people in beachwear on a sandy beach, suggesting a family or group vacation. The top-middle photo shows a group of men, some wearing patterned wraps, standing on a beach with the ocean in the background. The top-right photo captures three people in casual summer attire, possibly on a boardwalk or pier.

In the middle row, the left photo portrays a child with reddish hair embracing an adult man, both with bare torsos, implying they are at the beach or pool. The middle photo shows a man and a woman in a yellow dress sitting under a beach umbrella, with other people in the background. The middle-right photo features two women in swimwear and hats, possibly at a poolside.

The bottom row begins with a photo of two women in swimwear, one with a dark complexion, sitting by what seems to be a lounge chair. The middle photo presents three women in what could be religious garb, standing near beach chairs and possibly on a boardwalk. The bottom-right photo shows two women in swimwear and hats, under what appears to be a beach umbrella.

Overall, the image compilation presents a collection of memories from various beach or poolside summer vacations, captured in the style of vintage photographs.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image is a collage of nine photographs arranged in a 3x3 grid. Each photograph appears to be a vintage or retro snapshot, likely from the 1970s or 1980s, based on the clothing and overall aesthetic. Here is a detailed description of each photograph:

Top Row:

  1. Top Left: A group of people, including children and adults, posing together on a beach. They are dressed in swimwear and casual clothing.
  2. Top Center: Four men standing on a beach, wearing swim trunks. They appear to be enjoying a sunny day.
  3. Top Right: A group of people, including men and women, posing together. They are dressed in casual clothing, and some are holding drinks.

Middle Row:

  1. Middle Left: A man and a woman posing together. The man is shirtless and wearing a towel, while the woman is wearing a swimsuit.
  2. Middle Center: A group of people under an umbrella on the beach. They are dressed in swimwear and appear to be enjoying a picnic or gathering.
  3. Middle Right: Two women posing together. One is wearing a swimsuit and a headscarf, while the other is wearing a swimsuit and sunglasses.

Bottom Row:

  1. Bottom Left: A woman and a child posing together. The woman is wearing a swimsuit, and the child is wearing a colorful outfit.
  2. Bottom Center: A group of people, including men and women, posing together on a beach. They are dressed in swimwear and casual clothing.
  3. Bottom Right: Two women posing together. They are wearing swimsuits and appear to be enjoying a sunny day.

Overall, the collage captures moments of leisure and enjoyment, likely during a beach outing or vacation. The photographs convey a sense of camaraderie and relaxation, typical of summer activities.