Human Generated Data

Title

Untitled (two little girls)

Date

1978

People

Artist: Sharon Smith, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.2105

Human Generated Data

Title

Untitled (two little girls)

People

Artist: Sharon Smith, American 20th century

Date

1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.2105

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Sea 99.8
Ocean 99.8
Water 99.8
Nature 99.8
Outdoors 99.8
Shoreline 99.7
Human 99.2
Clothing 98.6
Apparel 98.6
Beach 98.4
Coast 98.4
Shorts 96.7
Sand 90.6
Face 90
Female 85.1
Blonde 83.2
Kid 83.2
Girl 83.2
Teen 83.2
Woman 83.2
Child 83.2
Vacation 78.1
Hair 77.1
Portrait 75.8
Photography 75.8
Photo 75.8
Bay 69.3
Land 63.9
Boy 61.7
Sleeve 59.4
Swimwear 56.4

Clarifai
created on 2023-10-29

beach 99.8
summer 99.4
water 99.3
child 99.3
sea 99
ocean 98.9
ma 98.5
vacation 98.5
girl 98.2
sand 97.7
travel 97.3
fun 97.2
family 96.9
love 96.8
woman 96.7
people 95.5
seashore 95
daddy 94.4
portrait 94.4
togetherness 93.7

Imagga
created on 2022-02-26

beach 60.3
sea 43.8
vacation 40.9
ocean 35.4
sand 33.2
summer 32.2
water 30.7
holiday 27.2
happy 27
tropical 25.6
child 25.5
people 24
person 23.5
coast 23.4
lifestyle 23.1
travel 22.5
fun 22.5
bikini 22.2
relax 21.9
man 20.8
happiness 20.4
couple 20
garment 20
swimsuit 19.7
smile 18.5
clothing 18.5
shore 17.7
sun 17.7
outdoors 17.3
male 16.8
pretty 16.8
smiling 16.6
leisure 16.6
sky 16.6
love 16.6
sexy 16.1
relaxation 15.9
island 15.6
paradise 15.1
healthy 14.5
adult 14.4
portrait 14.2
snorkel 13.8
joy 13.4
model 13.2
body 12.8
attractive 12.6
brother 12.6
outdoor 12.2
boy 12.2
resort 12.2
girls 11.9
wet suit 11.7
tan 11.5
running 11.5
together 11.4
brunette 11.3
play 11.2
swimming trunks 11
covering 10.8
family 10.7
lady 10.6
parent 10.4
wave 10.4
coastline 10.3
breathing device 10.3
waves 10.2
playing 10
relaxing 10
one 9.7
hair 9.5
women 9.5
outside 9.4
vacations 9.4
youth 9.4
cute 9.3
sunglasses 9.2
holding 9.1
recreation 9
kid 8.9
sandy 8.7
sunny 8.6
device 8.6
seaside 8.5
walking 8.5
children 8.2
romance 8
romantic 8
world 8
mother 8
little 8
tanning 7.9
sunbathing 7.9
day 7.8
hands 7.8
pacific 7.7
float 7.7
pool 7.7
swimming 7.7
two 7.6
walk 7.6
adults 7.6
enjoyment 7.5
human 7.5
relationship 7.5
rest 7.4
fit 7.4
maillot 7.4
freedom 7.3
blond 7.3
tranquil 7.2
horizon 7.2
looking 7.2
childhood 7.2
wet 7.2
face 7.1

Google
created on 2022-02-26

Water 96
Shorts 90.3
Beach 89.2
Sky 88.4
People on beach 87
Gesture 85.3
Happy 83.1
People in nature 80.5
Aqua 80.4
Adaptation 79.2
T-shirt 72.8
Travel 72.1
Vintage clothing 69.9
Rectangle 67.8
Fun 66.4
Toddler 66
Sand 65.2
Ocean 63.6
Holiday 61
Leisure 58.3

Microsoft
created on 2022-02-26

beach 97.9
monitor 95.2
clothing 94
text 93.3
person 90.8
human face 85.4
water 83.4
posing 82.3
child 81.8
smile 78.7
boy 55.3
ocean 51.8
picture frame 41.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 100%
Angry 54.7%
Happy 38.5%
Confused 2.3%
Disgusted 1.9%
Sad 1.2%
Surprised 0.7%
Fear 0.4%
Calm 0.4%

AWS Rekognition

Age 2-10
Gender Female, 100%
Happy 99.6%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Calm 0.1%
Surprised 0.1%
Fear 0%

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Picture frame
Human face
Clothing
Boy
Girl
Footwear
Human leg
Person
Human arm
Human hair

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.1%

Clarifai

Picture frame 89.5%

Clarifai

Human face 82.4%

Clarifai

Human face 73.9%

Clarifai

Clothing 80.9%

Clarifai

Clothing 69.8%

Clarifai

Clothing 63%

Clarifai

Boy 58.4%

Clarifai

Girl 57.7%

Clarifai

Footwear 56.4%

Clarifai

Footwear 55.1%

Clarifai

Human leg 42.2%

Clarifai

Human leg 39.2%

Clarifai

Person 39.4%

Clarifai

Human arm 39.3%

Clarifai

Human arm 36.4%

Clarifai

Human arm 35.1%

Clarifai

Human hair 34.8%

Categories

Imagga
created on 2022-02-26

paintings art 91.5%
events parties 6.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

person and me on the beach.

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of two young girls standing on a beach

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts two young children standing on a sandy beach near the shore. One child is wearing a bright swimsuit with a colorful design and holding a blue bucket, while the other child is dressed in a white t-shirt adorned with a cartoon character and appears to be wearing briefs or a diaper. The ocean and gentle waves are visible in the background, along with another person walking on the beach. The scene is bathed in natural light and has a nostalgic, vintage vibe, characteristic of a Polaroid photograph.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image shows two young children standing on a sandy beach. One child is wearing a red and yellow swimsuit with blue shorts and holding a light blue bucket. The other child is wearing a white t-shirt with black shorts. In the background, the ocean is visible with gentle waves, and there is another person walking along the shoreline. The sky is clear and blue, suggesting a sunny day at the beach. The image has a vintage Polaroid frame, indicating it might be an old photograph.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows two young children, a girl and a boy, standing on a beach. The girl is wearing a colorful swimsuit with a yellow top and blue and white bottoms. The boy is wearing a white t-shirt with a graphic design. Both children are smiling and appear to be enjoying themselves on the beach. The ocean and sky can be seen in the background, indicating this is an outdoor, beach setting. The image has a vintage, polaroid-style appearance, suggesting it may be an old photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a vintage Polaroid photo taken at a beach on a sunny day. Two young children are standing together on the sand, wearing swimsuits. One child is wearing a colorful swimsuit with stars and is holding a blue beach bucket, while the other is wearing a white t-shirt with what appears to be a Mickey Mouse design. The ocean can be seen in the background with waves breaking, and there's a turquoise-colored sky above. The photo has that characteristic vintage color saturation and feel that's typical of old Polaroid photographs from perhaps the 1980s or early 1990s.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a Polaroid photograph of two young children standing on a beach. The child on the left has blonde hair and is wearing a Wonder Woman swimsuit, holding a blue bucket. The child on the right has dark hair and is wearing a white onesie with a Mickey Mouse design.

In the background, there is a person running on the beach, and the ocean can be seen in the distance. The sky is blue and clear, suggesting a sunny day. The overall atmosphere of the image is one of fun and playfulness, capturing a carefree moment of childhood.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

This image is a Polaroid photograph of two young children standing on a beach, with the ocean in the background. The child on the left has blonde hair and is wearing a red, yellow, and blue swimsuit, while holding a blue bucket in their right hand. The child on the right has dark hair and is wearing a white onesie with a Mickey Mouse design.

In the background, there is a person walking along the shoreline, and the sky is clear and blue. The overall atmosphere of the image suggests a fun day at the beach for the two children.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a Polaroid photograph featuring two young children standing on a beach. The girl on the left is wearing a red and yellow swimsuit with a star pattern on the back, and she is holding a blue bucket. The boy on the right is wearing a white t-shirt with a cartoon character on it and a pair of white shorts. They are both smiling and seem to be posing for the camera. In the background, there is a person walking on the beach, and the ocean is visible in the distance.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image has a white border and a square shape. It features two children standing on the beach. The child on the left is holding a bucket in her right hand, and the child on the right is wearing a white outfit with a cartoon character printed on it. In the distance, a person is standing on the shore. The sea is calm, and the sky is clear.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here is a description of the image:

The image is a Polaroid photograph of two young children standing on a beach. The child on the left is a blonde girl with a big smile. She wears a colorful bathing suit, her lower half a pattern of stars like Wonder Woman's costume, and holds a blue bucket. The child on the right is a darker-skinned child with curly hair, also smiling, wearing a white t-shirt with a Mickey Mouse design and what appears to be a bathing suit bottom.

In the background, there is a beach scene with calm waves and a clear blue sky. There appears to be a person walking in the distance. The photo has an aged, vintage quality with slightly muted colors and a Polaroid frame. Their shadows stretch to the left of them.

Created by gemini-2.0-flash-lite on 2025-05-08

Here's a description of the image:

The image is a Polaroid photograph depicting two young children, likely toddlers, on a beach. The setting is a bright, sunny day with a vibrant blue sky and a turquoise-colored ocean in the background. The children are standing close together in the center of the frame, smiling and looking directly at the camera.

  • The girl on the left: She has blonde hair and is wearing a colorful swimsuit with a red top and star-spangled blue bottoms. She is holding a blue bucket.
  • The child on the right: This child has darker skin and curly dark hair. They are wearing a white t-shirt with a black and red Mickey Mouse graphic and what appears to be a diaper.

A person, likely an adult or older child, is visible in the distance, walking along the shoreline. The sand on the beach looks light-colored. The shadows cast by the children indicate the sun is high in the sky. The Polaroid frame around the photo gives it a vintage feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-09

The image depicts two young children standing on a sandy beach near the ocean. The child on the left is holding a blue bucket and is wearing a colorful swimsuit with a pattern that includes red, yellow, and blue. The child on the right is wearing a white t-shirt with a cartoon character design and white shorts. Both children are barefoot and appear to be enjoying their time at the beach, with smiles on their faces. In the background, the ocean waves can be seen, and there is another person farther away near the water. The sky is clear, indicating a sunny day. The photograph has a vintage, slightly faded quality, suggesting it might be an older photo.

Qwen

No captions written

Text analysis

Amazon

JAPAN