Human Generated Data

Title

Untitled (young boy, baby, and dog seated on carpeted brick steps outdoors)

Date

c. 1940, printed later

People

Artist: Paul Gittings, American 1900 - 1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12818

Human Generated Data

Title

Untitled (young boy, baby, and dog seated on carpeted brick steps outdoors)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12818

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.6
Pet 98.2
Canine 98.2
Mammal 98.2
Animal 98.2
Clothing 87.5
Apparel 87.5
Shorts 87.5
Potted Plant 86.1
Plant 86.1
Pottery 86.1
Vase 86.1
Jar 86.1
Tire 72.9
Pot 61.9
Planter 61
Finger 57.7
Child 56.6
Kid 56.6
Furniture 56.1
Couch 56.1
Flagstone 55.7
Outdoors 55.6

Clarifai
created on 2019-11-16

people 99.9
monochrome 98.5
child 98.4
group 97.8
woman 97.5
group together 96.4
adult 95.4
portrait 94.6
man 94.4
street 94.3
family 93.6
wear 91.4
sit 90.1
dog 90.1
two 88.4
music 88.3
dancer 87
canine 86.9
many 86.6
three 85.8

Imagga
created on 2019-11-16

dog 33.7
shepherd dog 27.1
people 22.9
adult 22.8
collie 21.8
love 21.3
person 19.6
couple 19.1
canine 19
man 18.1
happy 17.5
portrait 17.5
outdoors 16.6
trainer 16.5
attractive 15.4
male 14.9
outdoor 14.5
kin 14.3
fashion 14.3
fun 14.2
domestic animal 14.2
dark 13.4
happiness 13.3
park 13.2
sitting 12.9
water 12.7
together 12.3
home 12
hound 11.7
child 11.2
two 11
model 10.9
joy 10.8
lifestyle 10.8
smile 10.7
river 10.7
face 10.6
pretty 10.5
sexy 10.4
boy 10.4
hair 10.3
black 10.2
park bench 10.1
bench 9.9
lady 9.7
life 9.7
summer 9.6
fur coat 9.6
looking 9.6
body 9.6
wife 9.5
hunting dog 9.1
relaxing 9.1
romantic 8.9
family 8.9
night 8.9
interior 8.8
women 8.7
day 8.6
married 8.6
luxury 8.6
enjoy 8.5
passion 8.5
leisure 8.3
sky 8.3
street 8.3
dress 8.1
romance 8
light 8
smiling 7.9
cute 7.9
furniture 7.9
cold 7.7
couch 7.7
men 7.7
seat 7.7
room 7.7
expression 7.7
coat 7.7
husband 7.6
casual 7.6
erotic 7.6
pleasure 7.5
relaxation 7.5
lying 7.5
human 7.5
one 7.5
silhouette 7.4
cheerful 7.3
indoor 7.3
sensual 7.3
color 7.2
television 7.2
childhood 7.2
wet 7.2
posing 7.1
kid 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

toddler 96.1
baby 94
person 91.8
child 91
outdoor 90.7
black and white 88.1
human face 87.2
clothing 85.2
boy 80.2
text 72.4
monochrome 60.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 53.7%
Surprised 0.4%
Happy 97.1%
Sad 0.4%
Fear 0.2%
Calm 0.9%
Confused 0.2%
Disgusted 0.1%
Angry 0.8%

AWS Rekognition

Age 0-3
Gender Female, 69.6%
Happy 0%
Sad 13%
Disgusted 1.1%
Surprised 1.5%
Fear 4.3%
Angry 75.5%
Confused 2.3%
Calm 2.2%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Dog

Clarifai

Human face
Clothing
Tree
Footwear
Boy
Human arm
Human leg
Flowerpot
Dog
Houseplant

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.3%

AWS Rekognition

Dog 98.2%

Clarifai

Human face 93%

Clarifai

Human face 87.5%

Clarifai

Clothing 92.6%

Clarifai

Clothing 85.6%

Clarifai

Tree 90%

Clarifai

Tree 69.8%

Clarifai

Tree 50.4%

Clarifai

Tree 50.3%

Clarifai

Tree 45.5%

Clarifai

Tree 42.4%

Clarifai

Footwear 82.9%

Clarifai

Footwear 71.8%

Clarifai

Footwear 67.2%

Clarifai

Footwear 54.1%

Clarifai

Footwear 45.8%

Clarifai

Footwear 34.7%

Clarifai

Boy 66.8%

Clarifai

Human arm 44.8%

Clarifai

Human arm 33.4%

Clarifai

Human leg 41.8%

Clarifai

Human leg 35.6%

Clarifai

Human leg 34.6%

Clarifai

Flowerpot 41.1%

Clarifai

Dog 38.9%

Clarifai

Houseplant 33.7%

Categories

Imagga
created on 2019-11-16

people portraits 97%
paintings art 1.9%

Captions

Microsoft
created by unknown on 2019-11-16

a person sitting on a bench 75.3%
a group of people posing for a photo 70%
a girl sitting on a bench 59.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-27

a photograph of a young boy sitting on a couch with a dog

Created by general-english-image-caption-blip-2 on 2025-07-10

a black and white photo of two children and a dog

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image depicts an outdoor scene featuring two young children sitting on a patterned surface beside a Collie dog. One child is dressed in a short-sleeved outfit and holding a small object, while the other is wearing a simple dress. To the right, there is a large decorative planter with lush foliage. In the background, there are trees and a soft view of a house or structure, giving the setting a serene and natural feel. The brickwork and fabric suggest a cozy, comfortable space.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image depicts two children sitting outdoors on a patterned blanket spread over what seems to be steps or a low wall. Next to them, on the left, is a large, furry dog resting on the same surface. The child on the right is wearing a sleeveless outfit with a sailor-style collar and white shoes. Beside them is a large potted plant with leafy foliage positioned on a brick surface. The background is blurred, showing what appears to be trees and possibly a grassy area, indicating that the scene is likely a garden or park setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows two young children sitting on a stone bench or wall in an outdoor setting. The background appears to be a garden or park, with trees and foliage visible. The children are dressed in casual clothing, with one child wearing a white shirt and the other wearing a patterned outfit. The image is in black and white, giving it a nostalgic and timeless quality.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-16

The black and white image shows two young children, a boy and a girl, sitting together on some stone steps outdoors. They both have short hair and are wearing light-colored outfits that look like rompers or short overalls. The boy has his arm around a large, fluffy dog lying next to them on the steps. Trees and foliage can be seen in the blurred background, suggesting they are in a park or garden setting. The children have happy expressions as they sit closely together with the dog, giving the impression of a sweet, carefree moment captured from their childhood.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a vintage black and white photograph showing two young children sitting on what looks like a stone or brick wall. They're wearing light-colored summer clothing, possibly from around the 1940s or 1950s based on the style. Next to them is what appears to be a large dog, possibly a collie or similar long-haired breed, lying down on the wall. The background is slightly blurred but shows trees or foliage. The composition has a casual, everyday life quality typical of family photographs from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of two children and a dog sitting on a bench.

The child on the left is a baby with no hair, wearing a white dress with ruffles around the collar and buttons down the front. The child on the right is a boy with short hair, wearing a white sailor suit with a dark collar and buttons down the front. He has his arm around the baby and is holding a fishing pole in his other hand. The dog is a large, fluffy dog with long hair and a dark face. It is sitting on the bench to the left of the children.

The bench is made of stone and has a patterned cushion on it. There are plants in pots behind the children and trees in the background. The overall atmosphere of the image is one of happiness and contentment, as the children seem to be enjoying each other's company and the outdoors.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of two children and a dog sitting on a bench. The child on the left appears to be a baby, while the child on the right seems to be slightly older. The dog is positioned on the left side of the image, with its head resting on the bench. The children are dressed in white clothing, with the older child wearing a sailor-style outfit and the baby wearing a short-sleeved shirt and shorts. The background of the image is blurry, but it appears to be a park or garden setting, with trees and other foliage visible. The overall atmosphere of the image is one of innocence and joy, capturing a happy moment in the lives of the two children and their canine companion.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph featuring two children, a baby and a young boy, sitting on a brick wall with a dog. The baby is seated on the wall, while the boy is sitting on the edge, holding a stick in his hand. The baby is wearing a white dress, and the boy is wearing a white shirt and shorts. The dog is sitting next to the baby, looking up at the boy. The background is blurry, with trees and plants visible.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The black-and-white image features two children and a dog sitting on a stone structure, possibly a wall, with a potted plant beside them. The boy, on the right, is smiling and holding a stick in his right hand. He is wearing a white outfit with a collar. The baby, on the left, is sitting on a carpet and looking to the left. Behind them, there are trees and a blurry background.

Google Gemini

Created by gemini-2.0-flash on 2025-05-11

Here's a description of the image:

This is a black and white photograph featuring two young children and a dog. The children appear to be siblings. The older child, a boy, sits with his legs crossed and a smile on his face. He's dressed in a sailor-style outfit, complete with a vest-like top and short pants. He holds what looks like a toy airplane. The younger child, a baby, sits next to him wearing a simple dress with puffed sleeves.

A large collie dog is positioned next to the baby, resting its paws on what appears to be a rug or patterned fabric draped over a surface. The children and the dog are sitting on a low brick structure, possibly a wall or raised platform.

In the background, there are trees suggesting an outdoor setting, such as a park or a yard. To the right of the children, there is a potted plant. The photograph has a vintage feel due to its style and the attire of the subjects.

Created by gemini-2.0-flash-lite on 2025-05-11

Here's a description of the image:

Overall Scene: This is a vintage black and white photograph, likely taken outdoors. It captures a charming scene of childhood.

Subject and Composition: The main focus is on two children: a slightly older boy and a younger baby. They are sitting on a low brick wall or ledge, possibly next to a large potted plant. A large, fluffy dog is curled up next to the baby, adding a strong element of comfort and companionship.

Details:

  • The Boy: The older boy is smiling broadly. He is wearing a sailor-style outfit – a vest-like top with nautical details and shorts. He appears to be holding a small toy airplane.
  • The Baby: The baby is smaller and appears to be a girl. She is wearing a simple, light-colored dress with a ruffled collar. Her expression is more serious, looking slightly wide-eyed.
  • The Dog: The dog is a large, long-haired breed, possibly a Collie or similar. Its fur looks soft and lush. The dog's presence enhances the friendly, homey atmosphere of the image.
  • Setting: The background is blurred, suggesting a garden or outdoor setting. There are trees and foliage in the distance.

Mood and Impression: The photograph conveys a sense of nostalgia, innocence, and the special bond between children and their pets. It's a sweet snapshot of a moment in time, likely taken during a leisurely outdoor activity. The monochromatic tones add to the vintage feel of the image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-08

The image is a black-and-white photograph featuring two young children and a dog. The children are sitting on a low brick wall, with a patterned rug beneath them. The child on the left appears to be a baby or toddler, dressed in a light-colored outfit with short sleeves and socks. The child on the right is slightly older, wearing a sailor-style outfit with a collared shirt and shorts. The dog, which looks like a large, long-haired breed, is lying on the rug next to the children, facing the camera. In the background, there are some plants in pots and blurred figures of people, suggesting an outdoor setting, possibly a garden or park. The overall scene appears to be a casual, family-oriented moment captured in time.

Qwen

No captions written