Human Generated Data

Title

Untitled (woman with two young daughters standing in front of iron railing on porch)

Date

c. 1940, printed later

People

Artist: Paul Gittings, American 1900 - 1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12785

Human Generated Data

Title

Untitled (woman with two young daughters standing in front of iron railing on porch)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12785

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 99.3
Apparel 99.3
Human 99.2
Coat 90
Overcoat 90
Outdoors 88.1
Home Decor 87.2
Nature 79.7
Footwear 78.2
Snow 75.2
Female 67.7
Dress 66.8
Plant 61.7
Paper 61.5
Pants 58.8
Suit 58.1
Ice 58

Clarifai
created on 2019-11-16

people 99.9
adult 98.3
woman 97.9
wear 97.7
two 96.2
group 95.8
man 93.2
group together 92.5
dress 92.4
child 90.8
actress 89.7
street 89
outfit 88.8
wedding 87.9
fashion 86.7
one 85.3
many 85
monochrome 83.9
three 81.1
girl 80.9

Imagga
created on 2019-11-16

sax 25.6
person 24.7
man 21.7
people 21.2
black 18
musical instrument 15.8
portrait 15.5
male 14.2
wind instrument 14
planner 13.8
attractive 13.3
adult 12.6
lady 12.2
grunge 11.9
drawing 11.7
couple 11.3
fashion 11.3
happy 10.6
outdoors 10.4
style 10.4
city 10
dress 9.9
sexy 9.6
lifestyle 9.4
smile 9.3
business 9.1
silhouette 9.1
pretty 9.1
sketch 9.1
old 9.1
stringed instrument 9
businessman 8.8
standing 8.7
play 8.6
bass 8.6
bowed stringed instrument 8.6
model 8.5
cello 8.5
studio 8.4
active 8.1
office 8
chair 8
looking 8
job 8
musician 7.9
cute 7.9
singer 7.8
men 7.7
winter 7.7
outdoor 7.6
power 7.6
human 7.5
one 7.5
holding 7.4
park 7.4
street 7.4
professional 7.3
smiling 7.2
work 7.2
face 7.1
day 7.1
sport 7
sky 7

Google
created on 2019-11-16

Photograph 97.4
Black-and-white 87.9
Snapshot 87.3
Standing 85.8
Photography 77
Picture frame 75.7
Tree 74.7
Stock photography 72.2
Monochrome 64.3
Plant 58.5
Window 53.8
Style 53.5
Art 50.2

Microsoft
created on 2019-11-16

clothing 95.2
person 92.7
text 90.5
standing 87.6
dress 82.8
woman 73.6
footwear 73.1
posing 65.2
white 64.6
black and white 62.6
store 35.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 52.7%
Happy 45.1%
Disgusted 45%
Confused 45.1%
Calm 54.7%
Fear 45%
Sad 45.1%
Angry 45.1%
Surprised 45%

AWS Rekognition

Age 4-14
Gender Female, 54.8%
Sad 45%
Calm 45.1%
Angry 45%
Fear 45%
Happy 54.8%
Surprised 45%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 1-7
Gender Female, 54.5%
Fear 45.2%
Surprised 45.1%
Angry 45.3%
Sad 47.6%
Disgusted 45%
Happy 50.8%
Calm 45.9%
Confused 45.1%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe

Clarifai

Footwear
Dress
Girl
Human face
Woman
Picture frame
Chair
Window
Human leg
Tree
Plant
Human arm
Flower

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.5%

AWS Rekognition

Shoe 78.2%

Clarifai

Footwear 88.5%

Clarifai

Footwear 86.7%

Clarifai

Footwear 86.5%

Clarifai

Footwear 85.1%

Clarifai

Footwear 70.2%

Clarifai

Footwear 58.5%

Clarifai

Footwear 48.7%

Clarifai

Footwear 44.8%

Clarifai

Footwear 44.1%

Clarifai

Footwear 38.3%

Clarifai

Footwear 35.4%

Clarifai

Dress 79.8%

Clarifai

Dress 67.9%

Clarifai

Girl 77%

Clarifai

Girl 49.4%

Clarifai

Human face 74.8%

Clarifai

Human face 64.2%

Clarifai

Human face 45.1%

Clarifai

Woman 71%

Clarifai

Picture frame 70%

Clarifai

Chair 50.1%

Clarifai

Window 45.5%

Clarifai

Human leg 42.4%

Clarifai

Human leg 42.2%

Clarifai

Human leg 35.6%

Clarifai

Human leg 34%

Clarifai

Tree 40.5%

Clarifai

Plant 37%

Clarifai

Plant 34.6%

Clarifai

Human arm 34.7%

Clarifai

Flower 33.6%

Categories

Imagga
created on 2019-11-16

streetview architecture 94.9%
paintings art 4.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a woman in a dress and a child in a chair

Created by general-english-image-caption-blip-2 on 2025-07-10

an old black and white photo of a woman and two children

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This black-and-white photograph shows three individuals standing on a sunny outdoor patio or veranda. The setting includes a wrought iron railing and a striped awning overhead, with leafy foliage visible in the background. The central figure is wearing a button-down dress and standing between two smaller individuals, who appear to be children. The child on the left is leaning on the central figure and wearing a short dress with socks and shoes, while the child on the right is standing independently, wearing a dress with ruffled detailing. The patio also features a metal chair on the left-hand side. Shadows cast by the railing and foliage create patterns on the ground.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a black-and-white photograph depicting a family scene. A woman, dressed in a buttoned dress that reaches below her knees, is standing on a sunlit porch. She has her arms around two young children who are by her side. The child on the left is wearing a short-sleeved dress with a collar and is resting her arm around the woman's waist, while the child on the right is wearing a dress with ruffled shoulders and is holding a small object. Both children are wearing socks and shoes. The porch has a wrought-iron railing and part of a metal chair is visible on the left. The background shows foliage, indicating that the porch may overlook a garden or yard. The photo has a nostalgic feel, reminiscent of mid-20th-century family portraits.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a woman and two young girls standing on a porch or balcony surrounded by lush, flowering plants. The woman is wearing a long dress or coat, and the girls are wearing dresses as well. The scene appears to be from an earlier time period, as evidenced by the black and white photograph. The overall atmosphere is one of a warm, family-oriented setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, likely the 1930s or 1940s. The image shows three people standing on what appears to be a front porch or veranda of a brick building. There's a woman wearing a button-down dress with short sleeves, and two young children in dresses. The porch has a decorative metal railing and is surrounded by foliage or vines. There's also what appears to be a metal chair visible on the porch. The lighting creates interesting shadows on the wooden porch floor, and the overall composition has a nostalgic, documentary-style quality typical of photographs from that period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-07

The image is a black-and-white photograph of a woman and two young girls posing on a porch.

The woman, likely a mother or caregiver, stands in the center of the image, wearing a long dress with buttons down the front and a belt at her waist. She has short hair and stands with her feet shoulder-width apart, facing the camera. Her left arm is around the shoulders of the girl on her right, and her right arm is down by her side.

To the woman's left is a young girl with long hair, wearing a dark dress with white trim and black socks and shoes. She has her arms crossed over her chest and is looking at the camera.

To the woman's right is another young girl with short hair, wearing a light-colored dress with white socks and shoes. She is looking down at the ground and appears to be holding something in her hands.

In the background, there is a brick house with a window and a chair on the porch. There are also trees and bushes surrounding the porch, and a fence in front of them. The overall atmosphere of the image is one of warmth and happiness, as the three individuals appear to be enjoying each other's company on a sunny day.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-07

This image is a black-and-white photograph of a woman and two young girls standing on a patio. The woman, positioned centrally, wears a light-colored dress with buttons down the front and has short dark hair. She stands behind the two girls, who are dressed in dark dresses with white accents and white shoes. The girl on the left has her arms wrapped around the woman's leg, while the girl on the right stands slightly in front of her.

In the background, a brick building with windows is visible to the left, accompanied by a metal chair and a small tree. A black metal fence separates the patio from the surrounding foliage. The overall atmosphere of the image suggests a warm and sunny day, with dappled sunlight casting shadows on the patio floor. The photograph appears to be an old family portrait, capturing a tender moment between the woman and the two young girls.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph featuring a woman and two young girls standing on a porch. The woman, dressed in a button-up blouse and a skirt, stands between the two girls, who are holding hands. The image captures a moment of family togetherness, with the woman smiling and the girls looking at the camera. The porch is adorned with a metal railing, and a chair is placed to the left. Behind the family, there is a tree with leaves and a brick building, suggesting a residential setting.

Created by amazon.nova-pro-v1:0 on 2025-06-07

A black-and-white photo of a woman and two young girls standing on a balcony. The woman is wearing a dress and holding the hand of the girl on the right. The girl on the left is holding the waist of the woman. The balcony has a metal railing and a brick wall. Behind them is a chair and a tree with leaves. The photo has a black border.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-03

Here's a description of the image:

This is a black and white photograph of a woman and two young girls posing on a porch. The woman is standing in the center of the image, wearing a dress that buttons down the front. She has her hair pulled back and is looking directly at the camera with a somewhat serious expression. To her left stands an older girl in a dress, who has her arms crossed. She is looking at the camera, and there is a slight smile. To the right of the woman is a younger girl, holding the woman's hand, wearing a similar dress. The girls are smiling at the camera. The porch has a wrought iron railing with a backdrop of foliage. Above, is a striped awning. The background includes a brick building. The lighting appears to be bright, with strong shadows visible on the porch floor. The style of clothing suggests the photograph was taken in the mid-20th century. The photograph's edges have a black border.

Created by gemini-2.0-flash on 2025-05-03

Certainly! Here is a description of the image:

The image is a black and white photograph of a woman and two young girls standing on a porch or patio. They are positioned in front of a leafy backdrop with an awning visible above.

  • Subjects: The woman appears to be the mother of the two girls. She is wearing a knee-length dress with buttons down the front and heels. The girls are each wearing dresses and shoes; the older one has her arm resting on the mother, and the younger girl is holding a doll.

  • Setting: The background suggests an outdoor space, possibly a home's porch or patio. There is greenery behind them, and a brick wall is visible on the left side of the frame. A metal chair sits on the left side of the frame. The awning above gives shade.

  • Composition: The photograph is well-composed, with the subjects centered in the frame. The contrast between light and shadow is also noticeable.

  • Overall Impression: The image evokes a sense of nostalgia and family connection. It appears to be a formal portrait from a bygone era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

The image is a black and white photograph featuring a woman and two young girls standing on a patio or balcony. The woman is dressed in a light-colored dress with buttons down the front, and she has her arms around the shoulders of the two girls. The girls are wearing similar dresses, one darker and the other lighter in color, with matching shoes and socks.

The setting appears to be a residential area, as indicated by the brick wall and window in the background. There is also a metal railing with plants growing around it, suggesting a garden or outdoor space. The patio is paved with tiles, and there is a metal chair visible to the left side of the image. The overall scene suggests a family portrait taken outdoors, possibly in the mid-20th century, given the style of clothing and the black-and-white nature of the photograph.

Qwen

No captions written

Text analysis

Google

HHIPHHA
HHIPHHA