Human Generated Data

Title

Untitled (family portrait on porch of home with children holding dolls and teddy bears)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3707

Human Generated Data

Title

Untitled (family portrait on porch of home with children holding dolls and teddy bears)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3707

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Furniture 99.6
Human 99.6
Clothing 96.2
Apparel 96.2
People 74.3
Face 69.5
Kid 61.9
Child 61.9
Porch 59.6
Indoors 59
Hat 56.7
Steamer 55.1

Clarifai
created on 2019-06-01

people 99.4
adult 95.8
child 95.3
man 94.4
group 93.8
indoors 92.2
woman 91.1
room 88.3
family 88
group together 86.8
monochrome 85.2
sit 80.9
wear 80.1
furniture 79.2
facial expression 73.9
four 72.2
chair 72
leader 68.2
five 67.9
actor 67

Imagga
created on 2019-06-01

picket fence 52.8
fence 42.3
people 32.9
barrier 31.6
kin 29.3
male 24.8
man 22.8
person 22.7
obstruction 21.2
adult 20.3
professional 20
medical 18.5
men 17.2
portrait 16.8
business 15.8
human 15.7
laboratory 15.4
team 15.2
doctor 15
biology 14.2
group 13.7
lab 13.6
film 13.3
negative 13.1
worker 13
office 12.8
scientist 12.7
nurse 12.6
test 12.5
health 12.5
family 12.4
research 12.4
businessman 12.4
medicine 12.3
smiling 12.3
corporate 12
modern 11.9
work 11.9
casual 11.9
scientific 11.6
job 11.5
occupation 11
day 11
indoor 10.9
chemical 10.8
smile 10.7
colleagues 10.7
science 10.7
face 10.6
happy 10.6
chemistry 10.6
indoors 10.5
hospital 10.4
businesspeople 10.4
looking 10.4
instrument 10.2
structure 10.2
20s 10.1
clinic 9.9
working 9.7
coat 9.7
development 9.6
women 9.5
happiness 9.4
musical instrument 9.3
patient 9.1
confident 9.1
fashion 9
color 8.9
brass 8.8
home 8.8
love 8.7
lifestyle 8.7
life 8.6
sitting 8.6
window 8.5
room 8.4
black 8.4
attractive 8.4
old 8.4
wind instrument 8.2
child 8.2
businesswoman 8.2
photographic paper 8.1
glass 8
microscope 7.9
education 7.8
assistant 7.8
exam 7.7
confidence 7.7
study 7.5
equipment 7.4
teamwork 7.4
care 7.4
light 7.3
design 7.3
clothing 7.3
student 7.2
dress 7.2
mother 7.1
handsome 7.1
interior 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

clothing 98
window 95.2
posing 93.2
person 85.9
smile 80.6
man 74
human face 71.5
old 60.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Confused 45.2%
Happy 45.2%
Surprised 45.3%
Angry 45.4%
Disgusted 45.1%
Calm 50.6%
Sad 48.2%

AWS Rekognition

Age 26-43
Gender Female, 54%
Angry 45.7%
Happy 48.7%
Confused 45.3%
Sad 49%
Calm 45.8%
Surprised 45.3%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Angry 45.5%
Sad 49.9%
Disgusted 45.5%
Happy 46.4%
Calm 46.7%
Surprised 45.6%
Confused 45.5%

AWS Rekognition

Age 23-38
Gender Male, 53.7%
Angry 45.4%
Sad 49.1%
Disgusted 45.2%
Surprised 45.3%
Happy 45.4%
Calm 49.3%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 75%
Sad 42.4%
Happy 11.9%
Confused 3.6%
Angry 3.9%
Surprised 3.8%
Disgusted 4.2%
Calm 30.1%

AWS Rekognition

Age 23-38
Gender Female, 52.6%
Angry 45.3%
Happy 45%
Confused 45.5%
Calm 52.9%
Disgusted 45.1%
Sad 46%
Surprised 45.2%

Feature analysis

Amazon

Person
Chair

Clarifai

Human face
Clothing
Boy
Footwear
House
Human nose
Furniture
Human hair
Human leg
Human arm

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 91.5%

AWS Rekognition

Person 81.3%

AWS Rekognition

Person 78.1%

AWS Rekognition

Person 62.1%

AWS Rekognition

Chair 51.8%

Clarifai

Human face 94%

Clarifai

Human face 85.5%

Clarifai

Human face 84.4%

Clarifai

Human face 83.4%

Clarifai

Human face 71.9%

Clarifai

Human face 71.5%

Clarifai

Human face 67%

Clarifai

Human face 46.6%

Clarifai

Clothing 89.1%

Clarifai

Clothing 88.6%

Clarifai

Clothing 88%

Clarifai

Clothing 77.4%

Clarifai

Clothing 72.9%

Clarifai

Clothing 72.4%

Clarifai

Clothing 68.9%

Clarifai

Clothing 58.2%

Clarifai

Clothing 45%

Clarifai

Clothing 38.5%

Clarifai

Clothing 33.7%

Clarifai

Boy 84.5%

Clarifai

Footwear 60.2%

Clarifai

Footwear 54.4%

Clarifai

Footwear 52.9%

Clarifai

Footwear 52.7%

Clarifai

Footwear 42.4%

Clarifai

Footwear 38.6%

Clarifai

Footwear 33%

Clarifai

House 43.6%

Clarifai

Human nose 39.5%

Clarifai

Furniture 38.7%

Clarifai

Human hair 37.2%

Clarifai

Human leg 36.6%

Clarifai

Human leg 35.6%

Clarifai

Human leg 34.9%

Clarifai

Human arm 36.5%

Clarifai

Human arm 34.6%

Categories

Imagga
created on 2019-06-01

paintings art 97.4%
text visuals 2.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

the family at the beach.

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a family posing for a photo in a porch

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image appears to be a photographic negative showing a group of individuals, including adults and children, posed outdoors on a porch or similar structure. There is a visible staircase in the background on the left side and a wooden rocking chair positioned on the right. The people in the image are holding small animals, possibly puppies, suggesting a family or casual gathering atmosphere. The porch setting features architectural details like wooden siding and railings.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image appears to be an inverted (negative) black and white photograph of a group of people sitting and standing in front of a backdrop of a building with horizontal siding and a staircase. The individuals are likely comprised of a family, and one member is sitting on a porch swing. Some people are sitting while others stand. Certain individuals in the image are holding small dogs. The setting suggests a casual gathering, potentially at a house or residential area, with different members arranged in a line or grouped together. The lighting and inversion make it challenging to discern precise details, but the composition indicates a typical family portrait of the time.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph depicting a group of people, likely a family, standing outside a building. The group consists of several adults and children, all dressed in clothing typical of the early to mid-20th century. The background includes a wooden structure with a ladder and some other objects, suggesting a rural or small-town setting. The individuals in the image are not identified, but the overall scene suggests a family portrait or gathering.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a vintage black and white photograph that appears to be taken on a porch or veranda. The image shows a group of people, including what appears to be a person in a white coat or uniform standing, and several others seated and standing around them. There are also what look like cats being held by some of the individuals in the photo. The setting includes wooden slat walls or siding in the background and a wooden chair visible on the right side of the frame. The photograph has the characteristic soft focus and slight deterioration typical of early 20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a group of people, likely a family, posing for a picture on the porch of a house. The image is faded and appears to be old, with a white border around the edges.

In the foreground, there are several people standing and sitting on the porch. There is a man in a white suit and tie standing on the left side of the image, with a woman in a dark dress standing next to him. To their right, there are two children, a boy and a girl, sitting on the porch steps. Behind them, there is another woman in a dark dress and a man in a dark shirt and pants. On the right side of the image, there is a woman in a dark dress sitting in a rocking chair.

The background of the image shows the interior of the house, with a window and blinds visible behind the group of people. The overall atmosphere of the image suggests a family gathering or special occasion, possibly a holiday or celebration.

The image appears to be from the early 20th century, based on the clothing and hairstyles of the people in the photo. The faded quality of the image and the presence of a white border around the edges suggest that it may have been taken using an older camera or printing process.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is a black-and-white photograph of a family of seven, including two adults and five children. The family is positioned in front of a house with horizontal slats on the wall behind them, and a window is visible to the left of the group. A rocking chair is situated to the right of the family.

The two adults are dressed in dark clothing, while the children wear various outfits. The youngest child sits on the lap of one of the adults, and another child stands beside them. The remaining three children are positioned in front of the adults, with one sitting on a chair and the other two standing.

The overall atmosphere of the image suggests a casual, informal gathering of the family. The presence of the rocking chair and the relaxed poses of the family members contribute to this impression. The image appears to be an old photograph, possibly taken in the early 20th century, given the style of clothing and the quality of the image.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image depicts a family posing for a photograph in front of a wooden house. The photo is monochromatic, giving it a vintage feel. The family consists of a man and several women and children. The man is dressed in a white coat and tie, suggesting he may be a doctor or a scientist. The women and children are dressed in old-fashioned clothing, with the children holding stuffed toys. The house has a wooden structure with a window and a door, and there is a wooden chair in the foreground. The image has a slightly blurry effect, adding to its nostalgic and timeless quality.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black-and-white photograph of a family, consisting of an adult man, two adult women, and four children. They are standing and sitting on the front porch of a house. The man is wearing a white coat and a tie, while the two adult women are wearing dresses. The children are wearing dresses and shorts. They are all smiling and posing for the camera. The porch has a wooden railing and a chair.

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

The image shows a family portrait of seven people in an old-fashioned setting.

The backdrop is a wall with wide, horizontal boards, likely the exterior of a house. There is a window visible behind the family, adding to the indoor/outdoor setting.

The family consists of two adults and five children. An adult male is seated and wearing a suit, with a tie and a jacket. Two young children are in front of him, each holding a doll. Behind them, an adult female is holding a doll. Next to her, another young girl is wearing a dress. A women is holding a doll and is located behind a rocking chair.

The photograph is an inverted image, which gives it a vintage, almost ghostly quality.

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

Overall Impression:

The image appears to be an old, possibly historical, photograph that has been inverted, resulting in a negative image. It depicts a family group posing outdoors, likely on a porch or landing.

People:

  • Family: The composition includes several figures, likely family members.
  • Adults: There are at least two adults present, possibly the parents. One is seated. They are dressed in formal attire.
  • Children: Several children are present. Some are sitting on small chairs and have items in their hands.
  • Baby/Doll: One person in the background appears to be holding a baby, or possibly a doll.

Setting:

  • Outdoors: The scene appears to be outdoors, with a wooden background.
  • Porch/Landing: The setting suggests a porch, landing or a similar outdoor space with some simple furniture and possibly a staircase.
  • Light and Shadow: The play of light suggests a sunny day.

Style:

  • Old Photography: The image's style suggests an older form of photography.
  • Inverted Image: The negative effect is evident and gives an unusual feel.

In Summary: The image captures a family portrait, with formal dress and pose, indicative of a bygone era. The inverted image gives an interesting and unusual effect.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph featuring a group of people posing in front of a wooden building. The scene appears to be from an earlier time period, possibly the early to mid-20th century, based on the clothing and hairstyles.

From left to right, the individuals are:

  1. A young boy wearing glasses and a light-colored shirt with a dark tie.
  2. A young girl with short hair, wearing a dark dress.
  3. A woman holding a baby, dressed in a dark dress with a light-colored collar.
  4. An elderly woman wearing a dark dress and a light-colored apron.
  5. A woman with a decorative bow in her hair, wearing a dark dress with a light-colored collar.
  6. A young girl with short hair, wearing a dark dress.
  7. A woman with short hair, wearing a dark dress.

The group is standing in a doorway and on a porch, with some seated on a wooden bench to the right. The wooden building has horizontal siding and a visible window behind the group. The overall atmosphere suggests a family gathering or a special occasion.

Qwen

No captions written