Human Generated Data

Title

Untitled (family on couch)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17599

Human Generated Data

Title

Untitled (family on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17599

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.4
Clothing 99.2
Apparel 99.2
Shorts 96.2
Furniture 95.1
Chair 94.6
Sitting 75.1
Indoors 74.6
Face 69.2
Couch 67.1
Female 64
Portrait 63.4
Photography 63.4
Photo 63.4
Room 62.8
People 62
Kid 61
Child 61
Floor 57.2
Living Room 57.1
Shoe 56.2
Footwear 56.2

Clarifai
created on 2023-10-29

group 99.7
people 99.6
child 98
education 96.8
group together 95.8
adult 95.1
monochrome 94.3
man 93.6
several 91.2
woman 90.3
many 89.5
school 88.5
music 88.5
science 87.7
musician 87
teacher 86.8
boy 86
son 85.5
actor 84.6
wear 81

Imagga
created on 2022-02-26

person 40.9
man 31.6
people 30.7
male 26.9
adult 25.1
senior 23.4
shower cap 21.8
patient 21.6
happy 21.3
home 20.7
smiling 18.8
teacher 18.2
cap 18
indoors 17.6
portrait 16.2
professional 16.1
nurse 15.9
couple 15.7
sitting 15.5
elderly 15.3
retired 14.5
medical 14.1
headdress 13.8
clothing 13.6
health 13.2
lifestyle 12.3
sick person 12.2
mature 12.1
fun 12
case 11.9
family 11.6
casual 11
handsome 10.7
smile 10.7
retirement 10.6
together 10.5
human 10.5
looking 10.4
men 10.3
camera 10.2
child 10.1
alone 10
face 9.9
team 9.8
cheerful 9.7
one 9.7
technology 9.6
wife 9.5
educator 9.4
world 9.4
doctor 9.4
room 9.3
modern 9.1
holding 9.1
student 9.1
old 9
working 8.8
medicine 8.8
60s 8.8
hospital 8.8
mask 8.7
women 8.7
couch 8.7
laboratory 8.7
love 8.7
education 8.7
sibling 8.6
work 8.6
husband 8.6
instrument 8.5
enjoying 8.5
equipment 8.4
house 8.4
playing 8.2
science 8
hair 7.9
look 7.9
70s 7.9
clinic 7.8
happiness 7.8
mother 7.8
older 7.8
eyes 7.7
negative 7.7
expression 7.7
illness 7.6
joy 7.5
lady 7.3
classroom 7.3
grandma 7.3
color 7.2
pensioner 7.2
bright 7.1
kid 7.1
businessman 7.1

Google
created on 2022-02-26

Style 83.9
Black-and-white 83.2
Chair 82.3
Art 80.4
Smile 79.5
Font 76
Monochrome 75.5
Suit 73.9
Event 73.1
Monochrome photography 72.8
Vintage clothing 71.3
Fun 67.3
Sitting 67.3
Room 66.5
Visual arts 64.4
Illustration 63.4
Crew 60.2
Team 58
Child 56.3
Conversation 56.2

Microsoft
created on 2022-02-26

text 99.8
clothing 91.4
person 86.6
musical instrument 80.3
guitar 64.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 97.2%
Happy 87.9%
Calm 7%
Sad 1.5%
Confused 1.2%
Disgusted 0.9%
Surprised 0.6%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Surprised 89.5%
Happy 9%
Fear 0.9%
Calm 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat

Clarifai

Clothing
Human face
Boy
Footwear
Picture frame
Human head
Human hair
Human leg

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 79.9%

AWS Rekognition

Person 68.1%

AWS Rekognition

Hat 72.2%

Clarifai

Clothing 93.9%

Clarifai

Clothing 93.6%

Clarifai

Clothing 83.3%

Clarifai

Clothing 74.3%

Clarifai

Clothing 55.5%

Clarifai

Clothing 43.3%

Clarifai

Clothing 34.7%

Clarifai

Human face 80.2%

Clarifai

Human face 79.2%

Clarifai

Human face 71.7%

Clarifai

Human face 62.8%

Clarifai

Boy 69%

Clarifai

Footwear 63%

Clarifai

Footwear 58.2%

Clarifai

Footwear 58%

Clarifai

Picture frame 41.4%

Clarifai

Human head 41.4%

Clarifai

Human hair 38.5%

Clarifai

Human leg 34.2%

Categories

Imagga
created on 2022-02-26

paintings art 71%
people portraits 25.8%
text visuals 1.2%
streetview architecture 1.2%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a photo of children playing with toys.

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people sitting on a couch

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image appears to be a photographic negative showing a cozy interior living space. A woman is seated on a patterned sofa, wearing a striped dress, interacting with two small children holding stuffed animals, such as a monkey and another toy resembling vintage-style plush toys. The background contains home decor elements including bookshelves, a lamp, framed wall art, and a chair, evoking a warm and familial atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-11

This is an inverted black and white image showing a domestic scene with three individuals, one of whom appears to be an elderly woman seated in the center. She is wearing a patterned dress with buttons down the front. To her right, a child is seated, holding a stuffed animal. Both children are also holding additional stuffed toys and wearing casual clothing suitable for a home setting. The setting appears to be a living room with furniture such as a couch with foliage-patterned upholstery, bookshelves, framed art on the wall, and a lamp. The overall atmosphere is warm and family-oriented, reflecting a typical indoor, familial setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-21

The image appears to be a black and white photograph depicting a family scene. It shows several people, including what seem to be a mother and father, as well as two young children. The children are holding stuffed animals or toys, and the adults appear to be interacting with them in a warm and affectionate manner. The room they are in has a cozy, domestic feel, with framed artwork on the walls and other furnishings visible. Overall, the image conveys a sense of family togetherness and comfort.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-21

This appears to be a vintage black and white photograph taken in what looks like a living room setting. The image shows a family group seated on what appears to be a floral-patterned couch or chair. The adults and children are all holding what appear to be stuffed toys or dolls. The woman in the center is wearing a striped dress, and there's a table lamp visible in the background along with some framed artwork on the walls. The image has a negative or inverted quality to it, giving it an unusual appearance where the dark and light values seem reversed.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-01

This image is a black-and-white photograph of a family of four sitting on a couch. The woman, positioned centrally, wears a striped dress and holds a teddy bear. To her left stands a young boy, also grasping a teddy bear, while to her right sits an older boy holding another teddy bear. The man, seated beside the older boy, is dressed in a white suit.

The room's background features a dark wall adorned with two framed pictures, a lamp on a table, and a bookshelf. The overall atmosphere suggests a family gathering or portrait, with the teddy bears adding a playful touch to the scene.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-01

The image is a black-and-white photograph of a family of four sitting on a couch in a living room. The family consists of two adults and two children, all of whom are holding stuffed animals.

  • The two adults are seated on the couch, with the woman on the left wearing a striped dress and the man on the right wearing white pants and a dark-colored shirt.
  • The two children are standing in front of the adults, with the boy on the left holding a stuffed animal that resembles a monkey and the girl on the right holding a stuffed animal that resembles a bear.
  • The background of the image shows a living room with a couch, a lamp, and a bookshelf. There are also several framed pictures hanging on the wall.

Overall, the image appears to be a casual family portrait, with the family members posing together in a relaxed setting.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The black-and-white photo shows a family sitting on a couch in a living room. The woman is wearing eyeglasses and holding a stuffed toy. The man is sitting next to her, and two kids are sitting on either side of them. The boy on the right is holding a stuffed toy, while the boy on the left is holding a stuffed toy and looking at the woman. Behind them are picture frames, a shelf, and a lamp.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a black-and-white photograph of a family sitting on a couch in a living room. The family consists of a man, a woman, and two children. The man and woman are sitting on the couch, while the two children are standing in front of them. The woman is holding a baby, and the man is holding a stuffed toy. The two children are holding stuffed toys as well. The living room has a bookshelf with books, a lamp, and a picture frame on the wall.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Certainly! Here's a description of the image, based on the provided negative view:

Overall Scene:

The image is a family portrait taken indoors. It seems to be a candid shot, likely taken in a living room. The style suggests it might be a vintage photograph.

People:

  • Family: There are four people in the frame: a man, a woman, and two young boys. The family is most likely sitting on a couch.
  • Interaction: Both children seem to be holding stuffed animals, one is a teddy bear and the other is a doll. The adults are looking at the boys.

Setting:

  • Background: The backdrop suggests a home setting with the family seated on a floral couch. There's also a lamp and a bookshelf.
  • Details: There are pictures hung on the wall.

Technical Aspects:

  • Monochromatic: This is a black and white image.
  • Negative: The image is presented in a negative format, so the colors are reversed.

Created by gemini-2.0-flash on 2025-05-05

Here is a description of the image:

The image is a black and white photographic negative of a family group portrait. It appears to be taken indoors. On a floral sofa are a woman, two young boys, and a man. All four are holding stuffed animals.

The woman has short hair styled in waves and is wearing glasses and a striped dress or suit. She is sitting on the sofa and holding a doll in her arms. To her right, a man sits in a suit. He is looking down at the boy next to him. The two boys each hold a stuffed monkey.

The sofa is floral-patterned and there are framed pictures on the wall behind the family. To the right of the family is a side table with a lamp, along with a bookshelf. There is a note written upside down on the right.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

The image depicts a family scene in a living room setting. There are four individuals present: two adults and two children. The adults appear to be an older couple, possibly grandparents, and the children seem to be young boys.

Here are the details:

  1. Setting: The scene is set in a cozy living room. There is a floral-patterned couch on which the older woman and one of the boys are seated. The room has some decorative elements, including framed pictures on the wall and a lamp with a lampshade on a side table. There is also a bookshelf visible in the background.

  2. People:

    • The older woman is seated on the couch, wearing a striped dress. She has short, curly hair and is holding a small puppy in her lap.
    • The older man is standing next to the couch, wearing a light-colored shirt and pants. He has short, white hair and is also holding a small puppy.
    • One of the boys is seated on the couch next to the older woman. He is wearing a dark shirt and is holding another puppy.
    • The other boy is standing next to the older man. He is wearing a dark shirt and light-colored shorts and is holding a puppy as well.
  3. Puppies: Each person in the image is holding a small puppy, suggesting that the puppies might be new additions to the family or pets they are caring for.

  4. Atmosphere: The overall atmosphere of the image is warm and familial, with a focus on the interaction between the family members and the puppies.

The image captures a moment of togetherness and joy, likely reflecting a special occasion or a memorable family event.

Qwen

No captions written