Human Generated Data

Title

A young family in Brooklyn going for a Sunday outing. Their baby is named Dawn. Their son is retarded. 1966

Date

1966

People

Artist: Diane Arbus, American 1923 - 1971

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, National Endowment for the Arts Grant, P1972.9

Copyright

© The Estate of Diane Arbus, LLC

Human Generated Data

Title

A young family in Brooklyn going for a Sunday outing. Their baby is named Dawn. Their son is retarded. 1966

People

Artist: Diane Arbus, American 1923 - 1971

Date

1966

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, National Endowment for the Arts Grant, P1972.9

Copyright

© The Estate of Diane Arbus, LLC

Machine Generated Data

Tags

Amazon
created on 2023-10-18

Clothing 100
Hat 100
People 99.8
Face 99.8
Head 99.8
Photography 99.8
Portrait 99.8
Bonnet 99.5
Accessories 98
Bag 98
Dress 94.9
Formal Wear 93
Suit 93
Jacket 81.9
Fashion 80.5
Sun Hat 56.1
Gown 55.5
Happy 55.4
Smile 55.4
Overcoat 55

Clarifai
created on 2023-10-18

people 99.6
family 99.6
group 99.3
offspring 99.1
child 99
three 98.6
four 97.5
woman 96.5
adult 96.5
son 96.3
two 96.3
baby 95.7
wear 95.6
actress 95.6
sibling 94.8
portrait 94.3
love 93.4
movie 91.9
group together 91.4
man 91.4

Imagga
created on 2018-12-18

kin 32.5
mother 30.8
people 29
happy 25.7
portrait 25.2
male 23.1
adult 22.7
couple 22.6
dress 22.6
person 22.1
man 21.5
love 21.3
smiling 21
women 20.6
attractive 20.3
costume 19.9
fashion 19.6
happiness 19.6
child 19.3
together 19.3
parent 18.6
smile 17.8
lifestyle 17.3
pretty 16.8
black 15.9
sexy 15.3
party 14.6
two 14.4
home 14.4
family 14.2
lady 13.8
bride 13.4
cheerful 13
cute 12.9
youth 12.8
girls 12.8
holding 12.4
friends 12.2
brunette 12.2
performer 12.1
fun 12
hair 11.9
decoration 11.8
traditional 11.6
childhood 11.6
kid 11.5
holiday 11.5
look 11.4
face 11.4
boy 11.3
world 11.2
wedding 11
clothing 10.7
romantic 10.7
style 10.4
comedian 10.1
model 10.1
teen 10.1
group 9.7
groom 9.5
gift 9.5
daughter 9.4
elegance 9.2
children 9.1
vintage 9.1
color 8.9
celebration 8.8
standing 8.7
luxury 8.6
brother 8.5
clothes 8.4
friendship 8.4
life 8.4
old 8.4
studio 8.4
entertainer 8.3
emotion 8.3
year 8.2
pose 8.2
husband 8.1
new 8.1
interior 8
indoors 7.9
carnival 7.8
two people 7.8
casual 7.6
hand 7.6
wife 7.6
human 7.5
relationship 7.5
room 7.4
makeup 7.3
teenager 7.3
suit 7.2
looking 7.2
to 7.1
modern 7

Google
created on 2018-12-18

Microsoft
created on 2018-12-18

person 99
outdoor 92.8
standing 88.1
posing 81
people 71.7
white 61.5
clothes 20.4
wedding 2.7
black and white 2.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 1.5%
Confused 0.7%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 2-10
Gender Female, 98%
Happy 76.7%
Surprised 12.6%
Fear 10.3%
Sad 2.5%
Confused 1.4%
Angry 1.3%
Calm 0.7%
Disgusted 0.6%

AWS Rekognition

Age 0-3
Gender Female, 100%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Happy 0%
Angry 0%
Confused 0%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Female
Woman
Boy
Child
Handbag
Coat

Clarifai

Human face
Boy
Man
Woman
Human hair
Human eye
Human arm
Human hand

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.7%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Adult 99.3%

AWS Rekognition

Male 99.4%

AWS Rekognition

Male 98.7%

AWS Rekognition

Man 99.4%

AWS Rekognition

Female 99.3%

AWS Rekognition

Woman 99.3%

AWS Rekognition

Boy 98.7%

AWS Rekognition

Child 98.7%

AWS Rekognition

Handbag 98%

AWS Rekognition

Coat 94.7%

AWS Rekognition

Coat 75.8%

Clarifai

Human face 93.8%

Clarifai

Human face 93%

Clarifai

Human face 84.4%

Clarifai

Human face 79.9%

Clarifai

Boy 90.5%

Clarifai

Man 85.3%

Clarifai

Woman 84.1%

Clarifai

Human hair 46%

Clarifai

Human hair 42.4%

Clarifai

Human eye 41%

Clarifai

Human eye 40.7%

Clarifai

Human eye 34.8%

Clarifai

Human arm 37.5%

Clarifai

Human hand 33.5%

Categories

Imagga
created on 2018-12-18

people portraits 99.4%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

actor with his family in the 1960s.

Salesforce

Created by general-english-image-caption-blip on 2025-05-21

a photograph of a man and woman standing next to each other

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image depicts a family of four standing outdoors. The individuals include an adult woman holding a baby, dressed in a light-colored outfit, while carrying a leopard-print coat and a handbag. Beside her, an adult man is dressed in dark-toned clothing, with a coat layered over what appears to be a collared shirt. The man is holding hands with a young child, who is wearing a light-colored sweater and dark pants. The background includes a building with a textured wall and a pathway, along with some greenery.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image depicts a family group consisting of four individuals. The adult figure on the left is holding an infant. This individual is dressed in a sleeveless dress and carries a leopard print coat and a handbag. The infant is wearing a hooded outfit. Next to them, two other figures, an adult and a child, are standing. The adult on the right is dressed in a dark coat and trousers, while the child, situated between the two adults, is wearing a striped sweater and pants. The child is holding hands with the adult on the right. They are positioned in an outdoor setting, evidenced by a building with hexagonal patterned tiles in the background. The image is black and white, adding a classic or vintage feel to the scene.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-11

The image appears to be a black and white photograph of a family. It shows a woman holding a baby, with a young child standing next to her. A man is standing behind them. The woman is wearing a leopard print coat, and the man is wearing a jacket. The background appears to be a brick wall. The image has a vintage, documentary-style feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-11

This is a black and white photograph from what appears to be the 1960s, showing a family of four. The woman is wearing a stylish outfit with a leopard print coat and has a dramatic beehive hairstyle typical of the era. She's holding a baby dressed in white. Next to them stands a young boy in a white sweater, and beside him is a man wearing a dark jacket. The photo has a documentary-style quality to it and captures the fashion and aesthetic of the mid-20th century perfectly.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a family of four standing outside a house. The woman, dressed in a dark dress and leopard-print shawl, holds a baby in her arms and a purse in her right hand. The baby wears a white bonnet and a white outfit. The man, wearing a dark coat and pants, stands to the right of the woman, holding the hand of a young boy in front of him. The boy is dressed in a white sweater and dark pants. The background of the image features a house with a tiled roof and a tree or bush to the left.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

This image is a black-and-white photograph of a family of four. The woman, with dark hair styled in a bouffant, wears a sleeveless dress and holds a baby in her arms. The baby is dressed in a white outfit and bonnet. To her right stands a man with short dark hair, wearing a dark jacket over a collared shirt. In front of them is a young boy with short blond hair, dressed in a white sweater and dark pants. He appears to be holding the man's hand.

The background of the image features a wall with a textured pattern, suggesting an outdoor setting. The overall atmosphere of the photograph conveys a sense of warmth and closeness among the family members.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph of a family of four. The woman, who is wearing a leopard-print coat, is holding a baby in her arms. The baby is dressed in a white bonnet and a white onesie. The man on the right is wearing a dark coat and is holding the hand of a young boy. The boy is wearing a white sweater and black pants. The family is standing in front of a building with a brick wall.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A black-and-white photo of a family of four, with the man on the right, the woman on the left, and two children in between. The woman is holding a baby with a bonnet, and the man is holding the hand of a child. They are standing outside a house with a fence, plants, and trees behind them. The woman is wearing a leopard-print jacket, and the man is wearing a coat with a fur collar.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-14

Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely from an older era, judging by the fashion and the grainy quality. It depicts a family portrait, seemingly posed outdoors.

The People:

  • Mother: She's holding a baby in her arms. The mother has very dramatic eye makeup, styled dark hair, and wears a dark dress. She has a serious or slightly somber expression. She carries a black purse and a leopard-print coat.
  • Baby: The baby, dressed in a white hooded outfit, gazes directly at the camera with a calm expression.
  • Father: The father stands to the right of the image. He's wearing a jacket over a shirt and has a serious expression.
  • Child: A young boy, probably the older sibling, holds the father's hand. He has a more playful or mischievous expression and looks directly at the camera.

Setting/Background:

The backdrop is a textured wall, possibly the side of a building. The setting appears to be outdoors.

Composition/Style:

The photograph is a posed family portrait, with each member of the family looking directly at the camera. The composition is balanced, with the family members arranged centrally in the frame. The use of black and white enhances the dramatic feel of the image. The clothing and styling suggest a vintage aesthetic, perhaps from the 1960s or 1970s. The image is likely a snapshot of a family moment.

Created by gemini-2.0-flash on 2025-05-14

Here is a description of the image:

The image is a black and white photo of a family of four standing outside.

A woman with voluminous dark hair and heavy eye makeup stands on the left side of the frame. She holds a baby wrapped in a white blanket and bonnet. A leopard print coat hangs over her arm, and she carries a black purse.

To the right of the woman stands a man with short, dark curly hair. He wears a dark coat over a collared shirt. He holds the hand of a young boy who stands in front of him. The boy wears a white sweater and has a mischievous expression on his face, sticking out his tongue.

The background consists of a textured wall on the left and a blurred outdoor setting on the right. The overall tone of the image is serious, with the exception of the boy's playful expression.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-10

This black-and-white photograph captures a family of four standing outdoors. The setting appears to be in front of a building with a tiled roof.

  • The woman in the center is holding a baby dressed in a white outfit and bonnet. She is wearing a leopard print coat and has a large, dark hairstyle. She is also holding a black handbag and a cigarette in her left hand.
  • A young boy stands in front of the woman, holding her hand. He is wearing a light-colored sweater and dark pants and is looking directly at the camera with a somewhat surprised expression.
  • To the right of the woman stands a young man wearing a dark jacket over a sweater. He has short, dark hair and is looking off to the side.

The image conveys a sense of everyday life, capturing a candid moment of the family together. The attire and hairstyles suggest it was taken in the mid-20th century.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-29

This black-and-white photograph captures a family of four posing outdoors. The mother, positioned on the left, is holding a baby wrapped in a white blanket and wearing a bonnet. She is dressed in dark clothing with a leopard print scarf draped over her shoulder and is carrying a large black purse. The baby appears to be pointing with one hand.

The father stands to the right, holding the hand of an older child, possibly a toddler, who is standing between the two adults. The child is dressed in a white sweater with a dark collar and appears to be looking up at the adults. The father is wearing a dark coat and a scarf, and his expression is serious.

The background suggests an urban setting, with a large tree trunk and a building visible. The overall composition conveys a sense of family togetherness and formality in a historical or vintage style.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-29

This black-and-white photograph captures a family of four in a candid and slightly offbeat moment. The woman on the left holds a baby dressed in a white outfit, and the baby is pointing towards the camera. The woman has voluminous, styled hair and wears a fur coat and a leopard print scarf. She is holding a handbag and a camera. The man on the right is dressed in a dark coat and scarf, holding the hand of a toddler who is looking up at him with a surprised expression. The background features a tree and some elements of an urban environment. The overall composition and expressions give the image a unique and intriguing quality.