Human Generated Data

Title

[Andreas, Julia, Lux, and Laurence Feininger]

Date

1910

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.368

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Andreas, Julia, Lux, and Laurence Feininger]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1910

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.368

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Machine Generated Data

Tags

Amazon
created on 2022-07-01

Human 99.1
Newborn 95.1
Baby 95.1
Chair 84.2
Furniture 84.2
People 76
Clothing 69.8
Footwear 69.8
Apparel 69.8
Face 68.3
Photography 63
Photo 63
Portrait 62.5

Clarifai
created on 2025-01-09

people 99.9
child 99.6
group 98.8
two 98.7
offspring 98.1
adult 97.5
three 97.4
sibling 97.1
son 96.6
family 96.4
wear 95.9
woman 95.8
facial expression 95.4
four 94.8
portrait 94.7
interaction 94.4
baby 93.7
administration 91.4
furniture 90.6
five 90.5

Imagga
created on 2022-07-01

parent 70
child 68.7
father 56.9
mother 56.5
family 51.6
dad 51.4
male 35.6
happy 34.5
people 32.4
home 31.9
happiness 31.4
kid 27.5
love 26.8
sibling 26.6
together 26.3
man 26.2
daughter 25.8
children 24.6
smiling 23.9
baby 22
kin 21.8
boy 21.7
adult 20.8
cute 20.1
portrait 19.4
smile 19.3
couple 19.2
cheerful 18.7
lifestyle 18.1
fun 18
son 17.7
little 17.7
joy 17.5
sitting 17.2
husband 17.2
childhood 17
senior 16.9
indoors 16.7
person 16.7
casual 16.1
mature 15.8
juvenile 15.1
face 14.9
care 14.8
playing 14.6
wife 13.3
togetherness 13.2
kids 13.2
brother 12.8
old 12.6
room 12
youth 11.9
loving 11.5
laughing 11.3
mom 10.7
elderly 10.5
living 10.4
grandfather 10.3
women 10.3
indoor 10
girls 10
grandmother 9.8
sister 9.8
boys 9.7
group 9.7
30s 9.6
looking 9.6
married 9.6
toddler 9.6
clothing 9.5
two 9.3
adorable 9.2
joyful 9.2
holding 9.1
health 9
color 8.9
parenthood 8.8
affectionate 8.7
expression 8.5
enjoying 8.5
relationship 8.4
leisure 8.3
park 8.2
nurse 8
interior 8
medical 7.9
living room 7.8
40s 7.8
retired 7.8
play 7.8
couch 7.7
mid adult 7.7
attractive 7.7
outdoors 7.5
patient 7.2
dress 7.2
black 7.2
handsome 7.1

Google
created on 2022-07-01

Face 98.3
Skin 97.4
Photograph 94.3
White 92.2
Black 90
Black-and-white 86.7
Happy 85.5
Style 84.2
Shorts 83.6
Hat 80.2
People 78.4
Flash photography 77.1
Monochrome 76.6
Monochrome photography 76.6
Toddler 75.8
Comfort 75.2
Snapshot 74.3
Fun 73.6
Child 73.1
Sitting 72.5

Microsoft
created on 2022-07-01

person 99.9
toddler 98.7
human face 97.5
clothing 95.8
indoor 94.2
child 90.3
boy 84.8
smile 79.3
black and white 73.5
baby 72.3
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Female, 93.2%
Surprised 49.4%
Calm 46.5%
Happy 9.5%
Fear 6.4%
Sad 3.8%
Disgusted 3.3%
Confused 2.2%
Angry 1.9%

AWS Rekognition

Age 4-12
Gender Female, 51.8%
Calm 74.5%
Surprised 16.1%
Fear 6.4%
Sad 5.9%
Confused 2.1%
Disgusted 1.1%
Angry 0.8%
Happy 0.6%

AWS Rekognition

Age 0-3
Gender Male, 99%
Calm 95.2%
Surprised 6.4%
Fear 6%
Disgusted 2.6%
Sad 2.4%
Confused 0.4%
Happy 0.3%
Angry 0.2%

AWS Rekognition

Age 23-33
Gender Male, 54.3%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Disgusted 0%
Confused 0%
Angry 0%

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe

Clarifai

Human face
Woman
Clothing
Footwear
Human arm
Human eye
Human nose
Human leg
Human mouth
Human hair
Human ear

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 92.4%

AWS Rekognition

Person 86.4%

AWS Rekognition

Person 84.1%

AWS Rekognition

Shoe 69.8%

Clarifai

Human face 98%

Clarifai

Human face 95.5%

Clarifai

Human face 94.8%

Clarifai

Human face 94.7%

Clarifai

Woman 81.8%

Clarifai

Woman 38.1%

Clarifai

Clothing 79.7%

Clarifai

Clothing 77.5%

Clarifai

Clothing 59.6%

Clarifai

Clothing 55%

Clarifai

Clothing 49.5%

Clarifai

Footwear 70.9%

Clarifai

Human arm 44.6%

Clarifai

Human eye 42.6%

Clarifai

Human eye 39.6%

Clarifai

Human eye 36.3%

Clarifai

Human eye 35.3%

Clarifai

Human eye 33.9%

Clarifai

Human nose 41%

Clarifai

Human nose 35.4%

Clarifai

Human nose 34.6%

Clarifai

Human leg 39.7%

Clarifai

Human mouth 39.5%

Clarifai

Human mouth 33.6%

Clarifai

Human mouth 33.3%

Clarifai

Human hair 35.6%

Clarifai

Human ear 34%

Categories

Imagga
created on 2022-07-01

paintings art 95.4%
people portraits 4.1%

Captions

Microsoft
created by unknown on 2022-07-01

a person holding a baby 88%
a young boy holding a baby 66.3%
a person holding a baby 66.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a woman holding a baby and a baby in a chair

Created by general-english-image-caption-blip-2 on 2025-07-04

a woman and two children sit on a chair holding a baby

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image shows a seated woman wearing a detailed white dress with lace accents, holding an infant dressed in light clothing. To her left is a child standing on a wicker chair, wearing a buttoned coat and stockings. Another infant is partially visible on the right, sitting near the woman. The setting appears indoors, with vintage-style furniture, including a patterned cushion on the chair. The overall tone suggests a classic or historical portrait.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a vintage black and white photograph showing a family scene. A woman is seated on a wicker chair, wearing a long, white dress with detailed lace or embroidery. She is holding two infants, each dressed in traditional white baby gowns. Beside her, a young child is seated on the arm of the chair, wearing a light-colored outfit with large buttons and knee-length stockings, complete with shoes. The setting inside the room seems to have a vintage ambiance, with a fabric-patterned cushion visible on the chair.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a woman holding a baby, with a young boy standing next to them. The woman is wearing a white, lace-trimmed blouse, and the boy is wearing a gray coat. The baby appears to be sleeping in the woman's arms. The scene takes place in what looks like a living room, with a patterned sofa visible in the background.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white photograph that appears to be from the early 1900s. It shows a family scene on a patterned couch or sofa. A woman in a white, high-necked Victorian-style dress is holding an infant dressed in white christening or formal baby clothes. Next to them sits a young child in what appears to be a light-colored coat with buttons and knee socks. The image has the formal, posed quality typical of photography from that era, though it also captures a somewhat candid domestic moment. The furniture and clothing styles strongly suggest this photograph was taken during the Edwardian period (approximately 1901-1910).

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a woman holding a baby, with a young boy sitting on a chair to her left. The woman is wearing a long, white dress with lace details and has short, dark hair. She is holding the baby in her arms, who is wearing a white dress and appears to be around six months old. The young boy is sitting on a chair to her left, wearing a light-colored shirt and pants, and has short, dark hair.

The background of the image is a plain wall, and the overall atmosphere suggests a domestic setting, possibly a living room or nursery. The woman and the children appear to be in a comfortable and relaxed environment, with the woman gently holding the baby and the boy sitting calmly on the chair.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a black and white photograph of a woman holding a baby while two children sit on a couch behind her. The woman is wearing a white dress with lace details and has short, dark hair. She is holding the baby in her arms, who is dressed in a white outfit.

To the left of the woman, a young boy sits on the couch, wearing a light-colored shirt and shorts. On the right side of the woman, another child sits on the couch, but their face is not visible. The background of the image is a plain wall, suggesting that it was taken indoors. The overall atmosphere of the image appears to be one of warmth and intimacy, capturing a tender moment between the woman and the children.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The image is a black-and-white photograph featuring a woman and two children. The woman, dressed in a white blouse, is holding a baby in her arms. The baby is wrapped in a white cloth and is looking directly at the camera. The woman is sitting on a couch, and the baby is resting on her lap. On the left side of the image, a young boy is sitting on a chair. He is wearing a white shirt, pants, and shoes. His expression appears serious, and he is looking at something off-camera. On the right side of the image, another child, possibly a girl, is sitting on the floor. She is wearing a white dress and has her hands raised. The background of the image is plain, with a white wall visible behind the woman and children.

Created by amazon.nova-pro-v1:0 on 2025-06-13

A black-and-white photograph of a woman holding a baby and sitting on a couch with two kids, possibly her children. The woman is wearing a white blouse and skirt, while the baby is wearing a white dress. The boy is wearing a long-sleeve shirt and pants, while the girl is wearing a dress. The boy is sitting on the couch, while the girl is sitting on the woman's lap.

Google Gemini

Created by gemini-2.0-flash on 2025-06-14

In a grayscale medium shot, a woman sits with two children on a tufted sofa, a third sits to her left. The first child, a boy in a short trench coat and leggings, sits on what appears to be a woven basket or low table, staring off to his left. The woman, who has an updo, is turned slightly to her left, holding a baby in her lap and gazing down at her. The third child sits on her right, slightly behind the baby, with an arm outstretched. The women and children are all wearing light colored, ruffled outfits. The sofa is ornately patterned and tufted. The wall behind them is plain.

Created by gemini-2.0-flash-lite on 2025-06-14

Here is a description of the image:

The image is a black and white photograph of a woman and her children. The woman is seated on a chair and holding a baby in her lap. She is wearing a white dress with a ruffled collar. The baby is wearing a white dress and looks to be between 3 and 6 months old. To the left of the woman is a young boy, dressed in a jacket and leggings, sitting on a wicker stool. To the right of the woman is another child, also in white clothing, who is partially obscured. The overall composition is simple and intimate, capturing a tender moment of family life. The lighting and style of the photograph suggest it was taken sometime in the early 20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-13

The image is a black-and-white photograph that appears to be from the early to mid-20th century. It depicts a scene involving three individuals:

  1. A woman who is seated on a sofa, holding a baby in her lap. The woman is dressed in a light-colored, long-sleeved dress with a high collar. She is smiling and appears to be interacting with the baby.
  2. A young boy, likely a toddler, is seated on a small chair next to the woman. He is wearing a light-colored outfit with short pants and a collared top with buttons. He is looking at the woman and the baby with a curious expression.
  3. A baby is being held by the woman. The baby is dressed in a white gown and is looking at the woman, possibly engaging in some form of interaction.

The setting appears to be indoors, with a patterned sofa and a plain wall in the background. The overall atmosphere of the image is warm and familial, suggesting a moment of bonding or interaction between the woman and the children.

Qwen

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

This black-and-white image appears to be a vintage photograph, likely from the early 20th century, judging by the clothing styles and overall aesthetic. The scene depicts a woman and four children.

  • Woman: The woman is seated on the right side of the image, holding a baby in her lap. She is wearing a white blouse with lace details at the neckline and sleeves, paired with a long skirt. Her expression is gentle and engaged, suggesting she is talking or singing to the children.

  • Baby: The baby she is holding is dressed in a light-colored outfit with a frilly collar and a ribbon in its hair, indicating that it might be a girl. The baby appears to be looking at something off-camera.

  • Young Child: On the left side of the image, a young child is standing on the armrest of a patterned armchair. The child is wearing a long-sleeved shirt with large buttons and a skirt or shorts, along with knee-high socks and shoes. The child’s posture and expression suggest attentiveness.

  • Two Other Children: In the background, two other children are partially visible. One is seated on the armchair, and the other is standing behind the woman. Their faces are not as clear, but they seem to be dressed in similar period-appropriate clothing.

The setting appears to be indoors, possibly in a living room, given the presence of the armchair and the plain wall in the background. The overall mood of the image is warm and familial.

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

The image is a black-and-white photograph depicting a domestic scene. It shows an adult woman holding a baby girl. The woman is dressed in a lacy, long-sleeved blouse and a long skirt, suggesting a style that could be from the early to mid-20th century. She is seated and appears to be smiling or talking, with her expression gentle and affectionate towards the baby.

The baby is dressed in a long-sleeved, ruffled gown and is being held securely by the woman. The baby looks calm and is looking slightly away from the camera.

To the left of the frame, there is another child seated on a patterned armchair. This child is wearing a long-sleeved top and shorts with knee-high socks, and is looking towards the baby, appearing to be engaged in the scene. The background is plain, with a light-colored wall, and there is a partial view of another person in the background on the right side of the image.

The overall atmosphere of the photograph conveys a sense of familial warmth and intimacy. The clothing and setting suggest a historical period, possibly the 1920s or 1930s.