Human Generated Data

Title

[Julia and Andreas Feininger, Paris]

Date

1907

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.221

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Julia and Andreas Feininger, Paris]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1907

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.221

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Machine Generated Data

Tags

Amazon
created on 2022-07-01

Human 98.6
Face 98
Clothing 96.4
Apparel 96.4
Female 96.3
Costume 96.1
Dress 95.5
Animal 88.2
Woman 84.5
Glasses 82.6
Accessories 82.6
Accessory 82.6
Girl 79.1
Baby 74.2
Kid 73.4
Child 73.4
Portrait 73.2
Photography 73.2
Photo 73.2
Performer 72.7
Icing 72.7
Food 72.7
Dessert 72.7
Cake 72.7
Cream 72.7
Creme 72.7
People 66.8
Teen 60.2
Play 59.4
Hair 59.1
Finger 58.5
Hat 58.5
Leisure Activities 57.4
Head 56.8
Dance 56.3
Dance Pose 55.8

Clarifai
created on 2025-01-09

people 99.7
monochrome 98.9
two 98
man 95.3
theater 95.1
adult 94.9
wear 94.8
music 94.2
costume 93.8
actress 93.7
woman 93.4
one 91.2
art 90.7
group 90.4
actor 90.3
street 90.1
portrait 89.4
outfit 88.8
dancing 87.9
veil 87.2

Imagga
created on 2022-07-01

hairdresser 87.1
person 33.7
people 31.8
man 31.6
adult 26.7
couple 23.5
male 23.5
barbershop 22.7
portrait 21.4
patient 21.2
medical 21.2
happy 20.1
salon 20
love 19.7
shop 19
groom 18.6
doctor 17.9
bride 17.3
dress 17.2
senior 16.9
men 16.3
wedding 15.6
hospital 15.6
health 15.3
smiling 15.2
professional 14.6
work 14.1
mercantile establishment 13.6
looking 13.6
human 13.5
women 13.4
happiness 13.3
smile 12.8
face 12.8
home 12.8
hair 12.7
family 12.5
medicine 12.3
together 12.3
fashion 12.1
nurse 12
husband 11.6
care 11.5
wife 11.4
sitting 11.2
room 10.9
lifestyle 10.8
veil 10.8
laboratory 10.6
loving 10.5
life 10.3
mature 10.2
two 10.2
worker 9.9
gown 9.8
cheerful 9.8
lady 9.7
indoors 9.7
black 9.6
married 9.6
profession 9.6
day 9.4
camera 9.2
pretty 9.1
attractive 9.1
holding 9.1
place of business 9.1
old 9.1
one 9
affectionate 8.7
clinic 8.6
clothing 8.6
illness 8.6
casual 8.5
treatment 8.3
indoor 8.2
equipment 8.2
to 8
surgeon 7.9
scientist 7.8
model 7.8
lab 7.8
affection 7.7
research 7.6
uniform 7.6
marriage 7.6
relaxation 7.5
relationship 7.5
fun 7.5
leisure 7.5
mother 7.4
inside 7.4
occupation 7.3
sick person 7.1
science 7.1
modern 7

Google
created on 2022-07-01

Smile 90
Vision care 87
Sunglasses 86.8
Black-and-white 85.7
Style 84.1
Grey 84
Happy 78.8
Monochrome photography 76.6
Monochrome 76.6
Fun 73.5
Event 72.5
Eyewear 71.2
Fashion design 70.3
Fur 65.6
Road 64.7
Glass 64.6
Sporting Group 62.9
Room 61.5
Sitting 61.5
Street 59.6

Microsoft
created on 2022-07-01

person 99.2
wedding dress 97.9
human face 97.1
dance 96.7
bride 96
dress 94.5
clothing 94.3
smile 93
woman 88.1
text 76.9
fashion accessory 70

Color Analysis

Feature analysis

Amazon

Person
Bird

Clarifai

Human face
Clothing
Human nose
Human eye
Human mouth
Human hair
Human arm

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 75%

AWS Rekognition

Bird 88.2%

Clarifai

Human face 95.8%

Clarifai

Human face 89.2%

Clarifai

Human face 38.7%

Clarifai

Clothing 87.3%

Clarifai

Clothing 75.9%

Clarifai

Clothing 49.4%

Clarifai

Clothing 35.7%

Clarifai

Clothing 34.6%

Clarifai

Human nose 49.2%

Clarifai

Human nose 40.3%

Clarifai

Human eye 49.1%

Clarifai

Human eye 48.4%

Clarifai

Human eye 45.1%

Clarifai

Human eye 44.6%

Clarifai

Human mouth 48%

Clarifai

Human hair 38.8%

Clarifai

Human arm 34.9%

Clarifai

Human arm 34%

Categories

Imagga
created on 2022-07-01

paintings art 82%
people portraits 5.9%
interior objects 5%
food drinks 4.3%
events parties 1.7%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a woman in a costume is holding a cat

Created by general-english-image-caption-blip-2 on 2025-06-28

an old black and white photo of a woman holding a baby

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image appears to be a black-and-white photographic negative. It shows a seated individual holding a child or small figure. The clothing of the larger figure includes a patterned design, and they are seated in an upholstered chair. Details of the background, such as a column or architectural element and some items on a surface, are visible. The smaller figure reaches out with its arm extended.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a negative photograph showing a person seated on a patterned armchair, holding a child. The person's attire includes a garment with floral or decorative trim. Behind them, part of a room is visible with architectural detailing like a column or molding on the wall. The overall tone of the photograph is reversed due to it being a negative, with light tones appearing dark and vice versa.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows a black and white photograph of what appears to be a person wearing a frightening mask or costume. The figure has exaggerated, distorted features with large, wide-open eyes and a grotesque expression. The person is wearing a patterned robe or garment, and the background appears to be a room or indoor setting. The overall image has a surreal, unsettling quality, evoking a sense of unease or discomfort.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be an old black and white photograph with an unusual negative or inverted effect. The image shows someone sitting and holding what appears to be a doll or puppet. They are wearing patterned clothing with a light-colored top. The photograph has an eerie quality due to the inverted lighting effect which makes the faces appear bright white with dark features. The overall composition has a vintage, possibly early 20th century feel to it based on the photographic style and clothing visible.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black and white photograph of a woman holding a monkey. The woman has short, curly hair and is wearing a dress with a floral pattern. She is sitting in a chair and holding the monkey in her lap. The monkey is wearing a dark-colored outfit and appears to be looking at the camera.

The background of the image is out of focus, but it appears to be a room with a window and some furniture. The overall atmosphere of the image is one of warmth and intimacy, as the woman and monkey seem to be enjoying each other's company.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a woman holding a monkey. The woman has short, wavy hair and is wearing a light-colored blouse with a dark skirt. She is sitting in a chair, facing the camera, and holding the monkey in her arms. The monkey is looking at the camera with its mouth open, as if it is making a sound.

In the background, there are some indistinct objects that appear to be furniture or decorations. The overall atmosphere of the image suggests that it was taken in a domestic setting, possibly in the woman's home. The woman's expression is neutral, and the monkey seems to be enjoying the attention. The image is likely from the early 20th century, based on the style of the woman's clothing and the quality of the photograph.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The image is a black-and-white photograph of a woman sitting on a chair, holding a baby doll. The woman has a cheerful expression on her face, and she is dressed in a floral dress. The baby doll is wearing a black dress and has a white face. The baby doll's eyes are wide open, and it appears to be looking directly at the camera. The woman is holding the baby doll close to her chest, and her hand is resting on the doll's back. The background of the image is blurry, and it appears to be a room with a window and a door.

Created by amazon.nova-pro-v1:0 on 2025-06-13

The image is a black-and-white photograph of a woman sitting on a chair and holding a baby. She is wearing a white dress with a floral pattern. The baby is dressed in a black outfit. The woman's face is slightly blurred, while the baby's face is in focus. The image has a surreal quality, as if it were taken through a glass window.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here is a description of the image:

This is an inverted black and white image depicting a woman holding a baby. The woman is seated, presumably in a chair, with a decorative backrest visible behind her. She has her hair styled up and back from her face. She's wearing a long-sleeved blouse with a decorative pattern along the sleeves and possibly the neckline. A dark fabric, possibly a skirt or blanket, covers her lower body.

The baby is held in her arms, facing forward. It appears to be wearing a dark outfit and has a concerned expression on its face, with its mouth slightly open. A dark object is near the baby's hand.

In the background, the room has decorative elements, including what appears to be a picture or mirror hanging on the wall and a curtain or draped fabric to the right side of the frame. The image has a high contrast, with stark whites and dark blacks, which contributes to the vintage aesthetic.

Created by gemini-2.0-flash-lite on 2025-06-13

Here's a description of the image:

Overall Impression: The image is a black-and-white negative, which inverts the typical light and dark values. It depicts a woman holding a baby.

Main Subjects:

  • Woman: She appears to be seated, and is holding a baby. She has a serious expression and is dressed in a blouse with floral designs.
  • Baby: The baby is being held by the woman.

Setting/Context:

  • The background is blurred. There are indications of a room or interior setting.

Overall Mood/Tone: The image feels quite formal.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-13

The image appears to be a vintage black-and-white photograph featuring two people. The person on the left, likely an adult, is holding a child on their lap. The adult is wearing a patterned garment, possibly a dress or a robe, with a floral design. The child is dressed in a dark outfit and is wearing a hat. The adult's face is blurred, which could be due to motion or a long exposure time, common in older photographs. The background is somewhat indistinct but seems to include a window and some furniture. The overall tone of the image suggests it might be from the early to mid-20th century.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

This image is a black-and-white photograph featuring a person seated with a doll in their lap. The person appears to be wearing a patterned scarf and has a relaxed posture. The doll is bald and has a wide-eyed expression. The background is somewhat blurred but seems to include architectural elements, possibly a building or a structure with a column. The overall style of the photograph suggests it may be from the early to mid-20th century, given the attire and the quality of the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

The image is a black-and-white photograph of a person sitting and holding a doll. The person appears to be wearing a patterned blouse and has a light-colored shawl draped over their shoulders. The doll they are holding has dark skin, a bald head, and is dressed in dark clothing. The person is sitting next to a rocking chair, which is partially visible on the right side of the image. The background includes a window with curtains and some furniture. The overall style of the photograph suggests it is from an earlier era, possibly the early to mid-20th century.