Human Generated Data

Title

[Andreas and Julia Feininger]

Date

1909-1910

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.345

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Andreas and Julia Feininger]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1909-1910

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.345

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Machine Generated Data

Tags

Amazon
created on 2022-07-01

Human 98.8
Clothing 92.9
Apparel 92.9
Coat 79
Musician 67.8
Musical Instrument 67.8
Electronics 66
Leisure Activities 64.9
Jacket 63.2
Hair 59.9
Pianist 59.9
Piano 59.9
Performer 59.9
Sleeve 58.9
Sitting 58.8
Word 56.6
Hairdresser 56.6
Worker 56.6
Chair 55.6
Furniture 55.6

Clarifai
created on 2025-01-09

people 99.8
child 99.3
two 98.5
woman 97.6
sit 96.4
adult 96.2
one 94.4
portrait 94
furniture 92.9
man 92.7
wear 92.5
monochrome 90.4
family 89.9
bench 86.9
son 86.3
offspring 85.8
girl 84.2
boy 83.9
sitting 83.6
seat 82

Imagga
created on 2022-07-01

senior 37.5
people 35.1
happy 34.5
person 34.3
man 34.3
male 31.6
adult 26.9
mature 26
together 25.4
portrait 24.6
grandfather 24.2
smiling 22.4
old 22.3
couple 21.8
retired 21.3
lifestyle 21
elderly 20.1
grandma 17.9
retirement 17.3
computer 17.2
business 17
child 16.9
family 16.9
love 16.6
smile 16.4
sitting 16.3
happiness 15.7
looking 15.2
home 14.4
outdoors 14.3
hair 14.3
women 14.2
work 14.1
office 13.8
laptop 13.5
mother 13.3
indoors 13.2
grandmother 12.7
businessman 12.4
professional 12.2
face 12.1
attractive 11.9
casual 11.9
active 11.8
day 11.8
leisure 11.6
husband 11.6
wife 11.4
bow tie 11.3
pensioner 11.3
relaxing 10.9
outdoor 10.7
affection 10.6
human 10.5
togetherness 10.4
blond 10.3
relaxed 10.3
expression 10.2
glasses 10.2
businesswoman 10
worker 10
aged 10
working 9.7
technology 9.7
education 9.5
men 9.4
model 9.3
holding 9.1
park 9.1
gray 9
one 9
citizen 8.9
world 8.9
table 8.7
teacher 8.7
boy 8.7
chair 8.7
age 8.6
parent 8.5
two 8.5
color 8.3
necktie 8.2
lady 8.1
suit 8.1
handsome 8
kid 8
corporate 7.7
outside 7.7
generation 7.7
talk 7.7
room 7.7
youth 7.7
desk 7.7
loving 7.6
reading 7.6
head 7.6
communication 7.6
friends 7.5
fun 7.5
spectator 7.4
success 7.2
black 7.2
sibling 7.2
job 7.1
modern 7

Google
created on 2022-07-01

Black-and-white 84.2
Style 84
Jacket 77.3
Monochrome 76.1
Fun 75.4
Monochrome photography 72.4
Vintage clothing 70
Room 66
Sitting 64.6
Conversation 61.1
Happy 61.1
Toddler 60.5
Hoodie 58.3
Child 57.9
Family 51.8
T-shirt 51.3
Portrait 50.6

Microsoft
created on 2022-07-01

person 93.6
man 91.4
clothing 91.2
black and white 86
human face 78.5
text 71

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Female, 59.7%
Surprised 99.7%
Fear 5.9%
Sad 2.2%
Confused 0.7%
Calm 0.1%
Angry 0%
Happy 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Clothing
Human face
Boy
Houseplant
Flowerpot
Human hair
Human hand
Flower
Human nose

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.4%

Clarifai

Clothing 97.1%

Clarifai

Clothing 72.6%

Clarifai

Clothing 58.2%

Clarifai

Human face 94.5%

Clarifai

Human face 90.4%

Clarifai

Boy 89%

Clarifai

Houseplant 61.5%

Clarifai

Flowerpot 59.2%

Clarifai

Human hair 43.8%

Clarifai

Human hair 36.6%

Clarifai

Human hand 39.5%

Clarifai

Flower 39%

Clarifai

Human nose 36.5%

Clarifai

Human nose 33.8%

Categories

Imagga
created on 2022-07-01

pets animals 31.1%
people portraits 28.7%
nature landscape 26.7%
paintings art 6.3%
events parties 4.3%
food drinks 1.3%

Captions

Microsoft
created by unknown on 2022-07-01

a man sitting in front of water 70%
a man sitting on a table 65.4%
a man sitting on a bed 47%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a woman sitting on a couch with a baby in her lap

Created by general-english-image-caption-blip-2 on 2025-07-04

a black and white photo of two people sitting at a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This is a black-and-white negative image depicting two people seated indoors. One person appears to be an older woman with light-colored hair styled neatly, wearing a dark outfit with light accents. They are positioned near a table that has items on it. In the background, there is a wall and a windowsill with a potted plant featuring flowers. The composition suggests an intimate or casual interaction.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a black and white photograph showing two people sitting at a table or desk. To the right of the image is an elder person with light-colored hair, wearing a patterned garment. The setting includes a textured wall or surface in the background and a window ledge with a potted plant on the right side. The photograph has a vintage feel due to the monochromatic style and composition.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows two young children, a boy and a girl, sitting on a couch or chair. The boy appears to be looking at or interacting with the girl, who is wearing a frilly or ornate dress. The background is dark and indistinct, drawing the focus to the two children. The image has a vintage or historical feel, captured in black and white.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be taken in front of a white brick wall. The image shows what appears to be someone seated at a piano or keyboard, with their reflection or a repeated image effect creating an artistic, ghostly multiple exposure look. The photograph has an ethereal, dreamy quality created by the lighting and the way the figure seems to blur or repeat across the frame. The composition is quite artistic, with strong contrast between light and dark elements.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of a young child and an adult sitting at a table, engaged in conversation. The child, dressed in a dark shirt, sits on the left side of the table, while the adult, wearing a light-colored blouse with dark trim, sits on the right. The table is partially obscured by a dark cloth or table runner.

In the background, a white couch or sofa is visible, accompanied by a window on the right side of the image. A potted plant sits on the windowsill, adding a touch of greenery to the scene. The overall atmosphere of the image suggests a warm and intimate moment between the child and the adult, possibly a mother and son or a teacher and student. The setting appears to be a domestic or educational environment, with the table and chairs suggesting a meal or lesson taking place.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a woman and a child sitting at a table. The woman has short hair and is wearing a dress with a ruffled collar. She is looking down at the child, who is sitting on her right side. The child has short hair and is wearing a dark-colored shirt. They are both sitting at a table with a dark-colored tablecloth.

In the background, there is a white wall with a plant on a shelf to the right of the woman. The overall atmosphere of the image suggests a quiet, intimate moment between the woman and the child.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The black and white image shows a woman and a child sitting on a couch. The woman is looking at the child, who is looking at something on the couch. The child is wearing a black shirt and has short hair. The woman is wearing a long-sleeved blouse and has long hair. There is a potted plant on the right side of the image, near the window. The image has a vintage look, possibly taken in the 1960s or 1970s.

Created by amazon.nova-pro-v1:0 on 2025-06-13

The black-and-white image features a woman and a child sitting on a couch, facing each other. The woman is wearing a long-sleeved dress with a shawl. The child is wearing a short-sleeved shirt and is holding a toy. They are both looking at something in front of them. There is a potted plant on the right side, and a window is on the right side of the room.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here's a description of the image:

The image appears to be a black and white photograph, possibly an older one due to its style and the presence of minor imperfections like scratches on the surface. It features two figures: a child on the left and an adult, presumably a woman, on the right.

The child has light-colored hair and is dressed in a darker garment. The child seems to be looking down at something in front of them, possibly on a surface like a table.

The woman has shorter, styled hair and is wearing what appears to be a blouse or dress with a dark collar. She is facing towards the child, possibly interacting with them.

They are seated against a background that looks like a wall with a textured or panelled section behind them. To the right, partially obscured by what could be a window frame or bright light, there is a potted plant with blooms.

The overall composition suggests a candid domestic scene, possibly a quiet moment between a child and their mother or grandmother. The inverted colors suggest that the image is a negative.

Created by gemini-2.0-flash-lite on 2025-06-13

Here's a description of the image:

Overall Impression: The image is a black and white, negative photograph. It appears to be an older photograph due to the film grain and scratches on the surface. The composition is somewhat simple, focusing on a person and a small child indoors.

Subject & Composition:

  • The main subjects are a person, likely an older individual based on the hair and clothing, and a small child. They appear to be seated at a table or surface.
  • The child is turned towards the table, and the older person is looking at the child.
  • They are positioned in the lower portion of the frame, with a large section of the backdrop filling the upper portion.

Setting & Details:

  • The background suggests an interior setting.
  • There is a textured backdrop behind the subjects, which looks like a wall or a piece of furniture.
  • To the right is a window, with a potted plant visible on the windowsill. The details of the plant (flowers) can be seen.
  • Some dark lines appear on the table in front of the individuals, which could be other objects, perhaps items the child is playing with.
  • The lighting is soft, suggesting natural light from the window.

Style & Tone:

  • The image has a nostalgic feel due to the black and white format, and the presence of artifacts (scratches on the negative), suggesting an older photograph.
  • The overall tone is intimate and perhaps a captured moment of connection.

If you want, you can give me another image to describe!

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-13

The image is a black and white photograph depicting two children sitting on a bed. The bed has a light-colored headboard and is positioned against a dark wall. The children appear to be engaged in a quiet activity, possibly reading or looking at a book together. The child on the left has short, light-colored hair and is wearing a dark top, while the child on the right has slightly longer, light-colored hair and is wearing a striped garment.

To the right of the image, there is a window with a flower pot containing a plant placed on the windowsill. The overall scene suggests a calm and intimate moment between the two children, possibly siblings, in a domestic setting. The lighting in the room appears to be natural, coming from the window.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-13

This is a black-and-white photograph showing two individuals indoors, likely in a domestic setting. The room has a wall in the background with a patterned texture, and there is a window with a potted plant to the right.

  • On the left, a child is sitting and appears to be focused on an object, possibly a book or a small box, which is placed on a surface in front of them. The child is wearing a dark-colored sweater.
  • On the right, an adult is seated and seems to be engaged in an activity, possibly reading or looking at something. The adult is wearing a light-colored dress with a dark shawl or wrap over their shoulders, and they have light-colored hair styled in a way that it is slightly blurred or out of focus.

The lighting in the image is soft, and the overall atmosphere appears calm and intimate. There is a sense of quiet interaction between the two individuals.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-13

This is a black-and-white photograph that appears to be from an earlier time period, possibly the mid-20th century, given the style of clothing and the grainy quality of the image. The image shows two children sitting on a couch or a similar piece of furniture. The child on the left is a boy with short hair, wearing a dark sweater. He appears to be looking down at something in his hands, possibly a book or a tablet. The child on the right is a girl with her hair in a ponytail, wearing a light-colored dress with dark ruffled sleeves. She is leaning forward, seemingly engaged in an activity with the boy, possibly reading or playing with him.

The background is a plain wall with some visible texture, and there is a potted plant with flowers placed on a windowsill to the right. The overall atmosphere of the image is calm and intimate, capturing a moment of interaction between the two children. The photograph has some scratches and marks, indicating its age and possibly the method of development or the material it was printed on.