Human Generated Data

Title

Untitled (man lying on bed with baby posed on his stomach)

Date

1948-1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9280

Human Generated Data

Title

Untitled (man lying on bed with baby posed on his stomach)

People

Artist: Martin Schweig, American 20th century

Date

1948-1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9280

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 99.8
Couch 96.7
Person 92.4
Human 92.4
Interior Design 87.4
Indoors 87.4
Bedroom 86.7
Room 86.7
Home Decor 70.8
Cushion 67.4
Bed 53.7

Clarifai
created on 2023-10-27

people 99.9
child 99.8
furniture 98.1
sit 97.2
adult 96.8
room 95.5
family 95.4
two 94.1
indoors 93.9
son 92.8
monochrome 92.7
woman 92.3
offspring 91.8
baby 91.4
man 91.1
one 91
bed 90.8
boy 89.7
war 87.9
reclining 84.9

Imagga
created on 2022-01-23

adult 36.2
person 34.9
people 31.8
sitting 29.2
male 29.2
man 28.4
happy 27.6
home 27.1
indoors 23.7
lifestyle 21.7
smiling 21
couple 20.9
senior 20.6
casual 19.5
couch 19.3
women 19
happiness 18.8
portrait 18.8
smile 17.8
chair 17.6
family 16.9
sofa 16.6
room 16.6
laptop 15.6
relaxing 15.5
cheerful 15.4
computer 15.3
seat 15.2
fun 15
mature 14.9
elderly 14.4
together 14
indoor 13.7
patient 13
looking 12.8
work 12.7
worker 12.5
leisure 12.4
old 11.8
child 11.7
working 11.5
living 11.4
mother 11.3
one 11.2
attractive 11.2
men 11.2
love 11
business 10.9
professional 10.9
lady 10.5
human 10.5
reading 10.5
adults 10.4
relaxed 10.3
grandfather 10.3
relax 10.1
book 10.1
alone 10
playing 10
house 10
aged 10
case 9.9
care 9.9
living room 9.8
retired 9.7
husband 9.7
office 9.6
retirement 9.6
life 9.3
relaxation 9.2
sick person 9.1
pensioner 9.1
health 9
armchair 8.9
furniture 8.9
father 8.8
brown hair 8.8
older 8.7
face 8.5
togetherness 8.5
two 8.5
modern 8.4
horizontal 8.4
joy 8.4
color 8.3
camera 8.3
parent 8.1
job 8
daughter 7.9
model 7.8
age 7.6
teacher 7.6
fashion 7.5
enjoyment 7.5
active 7.5
holding 7.4
technology 7.4
joyful 7.3
20s 7.3
executive 7.2
activity 7.2
table 7.1
day 7.1

Microsoft
created on 2022-01-23

bottle 82.3
text 77.3
black and white 67.8
person 54.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 97.2%
Surprised 33.9%
Sad 26.1%
Happy 13.5%
Calm 11.4%
Fear 7.3%
Disgusted 4.1%
Angry 2.6%
Confused 1%

AWS Rekognition

Age 18-26
Gender Male, 80.1%
Calm 51.8%
Sad 39.4%
Confused 2.7%
Happy 2.4%
Fear 1.8%
Angry 1.2%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Female, 75.6%
Calm 89.4%
Sad 4.4%
Happy 2%
Disgusted 1.3%
Angry 0.9%
Confused 0.8%
Surprised 0.6%
Fear 0.6%

AWS Rekognition

Age 23-31
Gender Female, 89.3%
Calm 77.9%
Sad 10.4%
Confused 4%
Happy 3.5%
Surprised 1.6%
Angry 1.1%
Disgusted 1%
Fear 0.6%

AWS Rekognition

Age 20-28
Gender Female, 75.4%
Calm 83.8%
Sad 6.6%
Angry 2.6%
Confused 2%
Disgusted 1.9%
Happy 1.6%
Surprised 0.9%
Fear 0.7%

AWS Rekognition

Age 21-29
Gender Female, 75.6%
Calm 91.3%
Sad 3.1%
Happy 2.2%
Angry 1.6%
Confused 0.6%
Surprised 0.6%
Disgusted 0.5%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Bed
Person 92.4%
Bed 53.7%

Captions

Microsoft
created by unknown on 2022-01-23

a man and a woman sitting on a bed 60.1%
a person sitting on a bed 60%
a man and woman sitting on a bed 52.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-23

a photograph of a woman in a dress and a baby in a bed -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image depicts a black-and-white photograph of a man lying on a bed, with a baby standing on his chest. The man is wearing dark clothing and has short hair. He is lying on his back, with his head resting on a pillow. The baby is standing on the man's chest, holding onto his shirt. The baby is wearing a dark dress or romper.

In the foreground, there is a wooden bed frame with a headboard and footboard. The bed is covered with a dark blanket or comforter. There is also a window with curtains on the left side of the image, and a floral wallpaper on the wall behind the bed.

The overall atmosphere of the image suggests a warm and intimate moment between the man and the baby. The man appears to be relaxed and comfortable, while the baby seems to be enjoying the attention and interaction with the man. The image conveys a sense of love and affection between the two individuals, and the use of black-and-white photography adds a timeless and nostalgic quality to the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

This black and white image depicts a tender moment between an elderly woman and a baby. The woman, with short, light-colored hair, is reclining on a bed, wearing a dark dress. She is holding the baby, who is dressed in a dark dress with short sleeves, on her stomach. The baby is looking down at the woman's chest.

In the background, a window with a curtain is visible on the left side of the image. The wall behind the bed features a floral pattern, and the bed itself has a white frame with a dark blanket. The overall atmosphere of the image suggests a warm and intimate moment between the two individuals.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of an elderly man lying on a bed with a baby on his chest. The baby is looking forward, possibly towards the photographer. The man is wearing glasses and has gray hair. The baby is dressed in a white shirt and has a serious expression on its face. The bed is covered with a white blanket and has a white headboard. The room has a wallpaper with a leaf design on the wall.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man lying on a bed with a baby standing on the bed beside him. The man is wearing glasses and is lying on his back, with his head resting on a pillow. The baby is standing on the bed, looking up at the man. The bed has a white headboard and a white footboard, and the bedspread is white. The wall behind the bed has a floral pattern.

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

This black and white image shows a baby sitting on a grownup laying in bed. The baby is turned facing forward and is reaching their hands down towards the grownup. The grownup is laying on their back and looking up at the baby. They are laying on top of a dark blanket and are wearing a light-colored shirt. The bed has a wooden headboard. Behind the bed is a patterned wall. A window with a curtain is to the left of the bed.

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

Overall Impression: The image appears to be a negative of a photograph, depicting a tender moment between a baby and an older person, possibly a grandparent. The style suggests a vintage or historical photograph.

Setting:

  • Bedroom: The scene is likely inside a bedroom. This is indicated by the presence of a bed, a window (with a curtain), and wallpaper on the wall.
  • Wallpaper: The wallpaper has a repeating pattern of leaves.
  • Bed: The bed frame is a light color (appearing almost white in the negative). The bed is covered with blankets and pillows.

People:

  • Baby: The baby is the focal point, sitting upright, possibly being held by the older person. The baby seems happy.
  • Older Person: The older person is lying down on the bed. The older person has glasses. The older person is holding the baby.

Composition:

  • Candid Moment: It feels like a candid moment between the baby and the person.

Technical Aspects:

  • Monochrome: The image is in black and white.
  • Negative: Due to the negative, the tones are reversed. Light areas appear dark, and dark areas appear light.
  • Film: The edge of the frame shows that the image was taken on film.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a black-and-white photograph depicting a domestic scene. It appears to be taken in a bedroom with a child sitting on a bed. The child, who looks to be a toddler, is dressed in a dark outfit and is holding a small object, possibly a toy or a piece of cloth. The bed has a white headboard and is covered with a blanket or quilt.

In the foreground, there is a person lying on the bed, partially visible, with their back turned to the camera. The person appears to have light-colored hair. The room has a patterned wallpaper with a floral or leaf design, and there is a window with curtains to the left. The lighting suggests that it is daytime, with natural light coming through the window. The overall atmosphere of the image conveys a sense of intimacy and everyday life.

Text analysis

Amazon

003