Human Generated Data

Title

Untitled (two men grinning at two young boys on floor of living room decorated for Christmas)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9154

Human Generated Data

Title

Untitled (two men grinning at two young boys on floor of living room decorated for Christmas)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9154

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Clothing 99.4
Apparel 99.4
Person 99.1
Person 99
Chair 83.8
Furniture 83.8
Face 83.1
Wheel 81.7
Machine 81.7
Airplane 79.9
Transportation 79.9
Vehicle 79.9
Aircraft 79.9
Wheel 78.9
Female 76
Plant 71.6
Indoors 68.1
Girl 66
Wedding 65.4
Bridegroom 65.4
People 65.2
Robe 65.1
Fashion 65.1
Portrait 65
Photography 65
Photo 65
Leisure Activities 64.5
Gown 62.9
Room 62
Suit 61.5
Coat 61.5
Overcoat 61.5
Wedding Gown 59.4
Kid 57.9
Child 57.9
Floor 57.2
Outdoors 57.1
Woman 56.4

Clarifai
created on 2023-10-26

people 99.9
group together 99
group 98.8
adult 98.6
man 96.1
child 95.6
many 95.2
furniture 94.2
several 93.4
vehicle 93.1
two 91.5
recreation 89.5
administration 88.8
woman 88.7
three 88.2
wear 87.6
music 87.4
leader 85.3
boy 84.8
sit 83

Imagga
created on 2022-01-23

musical instrument 47.2
percussion instrument 34.5
man 31.6
people 28.4
male 24.1
hairdresser 22.3
drum 21.5
person 21
men 18.9
wind instrument 18.8
room 16.5
business 15.8
adult 14.7
chair 14.1
brass 13.9
group 13.7
table 13
work 12.8
worker 12.5
city 12.5
sitting 12
women 11.8
lifestyle 11.6
businessman 11.5
office 11.2
shop 11
happy 10.6
indoors 10.5
portrait 10.3
holding 9.9
hand 9.9
marimba 9.8
trombone 9.8
old 9.7
human 9.7
sax 9.7
outdoors 9.7
accordion 9.4
barbershop 9.3
indoor 9.1
playing 9.1
job 8.8
steel drum 8.8
smiling 8.7
teacher 8.7
modern 8.4
mature 8.4
teamwork 8.3
leisure 8.3
home 8
interior 8
working 7.9
device 7.9
together 7.9
urban 7.9
smile 7.8
life 7.8
keyboard instrument 7.7
studying 7.7
talking 7.6
fashion 7.5
study 7.4
street 7.4
back 7.3
music 7.3
school 7.2
team 7.2
classroom 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 94.2
black and white 93.6
outdoor 93.6
person 92.1
clothing 89.2
street 82
footwear 76.7
man 71.7
monochrome 52.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 97%
Happy 91.7%
Calm 3.4%
Confused 1.8%
Sad 1.3%
Surprised 0.6%
Disgusted 0.6%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 34-42
Gender Female, 61.3%
Calm 99.2%
Sad 0.2%
Confused 0.2%
Happy 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 36-44
Gender Female, 62.4%
Calm 93.2%
Sad 5.9%
Confused 0.4%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Wheel
Airplane
Person 99.7%
Person 99.1%
Person 99%
Wheel 81.7%
Wheel 78.9%
Airplane 79.9%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a man and two children playing with toys -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

This is a black-and-white negative image of a cozy indoor scene featuring a family during a festive occasion, presumably Christmas. The focal point includes a Christmas tree adorned with tinsel and decorations in the background. The room is filled with toys, including a tricycle, model train, and various other items scattered across the floor. Large windows and furniture, including a table and chairs, are visible, contributing to the domestic setting. The image depicts a warm, lively family atmosphere indicative of holiday celebrations.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image appears to be a photographic negative featuring a scene in a living room setting. It includes two children with one standing near a decorated Christmas tree and another one sitting on the floor playing with toys. The room has large windows and various furnishings, including a rocking toy in the foreground, a table, and chairs. The floor is covered with a rug, and a toy train track is visible along with other toys scattered around. There are curtains and shelves with items on them, adding a festive atmosphere to the image.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

The image is a black-and-white photograph of a family in their living room, with the father and two sons playing on the floor. The father is wearing a white robe, while the sons are dressed in dark clothing. The room is filled with various toys and objects, including a Christmas tree in the background.

Key Features:

  • A family of three (father and two sons) playing on the floor
  • Father wearing a white robe, sons in dark clothing
  • Room filled with toys and objects, including a Christmas tree in the background

Overall Impression:

The image captures a heartwarming moment of family bonding and playfulness, set against the festive backdrop of a Christmas tree. The black-and-white tone adds a nostalgic touch to the scene, evoking a sense of simplicity and joy.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image is a black-and-white photograph of a man and two children in a living room, surrounded by toys and Christmas decorations.

The man, who appears to be a father or uncle, is wearing a white robe and sitting on the floor with his legs crossed. He has short hair and is looking at the camera with a smile. To his left is a young boy, who is also looking at the camera and wearing a dark-colored shirt and pants. The boy has short hair and appears to be around 2-3 years old. To the right of the man is a younger child, who is sitting on the floor and playing with a toy. This child is wearing a light-colored shirt and pants and has short hair.

In the background, there are several Christmas decorations, including a Christmas tree, presents, and stockings. There are also several toys scattered around the room, including a rocking horse, a tricycle, and a ball. The walls of the room are decorated with curtains and pictures, and there is a window on the back wall that lets in natural light.

Overall, the image suggests that the man and children are enjoying a happy holiday season together, surrounded by festive decorations and toys.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The black-and-white photo shows a family in a room with a Christmas tree. A man is kneeling on the floor, holding a stick and a toy. A boy is standing in front of him, and another man is standing beside him, smiling and looking at the boy. On the left side, there is a desk with a chair and a shelf with some items on top. Behind them are windows.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image shows a black-and-white photograph of two men and a child inside a room. The man on the left is sitting on the floor and holding a baby, while the man on the right is kneeling and holding a toy. There is a Christmas tree behind them, and a table with a book and a box on top. There are also some toys and other items on the floor. The image has a watermark in the bottom right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a black and white photograph, possibly a negative. It shows a room scene with two adults and two children. A Christmas tree stands in the background, slightly blurred and appearing to be decorated.

An adult, possibly a man, is kneeling on the floor with a young child. The child seems to be playing with a toy guitar or similar instrument. Another adult, likely a man, is sitting on the floor next to a small child standing. The adults are smiling and interacting with the children.

The room is filled with various items: a table, a chair, toys, and other furniture. A window is visible in the background, suggesting it is daytime. The scene is likely a family gathering, possibly during Christmas. The overall mood is warm and familial.

Created by gemini-2.0-flash-lite on 2025-05-18

Here is a description of the image:

The image appears to be a negative of a photograph depicting a family scene. It features a couple of adults and two young children, possibly a parent and their children, in what seems to be a domestic setting. The adults are wearing white robes, and one is kneeling while playing with a toy or helping a child. The scene is filled with toys, suggesting it might be a playroom or a living room set up for children. A decorated tree is present in the background, indicating the picture could have been taken around Christmas or a similar holiday. The image's overall appearance is somewhat grainy, which is typical for older photographs or negatives. It is framed by a white border which suggests the print is a physical photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The image appears to be a black and white photograph taken indoors, likely in a living room or a similar setting. Here are the details:

  1. People:

    • There are four people in the image: one adult and three children.
    • The adult, who appears to be a woman, is standing and wearing a light-colored robe or dress. She is holding the hand of a young child who is standing beside her.
    • Two other children are on the floor, engaged in some activity. One child is seated and appears to be playing with a toy or an object, while the other child is leaning over, possibly interacting with the same object.
  2. Setting:

    • The room has a large window in the background, allowing natural light to enter.
    • There is a decorated Christmas tree in the center, suggesting that the photo was taken during the holiday season.
    • The room is furnished with various items, including a chair, a table, and what looks like a sewing machine or a similar device.
    • There are toys scattered on the floor, including a small tricycle and other playthings.
  3. Atmosphere:

    • The overall atmosphere of the image is warm and familial, capturing a moment of interaction and playfulness among the children and the adult.
    • The presence of the Christmas tree and the casual, comfortable setting suggest a cozy, homey environment.

The image captures a candid moment of family life, likely during the Christmas season, with a focus on the interactions between the adult and the children.

Text analysis

Amazon

00
MJIF
50
Adgats
MJIF ACTMA
ACTMA

Google

MJI7 YT33A2 MA
MJI7
YT33A2
MA