Human Generated Data

Title

Untitled (boy and girl with toys in playroom)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17407

Human Generated Data

Title

Untitled (boy and girl with toys in playroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17407

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.3
Clothing 95.8
Apparel 95.8
Female 74.7
Room 72.1
Indoors 72.1
Living Room 64.7
Shelf 64.2
Floor 63.7
Girl 61.6
Shorts 60.8
Furniture 60
Kid 58.3
Child 58.3
Home Decor 58.2

Clarifai
created on 2023-10-28

people 99.9
two 99.2
child 99.2
monochrome 98.9
adult 97.9
three 97.5
group together 96.8
group 96.5
indoors 96.4
wear 95.6
woman 94.6
man 94.1
recreation 94
sports equipment 93.7
room 93.1
one 91.3
boy 91.1
education 90.6
nostalgia 90.5
elementary school 90.4

Imagga
created on 2022-02-26

school 48.3
people 36.2
man 30.2
building 28.6
child 28.6
person 27.4
happy 25.1
family 24
home 23.9
adult 23.7
male 22.9
room 22.6
teacher 22.4
structure 20.6
happiness 18.8
lifestyle 18.8
kin 18.7
portrait 18.1
smiling 18.1
kid 17.7
couple 17.4
indoor 17.3
two 16.9
senior 16.9
children 16.4
mother 16
indoors 15.8
classroom 15.8
together 14.9
boy 14.8
sitting 14.6
looking 14.4
men 13.7
girls 13.7
face 13.5
love 13.4
interior 13.3
youth 12.8
human 12.7
casual 12.7
childhood 12.5
little 12.4
education 12.1
fun 12
women 11.9
playing 11.8
shop 11.7
cute 11.5
educator 11.3
mature 11.2
old 11.1
parent 10.7
smile 10.7
professional 10.6
elderly 10.5
standing 10.4
kids 10.4
blond 10.3
father 10.2
care 9.9
cheerful 9.7
black 9.6
age 9.5
leisure 9.1
exercise 9.1
world 9
health 9
kitchen 8.9
daughter 8.9
blackboard 8.6
studying 8.6
husband 8.6
back 8.3
student 8.3
aged 8.1
dress 8.1
active 8.1
group 8.1
to 8
table 7.8
sibling 7.8
retired 7.8
retirement 7.7
loving 7.6
wife 7.6
horizontal 7.5
house 7.5
outdoors 7.5
holding 7.4
teen 7.3
color 7.2
handsome 7.1
son 7.1
day 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 97.2
clothing 92.2
person 88.7
outdoor 85.4
footwear 81.7
black and white 61.5
street 56.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 91.9%
Happy 56.4%
Calm 26%
Surprised 5.4%
Sad 4.2%
Fear 2.9%
Disgusted 2.3%
Confused 1.5%
Angry 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Footwear
Boy
Dress
Human face
Human leg
Human arm
Window
Wheel
House

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 97.3%

Clarifai

Footwear 91%

Clarifai

Footwear 90.6%

Clarifai

Footwear 84.6%

Clarifai

Footwear 78.7%

Clarifai

Footwear 61.5%

Clarifai

Footwear 45.7%

Clarifai

Footwear 40.5%

Clarifai

Footwear 37.6%

Clarifai

Footwear 34.4%

Clarifai

Boy 85.1%

Clarifai

Dress 84.5%

Clarifai

Human face 69.3%

Clarifai

Human face 67%

Clarifai

Human leg 54.9%

Clarifai

Human leg 37.7%

Clarifai

Human leg 34.4%

Clarifai

Human leg 33.8%

Clarifai

Human arm 40.9%

Clarifai

Human arm 35.4%

Clarifai

Window 39.1%

Clarifai

Window 37.9%

Clarifai

Window 37.8%

Clarifai

Window 37.1%

Clarifai

Wheel 37.7%

Clarifai

House 33.1%

Categories

Imagga
created on 2022-02-26

interior objects 94.6%
paintings art 4.6%

Captions

Microsoft
created by unknown on 2022-02-26

a person standing in a room 90.5%
a man and a woman standing in a room 77.2%
an old photo of a person 77.1%

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

person and her brother, playing with a vacuum cleaner.

Salesforce

Created by general-english-image-caption-blip on 2025-05-24

a photograph of a black and white photo of a young girl playing tennis

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a room containing various toys and furniture. In the foreground, there is a playset resembling a tricycle or a ride-on toy with a steering wheel. To the left in the background, there is a play structure that resembles a building marked as a "Fire House." Against the wall, there is a set of shelves holding toys, including a doll, a toy train, and a small model vehicle. The floor is relatively open, and the setting appears playful and organized for children. The image has been presented in a negative format, reversing the light and dark tones.

Created by gpt-4o-2024-08-06 on 2025-06-11

This image captures a scene with two young children in a room. One child is sitting on a ride-on toy with a steering wheel, resembling a tricycle, while the other child stands nearby, both appearing to be in playful interaction. In the background, there is a playhouse designed to look like a building, specifically labeled "Fire House", and shelves stocked with toys or decorative objects, including a toy truck and a doll. The setting suggests an indoor play area with a variety of toys fostering imaginative play. The photo is a black-and-white image with a vintage or retro aesthetic, indicated by the style of toys and furnishings.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows two young children, a boy and a girl, playing in what appears to be a playroom or nursery. The boy is standing next to a toy fire station and is holding a steering wheel, while the girl is running with a doll in her hand. The room is filled with various toys and shelves, and the children seem to be engaged in imaginative play. The image has a vintage or nostalgic feel, with the black and white photography adding to the timeless quality of the scene.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage black and white photograph showing a display window or store interior. The scene includes two mannequins of children - one wearing a checkered or plaid shirt with white pants, and another wearing a dark dress with socks and shoes. In the background, there are wooden shelves displaying various items including what appears to be a radio and a toy train. There's also what looks like a "FIRE H-" sign visible in the background, possibly part of a toy or model building. The image has a distinct mid-20th century feel to it based on the style of clothing and decor.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of two children playing in a room with toys and a firehouse in the background.

The child on the left is a boy with short hair, wearing a plaid shirt, white pants, and sneakers. He is holding a jump rope and appears to be in mid-jump. The child on the right is a girl with short hair, wearing a dark dress with puffy sleeves, dark socks, and white shoes. She is standing with her hands on her hips and appears to be watching the boy.

In the background, there is a large wooden cabinet with glass doors and shelves, containing various toys. Behind the cabinet, there is a toy firehouse with a sign that reads "FIRE H." The floor is made of wood and has a few toys scattered around.

The overall atmosphere of the image suggests a playful and carefree moment between two children in a cozy and inviting environment.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

The image depicts a black-and-white photograph of two dolls, one male and one female, situated in a room with various toys and objects. The male doll is positioned on the left side of the image, wearing a plaid shirt, white pants, and shoes. He has short hair and is holding a hose in his right hand. The female doll is located on the right side of the image, dressed in a dark dress, socks, and shoes. She also has short hair.

In the background, there are several shelves displaying various toys, including a teddy bear, a toy train, and other objects. A large building with a sign that reads "FIRE H" is visible behind the male doll. The overall atmosphere of the image suggests a playful and imaginative setting, with the dolls and toys creating a sense of wonder and curiosity.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph showing two children playing in a room. The room appears to be a play area with various toys and objects. The boy is wearing a white outfit and appears to be jumping on a toy that resembles a seesaw or a merry-go-round. The girl is standing next to him, also smiling, and is dressed in a dress. Behind them, there is a wooden cabinet filled with toys and other items. On the left side of the room, there is a toy building with the words "FIRE HALL" written on it. The image has a vintage or antique feel, possibly from the mid-20th century.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image is a black-and-white photograph of two children, a boy and a girl, playing in what appears to be a toy shop. The boy is standing on a toy wheel, while the girl is sitting on a shelf. The boy is wearing a white shirt, pants, and shoes, while the girl is wearing a dress and shoes. Behind them is a cabinet with shelves filled with toys.

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

The image is a black and white photo negative of two children. On the left is a boy wearing a patterned jacket, light-colored pants, and shoes. He is smiling and appears to be stepping forward, with one foot raised off the ground. He is holding onto a toy with a wheel and a gauge. Behind him is a toy building labeled "FIRE HA".

To the right, a girl sits on a shelf. She is wearing a dress, socks, and shoes. She is also smiling. Behind her is a tall cabinet with several shelves. Various toys and items are visible on the shelves.

The background appears to be a room or play area, with additional props or toy structures visible.

Created by gemini-2.0-flash-lite on 2025-05-28

Here's a description of the image:

Overall Impression:

The image is a black and white negative, giving it a reversed tonality. It depicts two young children in what appears to be a play area or a room with toys. The setting has a vintage feel.

Details:

  • Children:

    • A young boy, dressed in a checked jacket, white pants, and holding a hoop, is standing and appears to be in motion, mid-step. He is smiling broadly.
    • A young girl, wearing a dark dress, is sitting on a low ledge or shelf. She has short, light-colored hair and is smiling.
  • Toys and Setting:

    • There's a large, open shelving unit filled with various toys on display.
    • A decorative, paper-like building structure is visible behind the boy, resembling a firehouse.
    • An elaborate, mechanical toy with gauges is in the foreground.
  • Composition:

    • The composition has a good balance.
    • The negative effect adds an interesting, artistic quality to the image.

Overall, the photograph captures a joyful moment of children playing in a room filled with toys.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a black-and-white photograph depicting two children playing in a room filled with various toys and playthings. The boy on the left is wearing a light-colored outfit and is sitting on a small, spring-mounted toy horse. He is smiling and appears to be enjoying himself. The girl on the right is dressed in a dark dress with a smocked bodice and is also smiling as she stands beside the boy.

In the background, there are shelves lined with different toys, including a toy train, a doll, and other play items. To the left of the children, there is a large toy fire station, which adds to the playful atmosphere of the scene. The room has a wooden floor and the walls are decorated with some patterns. The overall mood of the image is cheerful and nostalgic, capturing a moment of innocent childhood play.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-17

This is a black-and-white photograph of two children in a playful indoor setting. The boy, wearing a plaid shirt and white pants, is seated on a toy car with a steering wheel, appearing to be in motion, as though he is driving. The girl, dressed in a dark dress with ruffled sleeves and white shoes, is standing beside him with one leg lifted as if she is stepping or jumping. The background features a wooden wall with shelves displaying various toys, including a teddy bear, a toy car, and what looks like a toy train. A small building with the words "FIRE H" is visible on one of the shelves. The overall scene suggests a playful and imaginative moment, possibly staged for a photograph, given the positioning and expressions of the children.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-17

This black-and-white image appears to depict two children in a playful setting. The boy on the left is sitting on a toy, possibly a mechanical ride, and is smiling. The girl on the right is standing with one leg raised, also smiling. Behind them, there is a wooden shelf with various toys, including a teddy bear and other items. To the left, there is a toy house labeled "FIRE." The image has a vintage feel, suggesting it was taken several decades ago. The overall atmosphere is one of childhood joy and playfulness.

Text analysis

Amazon

FIRE
19
FIRE H
H
JJS
NAGOY
МОВО
and
YT77A.2

Google

FIRE H
FIRE
H