Human Generated Data

Title

Smithaven Mall, Christmas

Date

1979

People

Artist: Per Brandin, American born 1953

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.397

Copyright

© Per Brandin 1979

Human Generated Data

Title

Smithaven Mall, Christmas

People

Artist: Per Brandin, American born 1953

Date

1979

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.397

Copyright

© Per Brandin 1979

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.1
Stroller 86
Machine 82.5

Clarifai
created on 2023-10-25

people 98.9
stroller 98.6
two 98.1
cart 97.9
baby 97.8
carriage 97.8
family 97.1
child 95.8
dog 95.8
couple 95.7
street 94.3
monochrome 94
chair 93
walk 91.6
tram 90.7
woman 89.7
canine 89.3
adult 88.3
three 86.6
man 86.6

Imagga
created on 2022-01-09

cleaner 63.6
shopping cart 62.6
handcart 43.9
wheeled vehicle 32.9
container 27
crutch 26.9
shopping 24.8
cart 22.4
vacuum 21.3
staff 20.8
buy 18.8
basket 18.1
store 17.9
man 17.5
market 16.9
stick 16.6
business 15.8
retail 15.2
male 14.9
sale 14.8
shop 14
equipment 13.9
home appliance 13.9
metal 13.7
supermarket 13.7
adult 13.6
buying 12.5
empty 12
one 11.9
conveyance 11.9
trolley 11.8
person 11.8
object 11.7
chair 11.5
push 11.4
work 11.2
appliance 11.2
people 11.2
men 10.3
transport 10
clean 10
sport 9.9
cleaning 9.7
mall 9.7
trade 9.6
metallic 9.2
exercise 9.1
seat 9
pushcart 8.9
checkout 8.9
working 8.8
silver 8.8
smiling 8.7
customer 8.6
house 8.4
folding chair 8.3
happy 8.1
home 8
steel 8
trading 7.8
carry 7.8
nobody 7.8
wheel 7.5
commerce 7.5
outdoors 7.5
swab 7.4
tool 7.3
domestic 7.2
lifestyle 7.2
interior 7.1
indoors 7
modern 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

street 95.2
black and white 93.9
person 93.3
outdoor 87
monochrome 85.5
text 85
footwear 73.3
clothing 62.3
baby 52

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 0-4
Gender Female, 100%
Fear 87.7%
Surprised 3.9%
Confused 3.5%
Happy 3%
Sad 0.7%
Angry 0.5%
Disgusted 0.4%
Calm 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Wheel

Clarifai

No features identified

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 84.5%

AWS Rekognition

Wheel 82.5%

Categories

Imagga
created on 2022-01-09

streetview architecture 43%
paintings art 36.3%
interior objects 11.1%
beaches seaside 5.8%
text visuals 1.6%
nature landscape 1.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a man pushing a cart with a baby in a cart

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image depicts a person standing next to a wooden counter and holding a stroller. The stroller contains a child sitting inside, alongside a shopping bag and other items. The scene appears to be set in a public space such as a fast-food restaurant or café, with beverage dispensers and various supplies visible behind the counter. The floor consists of tiled and textured surfaces. A trash can is positioned to the right of the counter.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image shows a person standing in front of a food counter, pushing a stroller in which a baby or small child is seated. The person is wearing a light-colored suit and holding a beverage cup in one hand. Next to the stroller, there is a shopping bag labeled with the "Macy's" logo. The setting appears to be a food court or cafe area with a tiled floor, and there is a trash can visible to the right. Behind the counter, an assortment of food service items and equipment can be seen, including beverage dispensers and cups.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows a person, likely a man, walking with a baby stroller or carriage in front of a store or shop. The setting appears to be a city street or sidewalk, with a tiled floor and a storefront visible in the background. The image is in black and white, giving it a vintage or historical feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white photograph showing a scene at what appears to be a storefront. A small child is sitting in a basic stroller or pushchair while an adult, shown only from the waist down wearing what looks like casual pants, is standing at what might be a counter or service window. The setting has a tiled or paved floor and wooden paneling visible on the wall. The image has a casual, everyday feel to it, likely from sometime in the mid to late 20th century based on the style of the stroller and the overall aesthetic of the photograph.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of a woman pushing a baby in a stroller. The woman is wearing a light-colored suit and has short dark hair. She is standing on the right side of the image, facing left, and is pushing the stroller with her right hand. The baby is sitting in the stroller, facing forward, and appears to be holding something in its hands.

In the background, there is a counter with various items on it, including a cash register, a trash can, and some boxes. The floor is made of tile, and the walls are covered in wood paneling. The overall atmosphere of the image suggests that it was taken in a public place, possibly a store or restaurant, during the daytime.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black and white photograph of a woman pushing a stroller with a young child inside.

  • The woman is standing on the right side of the image, facing left. She has short dark hair and is wearing a light-colored suit with a dark shirt underneath. Her left hand is holding the handle of the stroller, and her right hand is holding a shopping bag.
  • The stroller is in front of the woman, facing left. It has a metal frame with wheels and a seat for the child. The child is sitting in the seat, facing forward. The child is wearing a long-sleeved shirt and pants, and has short blonde hair.
  • The background of the image shows a storefront with a counter and a trash can. There are various items on the counter, including a cash register, a coffee maker, and some cups. The floor is made of tile, and there is a doorway to the right of the woman.

Overall, the image appears to be a candid shot of a woman shopping with her child. The woman's casual attire and the presence of the stroller suggest that she may be running errands or doing some grocery shopping. The child in the stroller seems to be enjoying the ride, looking around at their surroundings with interest.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-01

The black-and-white photo shows a woman in a suit pushing a stroller with a child inside. The woman is holding a cup in her right hand, and the child is holding a bottle. Behind them is a counter with items on top, and on the right side, there is a trash bin and a glass door. The photo has a white border, and the child's face is partially obscured by the stroller.

Created by amazon.nova-lite-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a scene in a fast-food restaurant. The focus is on a woman pushing a stroller with a baby inside. The woman is dressed in a suit and is holding the stroller handle. The baby is seated in the stroller and appears to be looking out the window or at something of interest. Behind the woman, there is a counter with various items on it, including cups, a coffee machine, and other kitchen utensils. The counter is made of wood and has a tiled floor. On the right side of the image, there is a trash can and a door leading to another area. The image captures a moment of everyday life in a fast-food restaurant.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely taken in an urban setting. It captures a moment in time, possibly in a shopping area or restaurant. The scene has a slightly retro feel.

Main Elements:

  • Subject: A woman is standing next to a baby stroller, likely pushing it. The stroller contains a baby. The woman is wearing a suit.
  • Environment: They are positioned in front of a counter, which seems to be part of a food establishment. The counter has a wood-grain finish.
  • Details: There is a shopping bag next to the woman. The floor is tiled. The overall background consists of the counter.

Composition:

  • The shot is a medium shot, and the woman is centrally placed. The stroller and baby take up a significant portion of the composition.

Style:

The image has a documentary or candid feel. The black and white format lends it a timeless quality, and the composition suggests a moment that was quickly observed and captured.

Created by gemini-2.0-flash on 2025-05-05

Here's a description of the image:

The black and white photograph captures a moment in an indoor public space. A woman stands beside a vintage-style baby stroller, facing towards the left, with the stroller slightly in front of her. The stroller contains a small child. The woman is wearing a patterned suit and dark shoes. She is holding the stroller's handles and has a shopping bag hanging from the stroller handles.

Behind them is a counter, likely of a food service establishment, with various pieces of equipment and signage visible, including a drink dispenser and a sign that says "iced." The floor is tiled and the doorway is to the right side. The overall aesthetic of the image is somewhat dated, suggesting it was taken several decades ago.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The black-and-white photograph depicts a scene from what appears to be a commercial or retail area. In the foreground, there is a person pushing a baby stroller. The individual is dressed in a long coat and appears to be holding a bag or package in their left hand. The stroller contains a child who is looking towards the camera. The person pushing the stroller has their back to the camera, making their face unrecognizable.

The background features a storefront with a counter and various items on display, including what looks like a cash register and some packaged goods. The storefront has a wood-paneled design and a tiled floor. There is also a trash can and some other miscellaneous items visible in the background. The overall setting suggests a casual, everyday scene, likely from a past era given the style of clothing and the design of the stroller and storefront.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

This is a black and white photograph depicting a woman pushing a child in a stroller in front of a storefront. The woman is dressed in a light-colored, patterned suit and is holding a beverage in her hand. The child is wearing a dark outfit and appears to be looking towards the camera or the photographer. The stroller is a standard design with a fabric cover. In the background, there is a counter with various items on it, including what appears to be stacked cups, a cash register, and what looks like a menu or signage. The photo has a vintage quality, suggesting it was taken some time ago. The sidewalk and the edge of the building are visible at the bottom of the image, and the pavement is tiled. There is a trash bin to the right of the woman, partially covered with a bag. The overall scene suggests a casual, everyday moment captured in a public setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white photograph captures a candid street scene. A woman, dressed in a long coat and holding a bag, is standing near a counter inside what appears to be a store or café. She is looking towards a baby seated in a stroller positioned just outside the store. The baby is wearing a sweater and appears to be looking up, possibly at the woman. The counter inside the store is cluttered with various items, including stacked glasses and other objects. The flooring outside is tiled, and there is a trash can near the entrance. The overall atmosphere suggests a moment of interaction between the woman and the baby, possibly the baby's mother or caregiver.

Text analysis

Amazon

6
SM-