Human Generated Data

Title

Erik & Dylan, May 8, 1983 (Mother's Day)

Date

1983

People

Artist: Judith Black, American born 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.325

Human Generated Data

Title

Erik & Dylan, May 8, 1983 (Mother's Day)

People

Artist: Judith Black, American born 1945

Date

1983

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.325

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 99.1
Clothing 98
Apparel 98
Home Decor 97.5
Shoe 96.5
Footwear 96.5
Shoe 92.7
Pants 71.9
Vehicle 70.4
Transportation 70.4
Sleeve 67.4
Meal 65.6
Food 65.6
Window 57.9
Shorts 57
Long Sleeve 55.6
Door 55.2

Clarifai
created on 2023-10-25

people 99.9
child 99.5
street 99.4
monochrome 99.3
two 98.1
boy 97.6
man 95.6
adult 95.1
group together 94.2
woman 94.1
group 94
transportation system 93.6
offspring 93.4
vehicle 92.9
three 92.6
family 89.6
portrait 89.4
black and white 87.1
vehicle window 86.1
son 84.8

Imagga
created on 2022-01-09

musical instrument 30.7
man 28.2
accordion 21.5
people 20.6
male 20
keyboard instrument 19.4
person 17.6
industry 17.1
wind instrument 15.8
working 15
work 13.9
worker 13.5
business 13.4
adult 12.9
transportation 12.5
black 12.5
urban 12.2
equipment 12.2
device 11.8
city 11.6
building 11.4
vehicle 11.2
men 11.2
forklift 11
occupation 11
transport 11
office 10.5
construction 10.3
industrial 10
job 9.7
steel 9.7
repair 9.6
home 9.6
smiling 9.4
site 9.4
safety 9.2
happy 8.8
labor 8.8
walk 8.6
portrait 8.4
machine 8.4
house 8.4
support 8.3
human 8.2
travel 7.7
sitting 7.7
modern 7.7
outside 7.7
outdoor 7.6
life 7.5
outdoors 7.5
window 7.4
technology 7.4
street 7.4
metal 7.2
clothing 7.2
architecture 7
sky 7

Microsoft
created on 2022-01-09

clothing 95.8
person 94.2
text 92.3
black and white 91.3
standing 88.4
street 80.5
monochrome 74.8
footwear 51.6
posing 37.5
clothes 15.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Male, 99.6%
Calm 64.4%
Sad 34.7%
Confused 0.2%
Angry 0.2%
Fear 0.2%
Happy 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 31-41
Gender Female, 67.2%
Calm 48%
Confused 44.1%
Angry 2.9%
Surprised 2.3%
Sad 1.3%
Disgusted 0.7%
Happy 0.4%
Fear 0.2%

Microsoft Cognitive Services

Age 8
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.7%
Person 99.1%
Shoe 96.5%
Shoe 92.7%

Categories

Imagga

paintings art 99.5%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a young boy holding a tennis racket and a tennis racket -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The black and white image depicts two individuals on a porch. In the background, one person is lounging in a hammock, wearing casual clothes including jeans, a striped shirt, and sneakers. They appear relaxed, with their arms stretched out on either side. The porch is enclosed with windows, and the setting shows details like a wire shelf, containers, and outdoor structures. Light is streaming in, creating shadows on the floor and emphasizing the geometric lines of the space.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a black and white photograph depicting two children in an outdoor patio or porch setting. One child is standing in the foreground, wearing a dark short-sleeved collared shirt and jeans, while the other child is in the background lying on a hammock. The hammock is attached to a wire mesh structure and the child lying on it is dressed casually in a striped shirt, jeans, and white sneakers. The porch is enclosed, with visible windows showing the exterior of a house and some greenery outside. The lighting suggests it might be a sunny day. The composition of the photograph creates a sense of depth through the arrangement of the children and the environment around them.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black and white photograph of two young boys standing in front of a house. The boy on the left has shaggy hair and is wearing a dark polo shirt with a white collar and cuffs, and dark jeans. He is standing with his feet shoulder-width apart and looking directly at the camera. Behind him, to the right, is another boy who is sitting on a wooden platform, leaning back against a wall. He is wearing a light-colored t-shirt, dark jeans, and sneakers, and has his legs stretched out in front of him. He is holding a large spider web in his right hand and appears to be looking down at something on the ground.

In the background, there is a house with a porch and a window with blinds. There are also some trees and other buildings visible in the distance. The overall atmosphere of the image suggests that it was taken on a sunny day, possibly in the summer or early fall. The boys appear to be enjoying themselves, and the relaxed pose of the boy in the background suggests that they may have been playing or hanging out together.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This black-and-white photograph depicts two boys in a sunroom, with the older boy standing in the foreground and the younger boy reclining in a hammock behind him. The older boy has short, light-colored hair and is dressed in a dark polo shirt with white trim on the collar and sleeves, paired with light-colored pants. He stands with his hands by his sides, facing the camera.

The younger boy, positioned behind the older boy, is wearing a light-colored shirt, dark pants, and a hat. He is lying in a hammock suspended between the wall and a window frame, with his head resting on the edge of the hammock and his legs dangling in the air. The hammock appears to be made of a thin, net-like material.

In the background, the sunroom features a wall with windows and a door leading outside. A tree and a house are visible through the windows, while various items such as a wire rack and a bucket are scattered around the room. The overall atmosphere of the image suggests a relaxed and casual setting, with the two boys enjoying each other's company in a cozy and intimate space.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

A black-and-white photograph shows two boys in a room. The boy in the front wears a black polo shirt and pants. He stands with his hands by his sides. The boy behind him wears a hat and sneakers. He is lying on a hammock with his arms stretched out. The room has a window, a door, and a shelf with items on it. The photograph is printed on a white border.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black and white photo of a boy standing in a porch area with another boy lying on a hammock. The boy standing is wearing a polo shirt and pants, while the boy lying on the hammock is wearing a cap, a striped shirt, and pants. Behind them is a house with a window and a tree outside. There are also some items on the porch, such as a trolley and a storage box.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

The black and white photograph shows two children on what appears to be a porch or enclosed balcony. The main focus is a young boy in the foreground, standing with a solemn expression. He is wearing a dark polo shirt with white trim on the collar and sleeves, and light-colored pants. His hair is short and styled with bangs.

Behind him, slightly out of focus, is another child who appears to be a girl, standing in a hanging hammock or net. She has a cap on and is wearing a striped shirt and jeans. She has her arms raised, holding onto the net.

The backdrop behind the children includes a building with closed shutters and a glimpse of the outdoors through what looks like an open window. The porch area is enclosed with a fence or railing. The light suggests it is daytime, and the scene feels casual and candid. There's a general mood of quiet observation.

Created by gemini-2.0-flash-lite on 2025-05-17

The image is a black and white photograph featuring two young boys on a porch. The boy in the foreground is the primary subject, standing upright with a somewhat stern expression, looking directly at the camera. He is dressed in a dark polo shirt with white trim and blue jeans. His hair is somewhat disheveled.

Behind him, another boy is positioned further back in the image. He's wearing a hat, a striped shirt, and jeans, with arms outstretched, appearing to be posing with a net or a hammock-like structure that hangs on the porch. The structure has a distinct visual texture.

The background reveals a wooden house with shutters and windows. The porch is well-lit, and there is a slight shadow cast by the boy in front. The overall mood of the picture is reminiscent of a candid snapshot, capturing a moment in a seemingly everyday setting. The composition and the expressions of the boys give the photograph a sense of simplicity and quiet observation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black and white photograph featuring two young boys in an outdoor setting. The boy in the foreground is standing on a porch or balcony, looking directly at the camera. He has short, light-colored hair and is wearing a dark polo shirt with a white collar and dark pants.

In the background, another boy is leaning against a wall or fence, facing away from the camera. He is wearing a plaid shirt and shorts, and his posture suggests a relaxed or casual stance. The setting appears to be a residential area, with visible elements such as a window with blinds, a wooden wall, and some outdoor items like a cart or stroller. The overall atmosphere of the photograph conveys a candid, everyday moment.