Human Generated Data

Title

Untitled (couple posing on beach with adirondack chairs)

Date

c. 1970

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11587

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple posing on beach with adirondack chairs)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1970

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11587

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Shorts 99.8
Clothing 99.8
Apparel 99.8
Person 99.6
Human 99.6
Person 99.4
Person 98
Person 97.3
Person 93.6
Female 90.7
Dress 86.6
Person 81.8
Face 80.9
Outdoors 80.6
Tree 79
Plant 79
Nature 76.8
Person 76.4
Grass 75.3
Woman 72.9
Shirt 70.8
Girl 67.7
Pants 66.9
Portrait 65.9
Photography 65.9
Photo 65.9
Kid 65.3
Child 65.3
Person 61
Bench 60.7
Furniture 60.7
Icing 59.8
Food 59.8
Dessert 59.8
Cake 59.8
Cream 59.8
Creme 59.8
City 57.5
Building 57.5
Town 57.5
Urban 57.5
Bench 56.8
Man 56.2

Clarifai
created on 2023-10-25

people 99.7
group 96.2
group together 96.1
many 95.7
adult 91.7
man 88.7
wear 88.4
woman 87.2
child 85.6
monochrome 83.4
uniform 74.6
leader 73.1
audience 72.5
spectator 71.2
music 70.1
outfit 69.5
military 69.1
administration 65.2
vehicle 64.2
war 62.8

Imagga
created on 2022-01-15

person 19.9
dancer 17.9
people 17.8
silhouette 17.4
sunset 17.1
male 17
man 16.8
performer 16.8
sky 16.6
water 15.3
travel 14.1
sea 14.1
beach 12.8
ocean 12.4
men 12
outdoors 11.9
entertainer 11.9
stage 11.2
love 11
couple 10.4
outdoor 9.9
adult 9.9
night 9.8
old 9.7
teacher 9.7
happiness 9.4
two 9.3
sport 9.2
summer 9
world 9
landscape 8.9
weapon 8.8
tropical 8.5
waiter 8.4
dark 8.3
wedding 8.3
platform 8.3
art 8.2
light 8.2
history 8
dance 8
life 8
women 7.9
black 7.8
scene 7.8
bride 7.7
musical instrument 7.7
dusk 7.6
human 7.5
professional 7.5
city 7.5
evening 7.5
tourism 7.4
tourist 7.4
island 7.3
protection 7.3
danger 7.3
group 7.3
sand 7.2
architecture 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99.9
wedding 86.2
old 82.4
window 80.4
standing 80.4
black 66.5
ceremony 58.2
black and white 53.3
posing 36.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Female, 83.4%
Happy 99.6%
Calm 0.2%
Surprised 0.1%
Sad 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 80.2%
Calm 62.5%
Happy 29.5%
Surprised 3.6%
Sad 1.2%
Disgusted 1.2%
Fear 0.8%
Confused 0.7%
Angry 0.6%

AWS Rekognition

Age 31-41
Gender Female, 88.4%
Calm 52.7%
Fear 33.1%
Happy 7.6%
Sad 1.6%
Disgusted 1.6%
Angry 1.3%
Surprised 1.2%
Confused 0.8%

AWS Rekognition

Age 34-42
Gender Male, 97.8%
Happy 64.8%
Calm 22.2%
Sad 5.3%
Fear 3.9%
Surprised 1.2%
Angry 1.1%
Confused 0.9%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Bench
Person 99.6%
Person 99.4%
Person 98%
Person 97.3%
Person 93.6%
Person 81.8%
Person 76.4%
Person 61%
Bench 60.7%
Bench 56.8%

Categories

Imagga

paintings art 84.2%
text visuals 14.4%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and woman standing in front of a cemetery -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a man and woman standing in front of a row of houses, with palm trees visible in the background. The couple is positioned in the center of the image, with the man on the right and the woman on the left. They are both facing the camera and appear to be smiling.

The man is wearing a dark-colored shirt, light-colored pants, and shoes. He has short hair and is wearing a watch on his left wrist. The woman is wearing a striped shirt, dark pants, and shoes. She has short hair and is wearing a bracelet on her right wrist.

In the background, there are several houses with palm trees in front of them. The houses appear to be single-story and have a similar design. There are also several chairs scattered throughout the area, some of which have the words "ALOHA KAI" written on them.

Overall, the image appears to be a casual, outdoor scene, possibly taken during a vacation or leisure activity. The presence of palm trees and the relaxed atmosphere suggest a warm and sunny location, possibly in Hawaii or another tropical region.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of an older couple standing in front of a row of Adirondack chairs, with a house and palm trees visible in the background. The couple is positioned centrally in the image, with the woman on the left and the man on the right. They are both dressed in casual attire, with the woman wearing a striped shirt and dark pants, while the man sports a dark shirt and light-colored pants.

Behind them, a row of Adirondack chairs is arranged, each bearing the inscription "ALOHA KAI" on the backrest. In the background, a house with a porch and several palm trees can be seen, creating a serene and peaceful atmosphere. The overall mood of the image suggests a relaxed and leisurely setting, possibly a vacation or retirement home.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A black-and-white photo of two people standing in front of a chair with the word "ALOHA KAI" written on it. They are both smiling and seem to be posing for a photo. Behind them are several people sitting on chairs and standing, and there are trees and houses in the distance. The photo has a watermark on the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white image features a couple standing close to each other, possibly posing for a photograph. The man is wearing a belt and a watch, while the woman is wearing a long-sleeve shirt. Behind them, there are several people sitting on chairs, and some are standing. In the distance, there are trees and houses. The chairs have the text "ALOHA KAI" on them.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression:

The image is a black and white, negative-style photograph, giving it a vintage feel. It appears to be taken outdoors, likely in a tropical or coastal location.

Composition:

  • The image has two main figures that are posed facing the camera.
  • There are multiple adirondack chairs that say "Aloha Kai" that are in a line in the foreground.
  • There is a variety of people scattered in the background sitting in chairs and in the distance there are what appear to be houses and trees.

People:

  • There are two people in the foreground, a man and a woman, presumably the subjects of the photograph.
  • The man is wearing a button-down shirt and pants.
  • The woman is wearing a striped shirt and pants.
  • In the background there are multiple figures as well.

Setting:

  • The location seems to be a beach or lawn with houses or buildings behind.
  • Palm trees are visible, reinforcing the tropical/coastal setting.

Additional Details:

  • The negative effect makes the image somewhat difficult to fully decipher, but the elements and composition are still apparent.

Created by gemini-2.0-flash on 2025-05-17

The image appears to be a photographic negative of a daytime outdoor scene.

In the foreground, a couple stands posing for the photo. The person on the left is wearing a striped shirt and dark pants, while the person on the right is wearing a collared shirt and light-colored pants.

Behind them, there are several people seated in chairs, possibly relaxing or socializing. The chairs appear to be Adirondack-style and have the words "ALOHA KAI" printed on them.

In the background, there are buildings, possibly houses or vacation rentals, as well as palm trees. The overall setting seems to be a resort or a tropical vacation spot.

It should be noted that because this is a negative image, the colors are inverted.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black and white photograph featuring two people standing in the foreground. They appear to be a man and a woman, both smiling and posing for the camera. The man is wearing a short-sleeved shirt and light-colored pants, while the woman is wearing a striped blouse and dark pants.

In the background, there is a beach or outdoor setting with several people sitting on Adirondack chairs. The chairs have the words "ALOHA KAI" printed on them. The scene includes palm trees and some structures, possibly beach houses or cabins, suggesting a tropical or coastal location. The overall atmosphere seems relaxed and casual, indicative of a vacation or leisurely outing.

Text analysis

Amazon

KAI
ALOHA KAI
ALOHA
ALOHA K.J.
K.J.

Google

ALOHA KAI ALDHA KAI
ALOHA
KAI
ALDHA