Human Generated Data

Title

Untitled (three people and two dogs standing outside run down house)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3379

Human Generated Data

Title

Untitled (three people and two dogs standing outside run down house)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3379

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Shelter 100
Nature 100
Outdoors 100
Building 100
Countryside 100
Rural 100
Human 99.5
Yard 99.4
Housing 96.2
Grass 96.2
Plant 96.2
Clothing 95.1
Apparel 95.1
Vegetation 94.6
Face 91.9
Female 86.3
Tree 84.5
House 82.9
Dress 79.7
Chair 78
Furniture 78
Villa 77.6
Land 75
Backyard 74.5
Urban 73.9
Porch 72.7
Mammal 72.7
Canine 72.7
Animal 72.7
Pet 72.7
Door 72
Girl 69
Pants 68.1
Shorts 68
Portrait 67.5
Photography 67.5
Photo 67.5
Potted Plant 65.5
Pottery 65.5
Jar 65.5
Vase 65.5
Woman 64.1
Standing 64.1
Kid 61.8
Child 61.8
Hut 57.8
Patio 57.5
Swimming Pool 56.2
Water 56.2
Pool 56.2

Clarifai
created on 2023-10-26

people 99.9
adult 98.9
man 98.3
home 97.8
group 97.1
street 95.3
group together 94.9
monochrome 94.8
two 94.5
furniture 93.2
child 92.4
chair 91.9
one 90.1
print 89.6
three 89.3
art 88.8
house 87.2
four 85.6
black and white 84.7
seat 84.4

Imagga
created on 2022-01-22

shopping cart 100
handcart 100
wheeled vehicle 99.7
container 61.4
conveyance 34.2
sky 16.6
summer 15.4
chair 14.8
tree 14.6
house 13.4
old 13.2
outdoors 12.7
trees 12.4
water 12
outdoor 11.5
holiday 11.5
furniture 11.3
sun 11.3
empty 11.2
landscape 10.4
wood 10
city 10
building 9.6
seat 9.5
grass 9.5
rocking chair 9.4
dark 9.2
travel 9.1
park 9.1
forest 8.7
light 8.7
evening 8.4
shopping 8.3
home 8
rural 7.9
wooden 7.9
country 7.9
structure 7.9
sea 7.8
fence 7.7
winter 7.7
leisure 7.5
exterior 7.4
night 7.1
architecture 7

Google
created on 2022-01-22

Building 93.5
Plant 91.1
Black 89.7
Door 89.4
Black-and-white 84.6
Chair 83.5
House 79.6
Adaptation 79.2
Tree 78.2
Tints and shades 77.1
Monochrome 77
Monochrome photography 76
Cottage 72.8
Facade 71.7
Room 70
Porch 69.5
Art 68
Vintage clothing 67.4
History 64.5
Font 63.6

Microsoft
created on 2022-01-22

dog 97.5
building 93.3
outdoor 92
black and white 91
text 82.5
carnivore 78.7
animal 58

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 99.5%
Surprised 0.1%
Happy 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Female, 71.2%
Calm 59.2%
Sad 22.8%
Confused 9.9%
Fear 2.3%
Happy 2%
Disgusted 1.5%
Angry 1.3%
Surprised 1.1%

AWS Rekognition

Age 23-31
Gender Male, 96.9%
Calm 89.5%
Happy 9.3%
Sad 0.6%
Surprised 0.3%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Dog

Clarifai

House
Tree
Clothing
Dog
Person
Window
Human face

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.8%

AWS Rekognition

Dog 72.7%

AWS Rekognition

Dog 64.1%

Clarifai

House 90.7%

Clarifai

Tree 81.7%

Clarifai

Tree 77.9%

Clarifai

Tree 65.4%

Clarifai

Tree 62%

Clarifai

Tree 61.8%

Clarifai

Tree 53.4%

Clarifai

Tree 47.8%

Clarifai

Clothing 65.7%

Clarifai

Dog 50.8%

Clarifai

Person 49.9%

Clarifai

Person 48.5%

Clarifai

Person 33.7%

Clarifai

Window 45.1%

Clarifai

Window 41.1%

Clarifai

Window 40%

Clarifai

Human face 36.7%

Clarifai

Human face 33.9%

Categories

Imagga
created on 2022-01-22

streetview architecture 96.8%
paintings art 2.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a house in the neighborhood.

Salesforce

Created by general-english-image-caption-blip on 2025-05-23

a photograph of a man and a woman standing in front of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This image appears to be a negative photograph depicting a small cabin-like structure with a porch. There are two individuals standing on the porch, with one wearing overalls and the other in a patterned dress. The building features icicle-style vertical decorations along the eaves of the roof and a picket-style fence lining the porch area. Two dogs, positioned in the foreground, are sitting on the ground near the house. Trees without leaves can be seen in the background, as well as some outdoor objects like a satellite dish and containers near the house. The overall setting suggests a rural or rustic environment.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a black and white negative depicting a small wooden house or cabin with a porch. The house has a pitched roof and a simple picket fence in front. There are three people standing on the porch, and their clothing suggests a rural or work setting, with one of them in overalls. In the foreground, there are two dogs sitting on the ground. The background includes some leafless trees and what appears to be a satellite dish to the left. There is a wire fence in the immediate foreground. The overall scene gives a sense of a rural, homestead-like environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-22

The image shows a small wooden cabin or shack in a rural, wooded area. Three people, two men and one woman, are standing on the porch of the cabin. They appear to be wearing casual clothing from an earlier era. There are also two dogs sitting in front of the cabin. The scene has a vintage, black and white photographic quality, suggesting this is an older photograph. The overall impression is of a simple, rustic dwelling in a remote, natural setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-22

This is a black and white photograph showing three people standing on the porch of what appears to be a small house or cabin. The porch has decorative icicle-style trim along the roof edge and a picket fence railing. Two of the people are wearing overalls, while the person in the middle is wearing what looks like a dress. In front of them on the ground are two dogs sitting together. The house has a simple design with windows visible behind the group. The scene appears to be from an earlier era, possibly mid-20th century, given the photographic style and clothing. The surrounding area shows bare trees, suggesting it was taken during winter or late fall.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image depicts a black-and-white photograph of a family standing in front of their home, accompanied by two dogs. The family consists of a man, a woman, and a young boy, all dressed in casual attire. The man is wearing overalls and a dark shirt, while the woman is wearing a dress and a necklace. The boy is wearing overalls and a dark shirt, similar to his father.

The house behind them features a porch with a picket fence, a satellite dish on the left side, and a large window on the front. A ladder is visible on the right side of the house, leaning against the wall. In the foreground, two dogs are sitting on the ground, one in front of the other.

The background of the image shows a dark sky, with bare trees visible behind the house. The overall atmosphere of the image suggests a rural or suburban setting, with the family posing for a photo in front of their home.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image depicts a black-and-white photograph of a family standing in front of their home, with two dogs sitting in front of them. The family consists of three individuals, likely a man, woman, and child, all wearing casual clothing. The man is dressed in a dark shirt and pants, while the woman wears a dress and apron. The child, positioned between the adults, is attired in overalls.

In the foreground, two dogs are seated on the ground, facing the camera. The house behind the family features a porch with a picket fence and a window on the left side. A satellite dish is visible on the left side of the image, and trees are present in the background.

The overall atmosphere of the image suggests a sense of warmth and closeness among the family members, as they stand together in front of their home. The presence of the dogs adds to the cozy and intimate feel of the scene.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image shows a black-and-white photograph of three people standing on the porch of a house. The house is surrounded by a fence, and there is a dog sitting on the ground in front of them. The image has a vintage look, with a grainy texture and a slightly blurry effect. The people in the image are wearing old-fashioned clothing, with the man in the middle wearing a hat and the woman on the right wearing a dress.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A black-and-white photo of three people and two dogs standing in front of a house at night. The house has a porch with a wooden fence and a lamp hanging from the ceiling. The three people are standing close to each other, with the man on the left, the woman in the middle, and the man on the right. The two dogs are standing in front of them.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here is a description of the image:

The image is a black and white negative photograph of a family posing in front of their home. The house is a simple, one-story structure with a porch. Three adults are standing on the porch, and two dogs are sitting on the ground in front of them. The man on the left is wearing a collared shirt and pants. The woman in the middle is wearing a patterned dress. The man on the right is wearing overalls. The porch has a picket fence. The background includes trees and a dark sky. The image has a vintage feel, as though it may be an older photograph. The photo is framed by a white border.

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

This is an image of a family standing on the porch of their house. The image is a black and white negative. In the foreground are two dogs. Behind them are three people, a woman wearing a dress and two men, one wearing overalls and the other wearing a button down shirt and pants. They are standing on the porch of a small house with a picket fence. There are bare trees around the house. There is a large water tank to the left of the house. There are power lines that go across the sky above the house.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a black-and-white photograph depicting three people and two dogs standing in front of a small house. The house has a gabled roof with decorative trim along the eaves. The house's exterior appears to be made of wood and has a porch with a low fence.

The people in the photo are dressed in what appears to be clothing from an earlier era, possibly the early to mid-20th century. The person in the center is a woman wearing a dress and a necklace, and she is flanked by two men. The man on the left is wearing a dark jacket and pants, while the man on the right is dressed in lighter-colored overalls.

In front of the group, two dogs are sitting on the ground. The area around the house appears to be rural, with bare trees and a clear sky visible in the background. There is also a large barrel-like object to the left of the house, and some other items scattered around the yard. The photograph has a vintage quality, with some visible scratches and wear, suggesting it is quite old.

Qwen

No captions written

Text analysis

Amazon

PERINEN