Human Generated Data

Title

Untitled (family reunion portrait in front of trees and house, patriarch seated center)

Date

1948, printed later

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6761

Human Generated Data

Title

Untitled (family reunion portrait in front of trees and house, patriarch seated center)

People

Artist: Harry Annas, American 1897 - 1980

Date

1948, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6761

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Indoors 100
Interior Design 100
Human 99
Display 98.6
Screen 98.6
Electronics 98.6
Room 94.5
Theater 89.6
Face 72
Cinema 71.1
Clothing 58.5
Apparel 58.5
Military 55.5

Clarifai
created on 2019-11-16

people 99.4
man 95.4
adult 93.1
silhouette 90.6
group 89.5
movie 89
woman 88.4
wear 86.8
many 84.9
monochrome 84.4
museum 84.3
picture frame 82.9
television 82.9
street 81.7
cavalry 81.1
family 78.9
child 78.1
winter 76.9
exhibition 76.1
shadow 75.8

Imagga
created on 2019-11-16

screen 42.6
window screen 36.1
billboard 33.6
television 31.9
structure 27
signboard 26.6
grunge 24.7
monitor 24.6
old 23
frame 22.5
protective covering 22.2
vintage 21.5
snow 21.4
landscape 20.1
border 19
texture 18.8
black 18.6
art 18.2
antique 17.3
tree 16.9
sky 16.6
design 16.3
film 16.2
winter 16.2
broadcasting 15.9
pattern 15.7
covering 15.7
paint 15.4
graphic 15.3
damaged 15.3
forest 14.8
retro 14.7
window 14.6
rough 14.6
dirty 14.5
grungy 14.2
text 14
space 14
cold 13.8
trees 13.3
negative 13.2
digital 13
designed 12.8
weather 12.6
your 12.6
rust 12.5
material 12.5
season 12.5
weathered 12.3
equipment 12.3
electronic equipment 12.2
scene 12.1
computer 12.1
telecommunication 12.1
empty 12
frames 11.7
noise 11.7
messy 11.6
collage 11.6
frost 11.5
dirt 11.5
travel 11.3
windowsill 11.1
blank 11.1
dark 10.9
noisy 10.8
layered 10.8
mess 10.8
silhouette 10.8
movie 10.7
layer 10.6
edge 10.6
mask 10.6
building 10.2
light 10
park 9.9
highly 9.9
scratches 9.8
photographic 9.8
slide 9.8
scratch 9.8
detailed 9.6
decoration 9.6
frozen 9.5
telecommunication system 9.4
wall 9.4
ice 9.2
outdoor 9.2
aged 9
road 9
sill 8.9
color 8.9
projects 8.9
overlay 8.9
strip 8.7
fog 8.7
ancient 8.6
paper 8.6
holiday 8.6
framework 8.2
scenic 7.9
freeze 7.8
wallpaper 7.7
poster 7.6
wood 7.5
office 7.4
medium 7.4
grain 7.4
entertainment 7.4
nice 7.3
business 7.3
cool 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

text 99.5
monitor 98.9
person 96.2
tree 93.5
screen 87.8
indoor 85.9
house 78.5
electronics 76.8
gallery 73
clothing 65.4
display 57.3
room 56.2
man 53.2
watching 41.4
image 39.4
picture frame 38.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-37
Gender Female, 50.1%
Angry 49.7%
Happy 49.5%
Disgusted 49.5%
Sad 50%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Fear 49.6%

AWS Rekognition

Age 32-48
Gender Female, 50.4%
Disgusted 49.6%
Fear 49.5%
Confused 49.5%
Calm 49.9%
Surprised 49.5%
Angry 49.8%
Sad 49.6%
Happy 49.5%

AWS Rekognition

Age 21-33
Gender Male, 50.3%
Disgusted 49.5%
Happy 50.1%
Angry 49.6%
Fear 49.5%
Sad 49.6%
Surprised 49.5%
Confused 49.6%
Calm 49.6%

AWS Rekognition

Age 28-44
Gender Male, 50.4%
Fear 49.5%
Happy 49.5%
Calm 49.8%
Surprised 49.5%
Disgusted 49.5%
Angry 49.5%
Sad 49.7%
Confused 49.8%

AWS Rekognition

Age 34-50
Gender Male, 50.5%
Fear 49.5%
Calm 50%
Disgusted 49.5%
Happy 49.6%
Sad 49.8%
Confused 49.5%
Surprised 49.5%
Angry 49.5%

AWS Rekognition

Age 34-50
Gender Female, 50.2%
Happy 49.8%
Confused 49.5%
Calm 49.9%
Angry 49.6%
Disgusted 49.5%
Surprised 49.5%
Fear 49.5%
Sad 49.6%

AWS Rekognition

Age 48-66
Gender Female, 50.4%
Fear 49.5%
Calm 49.7%
Angry 49.9%
Happy 49.6%
Confused 49.5%
Disgusted 49.5%
Sad 49.7%
Surprised 49.5%

AWS Rekognition

Age 49-67
Gender Female, 50.3%
Fear 49.6%
Sad 49.5%
Angry 49.5%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 50.2%
Surprised 49.6%

AWS Rekognition

Age 37-55
Gender Male, 50.3%
Angry 50.4%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Sad 49.5%
Fear 49.5%

AWS Rekognition

Age 18-30
Gender Female, 50.3%
Angry 50.1%
Happy 49.5%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Fear 49.6%
Sad 49.8%
Surprised 49.5%

AWS Rekognition

Age 21-33
Gender Male, 50%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Calm 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.5%
Surprised 49.5%

AWS Rekognition

Age 26-40
Gender Female, 50%
Angry 50.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 49.5%
Happy 49.5%
Calm 49.5%
Fear 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.4%
Disgusted 49.5%
Fear 49.8%
Confused 49.6%
Angry 49.5%
Calm 49.5%
Surprised 49.7%
Sad 49.6%
Happy 49.7%

AWS Rekognition

Age 40-58
Gender Male, 50.3%
Angry 49.5%
Surprised 49.5%
Sad 49.8%
Fear 49.9%
Calm 49.6%
Happy 49.6%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 31-47
Gender Male, 50.4%
Confused 49.6%
Happy 49.6%
Disgusted 49.5%
Calm 50.1%
Angry 49.5%
Sad 49.6%
Surprised 49.5%
Fear 49.6%

AWS Rekognition

Age 26-42
Gender Female, 50.2%
Angry 49.6%
Sad 49.7%
Calm 49.6%
Disgusted 49.5%
Confused 49.5%
Surprised 49.6%
Fear 49.6%
Happy 49.8%

AWS Rekognition

Age 22-34
Gender Female, 50.4%
Disgusted 49.7%
Happy 49.6%
Surprised 49.5%
Sad 49.6%
Fear 49.5%
Calm 50%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Surprised 49.5%
Sad 49.5%
Disgusted 49.5%
Calm 50.2%
Fear 49.5%
Angry 49.7%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.3%
Sad 49.8%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.6%
Fear 49.6%
Confused 49.7%
Calm 49.8%

AWS Rekognition

Age 36-54
Gender Female, 50.4%
Happy 49.5%
Angry 49.5%
Disgusted 49.6%
Surprised 49.5%
Calm 49.5%
Sad 49.7%
Fear 49.6%
Confused 50%

AWS Rekognition

Age 30-46
Gender Male, 50.4%
Happy 49.6%
Angry 49.6%
Disgusted 49.5%
Sad 49.6%
Surprised 49.5%
Calm 49.5%
Fear 49.9%
Confused 49.6%

AWS Rekognition

Age 39-57
Gender Male, 50.5%
Disgusted 49.5%
Angry 49.6%
Fear 49.6%
Happy 49.8%
Confused 49.5%
Sad 49.7%
Calm 49.6%
Surprised 49.6%

Feature analysis

Amazon

Person
Monitor

Clarifai

Tree
Picture frame
Person
Window

AWS Rekognition

Person 99%

AWS Rekognition

Person 97.2%

AWS Rekognition

Person 96.6%

AWS Rekognition

Person 90.6%

AWS Rekognition

Person 89.6%

AWS Rekognition

Person 88.7%

AWS Rekognition

Person 68.2%

AWS Rekognition

Person 60.3%

AWS Rekognition

Monitor 98.6%

Clarifai

Tree 87%

Clarifai

Tree 81.4%

Clarifai

Tree 74%

Clarifai

Tree 65.8%

Clarifai

Tree 41.8%

Clarifai

Picture frame 66.9%

Clarifai

Person 63.3%

Clarifai

Person 44.5%

Clarifai

Person 44.2%

Clarifai

Person 37.7%

Clarifai

Person 35.6%

Clarifai

Person 35.2%

Clarifai

Person 34.7%

Clarifai

Person 34.1%

Clarifai

Window 33.3%

Categories

Imagga
created on 2019-11-16

paintings art 75.9%
interior objects 14.5%
streetview architecture 7.3%
text visuals 1.4%

Captions

Microsoft
created by unknown on 2019-11-16

a flat screen television 60%
a flat screen tv sitting in front of a television 40.6%
a flat screen tv 40.5%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people standing around a group of people

Created by general-english-image-caption-blip-2 on 2025-07-10

a group of people standing in front of a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image depicts a black-and-white photograph of a large group of people posed together in front of a house with a distinctive, two-story architectural style. The group consists of men, women, and children standing and sitting in the foreground on a grassy area surrounded by leafless trees. The house in the background has a gabled roof and appears to be an older, traditional structure with a porch and ornate woodwork details. The individuals in the group are dressed in various styles typical of early to mid-20th century attire. The photograph is framed within a wider black border.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image is a black and white photograph of a large group of people posing in front of a house. The group consists of men, women, and children, suggesting a family gathering or community event. The house in the background appears to be two stories, with a porch and some trees partially obscuring it. The people are standing closely together on a grassy area, and the setting has the appearance of a residential neighborhood. The photograph is bordered by a dark space, likely indicating the image was scanned from a film negative or slide.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image appears to be a black and white photograph of a large group of people gathered outside a building. The building has a distinctive architectural style with a peaked roof and appears to be an older, historic structure. The people in the image are standing or sitting together, suggesting this may be some kind of group or community gathering. The trees in the background are bare, indicating this was likely taken during the colder months of the year. Overall, the image conveys a sense of community and a snapshot of life from a bygone era.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-17

The black and white photograph depicts a large group of people, likely an extended family, posing together outside in front of a house or building. There are people of various ages, from young children to elderly adults. The group is dressed nicely, with the men wearing suits and the women in dresses, suggesting it may be a special occasion or family gathering. Trees without leaves are visible behind the group, indicating it is likely winter or early spring when the photo was taken. The image has an old-fashioned, vintage feel based on the clothing styles and black and white format.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white historical photograph showing a large group of people gathered in front of what appears to be a wooden house or church building. The structure has a Victorian-style architecture with decorative trim and a porch. There are bare trees visible on either side of the building. The group appears to include both adults and children arranged in rows for a formal group photo. The photograph has a dark border around it, suggesting it may be mounted in an album or display. The image has the characteristic look of being taken sometime in the early-to-mid 20th century based on the clothing styles visible and the photographic quality.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a large group of people, likely a family, posing in front of a house. The group consists of approximately 40 individuals, including children and adults, all dressed in casual attire. They are standing on a grassy lawn, with trees visible behind them.

In the background, a two-story house with a gable roof and a covered porch is visible. The house appears to be made of wood and has a classic, old-fashioned design. The overall atmosphere of the image suggests a warm and welcoming gathering, possibly a family reunion or celebration.

The photograph is presented on a black background, with a white border around the edges. The image itself is rectangular, with a slight curve at the top and bottom. The overall effect is one of nostalgia and warmth, inviting the viewer to step into the scene and experience the joy and connection of the people in the photograph.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a large group of people standing in front of a house. The group consists of approximately 40 individuals, including children and adults, all dressed in formal attire. They are arranged in several rows, with the children in the front and the adults behind them.

In the background, there is a large house with a porch and a tree on either side. The sky above is overexposed, making it difficult to discern any details. The overall atmosphere of the image suggests that it was taken during a special occasion or event, possibly a family gathering or celebration.

The photograph appears to be an old one, likely taken in the early 20th century. The style of clothing and the architecture of the house suggest a rural or small-town setting. The image has been printed on a piece of paper or cardboard, which has been folded and creased at the top. There are also some small marks and scratches on the surface of the image, indicating that it has been handled and stored over time.

Overall, the image provides a glimpse into the past, capturing a moment in time when people came together to celebrate and commemorate a special occasion. It is a valuable historical artifact that can provide insight into the lives and traditions of people from a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image shows a black-and-white photograph of a group of people standing in front of a house. The house is surrounded by trees, and the people are standing in a line. The photograph is framed with a black border and has a white border on the bottom. The people in the photograph are wearing old-fashioned clothing, and some of them are wearing hats. The photograph is slightly blurry, and it appears to be an old photograph.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of people standing in front of a house. The house has a porch with a railing, and there are two trees on either side of the house. The people are standing in two rows, with some sitting on the ground. They are all looking in the same direction, possibly at the camera. The image has a vintage feel to it.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-11

Here is a description of the image:

The image is a black and white photograph of a large group of people posing in front of a large house. The house has a gable roof and appears to be two stories tall, with a porch and several windows. Bare trees flank the house on either side, and the group of people are standing on the grass in front of the house. The people are a mix of adults and children, and they are all dressed in clothing that suggests the photo was taken in the early to mid 20th century. There's a man sitting in a chair in the center of the group. The photograph is mounted on a black background.

Created by gemini-2.0-flash on 2025-05-11

The image shows a black and white group portrait of a large family or community gathered outside a two-story house. The house has a prominent front porch with rounded archways, visible windows, and a gable roof. Two bare-branched trees flank the house, one on either side, partially obscuring the view of the house.

The group of people, including adults and children of varying ages, are gathered in front of the house on a grassy lawn. They are dressed in clothing that appears to be from the mid-20th century. A man in a hat sits in a chair slightly forward of the rest of the group, likely the patriarch.

The image itself appears to be a print or negative placed in a black mount with registration marks along the edges. This suggests that it might be a scanned or photographed film negative or print, rather than the original scene.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-08

The image depicts a group of people standing in front of a building, likely a school or a community center, given the context of the group's composition and the structure's appearance. The group consists of both adults and children, suggesting a mixed-age gathering, possibly for a school event, community meeting, or a family reunion.

The building in the background is a two-story structure with a gabled roof and a porch. It has a rustic, possibly historical look, with wooden siding and multiple windows. There are bare trees around the building, indicating that the photo might have been taken in late autumn or winter.

The people in the photo are dressed in what appears to be early to mid-20th-century attire. The women are wearing dresses, and the men are in suits or formal wear. The children are also dressed formally, with the girls in dresses and the boys in suits or nice clothing.

The photograph itself is framed within a black border, and it appears to be a print from a negative, given the sprocket holes visible along the bottom edge. This suggests that the image might be from a film roll, common in older photography. The overall tone of the image is sepia or black and white, adding to its vintage feel.

Qwen

No captions written