Human Generated Data

Title

Students in front of Gore Hall

Date

1861-1866

People

Artist: George Kendall Warren, American 1824 - 1884

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of David B. Walters, P2003.169

Human Generated Data

Title

Students in front of Gore Hall

People

Artist: George Kendall Warren, American 1824 - 1884

Date

1861-1866

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of David B. Walters, P2003.169

Machine Generated Data

Tags

Amazon
created on 2022-05-27

Person 99.3
Human 99.3
Person 98.9
Person 98.1
Person 98.1
Person 97.9
Person 97.3
Person 97.3
Person 96.1
Person 95.6
Person 95.5
Person 90.9
Person 90.9
Person 86.1
Funeral 82.4
People 81.6
Person 79.2
Art 77.8
Face 77
Brass Section 60.2
Musical Instrument 60.2
Horn 56.4
Photography 55.8
Photo 55.8
Drawing 55.7
Person 48.5
Person 43.7

Clarifai
created on 2023-10-30

people 99.7
man 98.4
adult 98.3
portrait 97.2
woman 96.7
travel 94.7
art 94.3
child 93.9
group 93.9
no person 92.7
two 92.7
girl 91.6
sepia 90.2
one 89.7
beach 89.1
sky 87.5
ball-shaped 87.2
nature 87.1
old 87
wear 86.7

Imagga
created on 2022-05-27

light bulb 24.7
cup 24.2
currency 22.4
container 21.7
money 21.3
coin 21
close 20
electric lamp 19.8
food 17.8
brown 16.2
closeup 16.2
finance 16.1
hat 14.8
lamp 14.7
lampshade 14.1
financial 13.4
tableware 13.3
banking 12.9
shade 12.8
cash 12.8
sombrero 12.7
bank 12.5
object 11.7
ingot 11.3
headdress 10.7
healthy 10.7
coins 10.6
metal 10.5
one 10.5
ball 10.4
source of illumination 10.1
wealth 9.9
business 9.7
black 9.6
natural 9.4
dollar 9.3
covering 9.3
stone 9.3
eat 9.2
tasty 9.2
vintage 9.1
breakfast 8.8
protective covering 8.7
block 8.7
shiny 8.7
rock 8.7
ware 8.6
round 8.6
exchange 8.6
toiletry 8.6
old 8.4
economy 8.3
delicious 8.3
gray 8.1
silver 8
pebble 7.8
texture 7.6
clothing 7.5
investment 7.3
face powder 7.2
spa 7.2
sweet 7.1

Google
created on 2022-05-27

Art 85
Font 81.2
Oval 80.8
Tints and shades 77.2
Circle 75.9
Wood 68.1
Visual arts 67.5
Monochrome 66.8
Illustration 62.2
Graphics 61.9
History 61.8
Metal 60
Sphere 59.9
Painting 56.7
Pattern 56
Symmetry 53.4

Microsoft
created on 2022-05-27

person 97
text 95.3
clothing 88.9
man 69.5
old 59.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Disgusted 40.3%
Fear 21.9%
Calm 14.2%
Surprised 12.1%
Happy 7.2%
Sad 3.9%
Angry 2.6%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.1%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Confused 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Disgusted 37.2%
Angry 18.9%
Surprised 14.1%
Calm 11.6%
Sad 9.7%
Fear 7.2%
Confused 4.7%
Happy 2.8%

AWS Rekognition

Age 29-39
Gender Male, 100%
Disgusted 38.8%
Confused 20.1%
Calm 18.7%
Angry 9.9%
Surprised 9.4%
Fear 6.3%
Sad 4.2%
Happy 1.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Sad 75.5%
Calm 50%
Angry 7.2%
Surprised 7.1%
Fear 6.3%
Confused 3%
Disgusted 1.4%
Happy 1.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 80.1%
Angry 10.1%
Surprised 6.7%
Fear 6.2%
Sad 4.5%
Confused 1.5%
Disgusted 0.7%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 96%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Disgusted 1.2%
Angry 0.7%
Confused 0.5%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 97.1%
Surprised 6.3%
Fear 5.9%
Disgusted 2.3%
Sad 2.2%
Confused 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 27-37
Gender Male, 98.1%
Angry 70.5%
Calm 21.4%
Surprised 7%
Fear 6%
Confused 3.5%
Sad 2.5%
Disgusted 1.3%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Female, 91%
Sad 100%
Fear 6.9%
Surprised 6.4%
Calm 6.4%
Confused 1.4%
Disgusted 0.7%
Angry 0.7%
Happy 0.2%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 81%
Sad 10.6%
Surprised 6.5%
Fear 6.1%
Confused 2.4%
Disgusted 2.2%
Angry 1.1%
Happy 0.5%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 67.8%
Sad 22.7%
Surprised 8.1%
Fear 6.7%
Confused 6.7%
Happy 1.1%
Disgusted 0.7%
Angry 0.2%

AWS Rekognition

Age 13-21
Gender Male, 76.7%
Calm 70%
Confused 14.3%
Angry 7.5%
Surprised 6.6%
Fear 6%
Sad 3.5%
Disgusted 2.1%
Happy 1.5%

AWS Rekognition

Age 24-34
Gender Male, 85%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Disgusted 76.7%
Sad 13.3%
Surprised 6.9%
Fear 6.2%
Angry 4%
Calm 1.4%
Confused 1.1%
Happy 1%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Angry 44.9%
Confused 24.4%
Sad 24.1%
Surprised 8.1%
Fear 6.4%
Calm 4.1%
Disgusted 2.4%
Happy 1%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 93.3%
Surprised 6.3%
Fear 6%
Sad 3%
Confused 2.2%
Angry 1%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Male, 100%
Sad 99.4%
Calm 28.4%
Surprised 6.6%
Fear 6.2%
Disgusted 5.3%
Angry 1.1%
Happy 0.6%
Confused 0.6%

AWS Rekognition

Age 23-33
Gender Female, 56.4%
Calm 76.8%
Sad 12.9%
Surprised 6.6%
Fear 6.3%
Angry 2.9%
Disgusted 2.3%
Confused 1.8%
Happy 1%

AWS Rekognition

Age 23-33
Gender Male, 97%
Sad 46.7%
Calm 37.9%
Angry 17.7%
Surprised 10.5%
Fear 7.3%
Disgusted 3.9%
Confused 2.6%
Happy 2.2%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.3%
Confused 0.1%
Happy 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Person 99.3%
Person 98.9%
Person 98.1%
Person 98.1%
Person 97.9%
Person 97.3%
Person 97.3%
Person 96.1%
Person 95.6%
Person 95.5%
Person 90.9%
Person 90.9%
Person 86.1%
Person 79.2%
Person 48.5%
Person 43.7%

Categories

Imagga

paintings art 97.8%
food drinks 2.2%

Captions

Microsoft
created by unknown on 2022-05-27

an old photo of a cake 40.8%

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a group of men in suits and ties posing for a photo -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This is a vintage sepia-toned photograph of a group of men gathered on the steps in front of a large, sturdy, arched wooden door set into a stone building. The image has an oval vignette framing effect, focusing attention on the group. The men are dressed formally in 19th-century attire, including suits, ties, and waistcoats. Most are sitting while a few are standing, and some hold hats or walking sticks, indicating a social or academic setting. Their demeanor appears calm and composed, suggesting a posed group photograph, potentially marking an event or organization.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a vintage photograph featuring a group of young men, presumably students, posing in front of a large, heavy wooden door set in a stone building. The photo has an oval-shaped vignette effect, typical of 19th-century photography styles. The men are dressed in formal attire, including suits and ties, typical of the late 19th or early 20th century. Some are seated on the steps or ground, while others are standing. Most of the men have short hair and are clean-shaven or have mustaches, which was the style of the time. They are posing casually but with a sense of formality, suggesting this may be a class photo or a group from a distinguished organization or club. The overall sepia tone of the image gives it an aged appearance.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-11

The image appears to be a historical photograph of a group of men gathered in front of a large wooden door or entryway. The men are dressed in formal attire, such as suits and ties, suggesting this is likely a formal or official occasion. The image has an oval shape, which was a common photographic style during that time period. The background appears to be a stone or brick wall, adding to the sense of an institutional or formal setting. Overall, the image conveys a sense of a group portrait of men from a particular time and place, though I cannot identify any specific individuals in the photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-11

This is a historical sepia-toned photograph, likely from the late 1800s, showing a group of young men posed in front of what appears to be a large stone building with an arched wooden door. The men are dressed formally in the style of the Victorian era, wearing suits, bow ties, and some are wearing hats. They are arranged in multiple rows, with some seated on steps and others standing behind them. The photograph has an oval border, which was a common photographic format during that period. The image quality and style suggests this might be a collegiate or fraternal organization group photo, which was common during that era. The stone architecture visible in the background appears to be of an institutional or academic building.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-08

The image is a sepia-toned photograph of a group of men in suits and bow ties, posing for a picture in front of a large wooden door.

  • The group consists of approximately 20 men, all dressed in formal attire, with some sitting on steps and others standing behind them.
    • The men are wearing dark-colored suits, white shirts, and bow ties, with some holding canes or hats.
    • They appear to be posing for a formal portrait, with some looking directly at the camera and others gazing off to the side.
  • The background of the image features a large wooden door with a stone archway above it.
    • The door is made of dark wood and has a large metal knocker in the shape of a lion's head.
    • The stone archway is decorated with carvings and has a small window above it.
  • The overall atmosphere of the image suggests that it was taken in the late 19th or early 20th century, possibly at a university or other educational institution.
    • The formal attire and pose of the men suggest that they were members of a prestigious organization or club.
    • The image may have been taken as a commemorative photograph, perhaps to mark a special occasion or event.

In summary, the image is a formal portrait of a group of men in suits and bow ties, posing in front of a large wooden door with a stone archway. The men appear to be members of a prestigious organization or club, and the image may have been taken as a commemorative photograph.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-08

This image is a sepia-toned photograph of a group of men posing on the steps of a building. The men are dressed in formal attire, with most wearing suits and ties. They are seated or standing in front of a large wooden door with metal studs, which appears to be the entrance to the building. The background of the image features a stone wall, suggesting that the building may be historic or of architectural significance.

The photograph has a circular shape, with a white border around it. The overall atmosphere of the image suggests a sense of formality and importance, possibly indicating that the men are gathered for a special occasion or event.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A black-and-white photograph shows a group of men sitting on a stone bench in front of a stone building with a wooden door. They are all dressed in formal attire, including suits, ties, and hats. The men are sitting in a row, with some of them looking directly at the camera while others are looking to the side. The photograph has a circular shape, with the men in the center and the building and door in the background.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is an old black-and-white photograph of a group of men, possibly a team or a club, standing and sitting in front of a building. The men are all dressed in formal attire, including suits, ties, and hats. Some of them are standing, while others are sitting on the steps in front of the building. The building has a wooden door with a design on it, and the steps are made of stone.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression:

The image is a sepia-toned photograph of a group of men, likely taken in the late 19th century. The photo is mounted on a larger, off-white background and is contained within a rounded oval shape.

Subject and Composition:

  • The Men: The photograph captures a group of approximately 20 men. They are all dressed in dark suits, bow ties, and mostly appear to be of similar age.
  • Setting: The men are posed on the steps leading up to a large, wooden door set into a stone wall. The door is the background.
  • Arrangement: The men are arranged in a semi-formal group photo. Some are standing, while most are sitting on the steps.
  • Mood: The image conveys a sense of formality, possibly signifying a class photo or a group portrait of a club or association.

Details:

  • Clothing: The attire suggests a formal occasion or a particular social group, and the attire strongly suggests the era of the photo.
  • Props: Some men are holding canes, or hats.
  • Photograph Type: The style of the photograph suggests it is a vintage image.
  • Quality: The photograph is in good condition considering its age.

In Summary:

It's a well-composed, historical photograph of a group of gentlemen, likely taken in a setting suggesting social importance or institutional association.

Created by gemini-2.0-flash on 2025-05-04

The image shows a sepia-toned photograph of a group of men, likely a class or fraternal organization, posed on the steps of a building. The photograph is cropped into an oval shape and is set against a blank white background.

The men are dressed in formal attire, including suits with bow ties or neckties, vests, and jackets. They are arranged in rows on the steps, with some sitting and some standing. The setting appears to be an exterior of a stone building with a large, arched wooden door. The door seems to be made of dark wood and features vertical panels.

The overall tone of the image is serious and formal, reflecting the style of portraiture common during the period when the photograph was likely taken. The image's sepia tone suggests that it is an antique or vintage photograph. The composition is symmetrical, with the subjects arranged in a way that fills the oval frame effectively.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a group of men, likely from the late 19th or early 20th century, posing for a formal photograph. The setting appears to be outside a stone building with a large wooden door. The men are dressed in formal attire typical of the period, including suits, bow ties, and hats.

The group is arranged in two rows: the front row is seated on the steps leading up to the door, while the back row is standing. The men in the front row are sitting with their legs crossed or slightly apart, and some are holding hats in their laps. The men in the back row are standing upright, with some holding hats as well. The overall mood of the image is formal and composed, suggesting it might be a commemorative or official group photograph, possibly of a club, organization, or professional group. The image has an oval frame, which was a common style for photographs of that era.