Human Generated Data

Title

Untitled (group of six men, seated, crowd of men in background)

Date

c. 1870-1890

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.55

Human Generated Data

Title

Untitled (group of six men, seated, crowd of men in background)

People

Artist: Unidentified Artist,

Date

c. 1870-1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.55

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 97.2
Person 97.2
Person 96.7
Person 94.5
Person 92.6
Person 92.3
Person 82.5
Amusement Park 77.4
Theme Park 75.8
Text 75.1
Painting 72.6
Art 72.6
Person 65.4
Canvas 59.6
Carousel 57.8
Spoke 55.8
Machine 55.8
Person 49.7

Clarifai
created on 2018-03-16

vintage 98.7
retro 98.6
people 98.4
old 96.9
antique 95.2
print 94.7
art 94.7
group 94.5
adult 94.5
wear 92.3
man 92.2
paper 92
furniture 91.2
ancient 90.7
illustration 89
no person 87.8
room 86.1
collection 84.5
card 82.6
woman 82.2

Imagga
created on 2018-03-16

vintage 46.3
grunge 40.9
old 40.4
fire screen 35.4
antique 34.8
texture 33.3
retro 31.9
screen 31.9
aged 29
container 26.9
ancient 25.1
border 24.4
frame 24.1
paper 23.5
protective covering 23.3
structure 23.2
art 23.1
decoration 20.8
grungy 19
tray 18.9
covering 18.5
material 17.9
dirty 17.2
damaged 17.2
wall 17.1
pattern 16.4
rusty 16.2
design 15.8
receptacle 15.3
grain 14.8
empty 14.6
wallpaper 14.5
graffito 14.5
black 13.8
decay 13.5
history 13.4
old fashioned 13.3
brass 13.3
historic 12.8
grime 12.7
paint 12.7
style 12.6
memorial 12.6
brown 12.5
space 12.4
graphic 12.4
letter 11.9
stamp 11.8
envelope 11.6
rust 11.6
backdrop 11.5
parchment 11.5
worn 11.5
textured 11.4
blank 11.1
binding 11
global 10.9
architecture 10.9
mottled 10.7
fracture 10.7
crumpled 10.7
crack 10.7
dirt 10.5
text 10.5
postmark 9.9
postage 9.8
ragged 9.7
stains 9.7
detail 9.6
stained 9.6
spot 9.6
mail 9.6
building 9.5
map 9.3
rough 9.1
backgrounds 8.9
box 8.9
printed 8.8
interior 8.8
states 8.7
geography 8.7
stain 8.6
post 8.6
weathered 8.5
textures 8.5
money 8.5
china 8.5
travel 8.4
page 8.3
decorative 8.3
color 8.3
tracery 8.3
artwork 8.2
symbol 8.1
currency 8.1
blackboard 8.1
surface 7.9
postal 7.8
atlas 7.8
faded 7.8
messy 7.7
edge 7.7
culture 7.7
obsolete 7.7
international 7.6
bill 7.6
house 7.5
chest 7.5
gold 7.4
note 7.3
landmark 7.2

Google
created on 2018-03-16

picture frame 74.3
history 67.3
antique 50.5

Microsoft
created on 2018-03-16

old 78.3
picture frame 57.6

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 48-68
Gender Male, 53.4%
Calm 47.9%
Confused 45.1%
Surprised 45.1%
Disgusted 45.1%
Happy 45.3%
Angry 46.9%
Sad 49.7%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Calm 51.4%
Angry 45.5%
Disgusted 45%
Happy 45.1%
Confused 45.8%
Surprised 45.1%
Sad 47.1%

AWS Rekognition

Age 35-52
Gender Female, 52.2%
Happy 48%
Disgusted 45.1%
Calm 45.2%
Sad 51.1%
Confused 45.4%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Confused 49.6%
Sad 49.7%
Angry 49.7%
Calm 49.9%
Happy 49.5%
Surprised 49.5%
Disgusted 49.6%

AWS Rekognition

Age 6-13
Gender Male, 50.3%
Surprised 49.6%
Angry 49.6%
Sad 49.7%
Calm 49.8%
Disgusted 49.6%
Confused 49.6%
Happy 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Sad 50.4%
Disgusted 49.5%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 49-69
Gender Male, 53.8%
Happy 45.4%
Surprised 45.1%
Disgusted 45.1%
Confused 45.2%
Angry 47.1%
Calm 45.5%
Sad 51.5%

AWS Rekognition

Age 38-57
Gender Female, 50.5%
Confused 49.5%
Surprised 49.5%
Happy 49.8%
Angry 49.5%
Disgusted 49.5%
Sad 50.1%
Calm 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Disgusted 49.5%
Happy 49.5%
Angry 49.6%
Surprised 49.5%
Sad 49.9%
Calm 49.9%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 49.6%
Angry 49.7%
Disgusted 49.6%
Calm 49.5%
Sad 50.1%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 29-45
Gender Female, 50.3%
Sad 49.8%
Calm 49.7%
Confused 49.6%
Angry 49.6%
Happy 49.7%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-44
Gender Male, 50%
Sad 50.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 54.4%
Confused 45.3%
Surprised 45.1%
Calm 46.5%
Sad 52.4%
Disgusted 45.1%
Happy 45.2%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Confused 49.5%
Happy 49.6%
Sad 49.8%
Angry 49.7%
Disgusted 49.6%
Surprised 49.5%
Calm 49.8%

AWS Rekognition

Age 38-59
Gender Male, 54.7%
Calm 45.1%
Surprised 45%
Angry 45.1%
Sad 54.6%
Disgusted 45%
Confused 45.1%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Sad 50.4%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Sad 50.3%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.6%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 49.8%
Calm 49.6%
Surprised 49.6%
Angry 49.6%
Disgusted 49.7%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 35-53
Gender Female, 50.5%
Surprised 49.5%
Confused 49.5%
Calm 50%
Sad 49.8%
Happy 49.6%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Calm 50.1%
Angry 49.6%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Sad 49.7%

AWS Rekognition

Age 14-25
Gender Female, 50.1%
Surprised 49.5%
Angry 49.6%
Sad 49.7%
Calm 49.9%
Disgusted 49.6%
Confused 49.7%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Surprised 49.5%
Confused 49.5%
Disgusted 49.6%
Calm 49.7%
Angry 49.5%
Sad 50%
Happy 49.6%

Microsoft Cognitive Services

Age 51
Gender Male

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting
Person 97.2%
Person 96.7%
Person 94.5%
Person 92.6%
Person 92.3%
Person 82.5%
Person 65.4%
Person 49.7%
Painting 72.6%

Categories

Imagga

paintings art 100%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-11

a photograph of a group of people standing in front of a store -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image depicts a formal group portrait featuring individuals dressed in traditional garments, likely from an East Asian cultural setting. The seated individuals at the front are wearing intricately embroidered robes with detailed patterns, and they hold various ceremonial objects, indicating an official or noble context. Behind them, standing individuals also appear in traditional attire. The background includes a large ornate tree sculpture, a tiled roof, and architectural elements consistent with classical East Asian design, including a decorative latticework and courtyard arrangement. The composition suggests a significant occasion or gathering.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a group portrait featuring individuals dressed in traditional garments, likely from an Asian culture, sitting and standing in front of a structured background with a traditional architectural design. There are decorative elements visible, such as a pagoda-style roof with intricate patterns and a rock sculpture with a tree growing through it in the center of the composition. The attire consists of long robes with elaborate embroidery, and the individuals appear to be situated outdoors, surrounded by architectural features that suggest a formal or ceremonial setting. The overall tone of the image is sepia, giving it an antique or historical appearance.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-31

The image appears to be a black and white photograph depicting a group of men in traditional Chinese attire gathered in front of a building with decorated roofs. The men are seated in rows and are wearing ornate robes and hats, suggesting this may be an important ceremonial or religious occasion. The building in the background has a distinctive Chinese architectural style, with curved roofs and ornate decorations. Overall, the image provides a glimpse into a historical moment in Chinese culture and tradition.

Created by claude-3-opus-20240229 on 2024-12-31

The sepia-toned photograph depicts a group of Chinese men, likely officials or dignitaries, dressed in traditional robes and seated in front of an ornate building with tiled roofs. The men are arranged in two rows, with those in the front row sitting cross-legged while those in the back row stand. Each man holds a decorative staff or scepter, possibly indicating their rank or position. The intricate architecture of the building behind them features latticed windows and doors adorned with Chinese characters. The image captures a formal gathering or ceremony, providing a glimpse into the customs and attire of the time period.

Created by claude-3-5-sonnet-20241022 on 2024-12-31

This is a historical black and white photograph that appears to be from late 19th or early 20th century China. It shows a formal group portrait taken outside a traditional Chinese building with distinctive architectural elements like decorative roof tiles and ornate doorways. In the image, there are several people dressed in traditional Chinese robes or changshan with elaborate embroidery and trim. They are arranged in two rows - a seated row in the front and a standing row behind them. The clothing and setting suggest these are officials or people of high social status during the Qing Dynasty period. The building in the background has typical Chinese architectural features including a carved stone decoration or sculpture visible between the doorways.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image shows a historical photograph of a group of men in traditional Chinese clothing. The men are seated in a row, with one man standing behind them. They are all wearing robes with intricate patterns and designs. The man standing behind them is wearing a hat and holding a fan. Behind the men, there is a building with a roof and a tree. The photograph has a sepia tone and appears to be old.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people in traditional Chinese clothing. They are sitting on a bench in front of a building, with some people standing behind them. The people are wearing robes with ornate designs, and some of them have hats. The building behind them has a roof with a unique design, and there is a tree in front of it. The photograph is old, and the people in it appear to be posing for the camera.

Google Gemini

Created by gemini-2.0-flash on 2025-06-03

The image shows a group of people photographed in what appears to be a formal setting. The photograph is mounted on an album page.

In the foreground, there are seven men seated in a row. They are dressed in traditional robes and hats, each robe adorned with intricate designs. The men appear to be of Asian descent. The background features a traditional Chinese architectural style, with a building adorned with decorative patterns and a tiled roof.

Standing behind the seated men, there is a larger group of people, mostly men, also dressed in traditional attire. The lighting in the photograph is somewhat dim, contributing to a vintage aesthetic. The photograph is encased within an album page with visible texture and worn edges.

Created by gemini-2.0-flash-lite on 2025-06-03

Here's a description of the image:

Overall Impression:

The image is a sepia-toned photograph mounted within an aged album page. The photograph itself depicts a group of men, likely from the Qing Dynasty era in China, posed in a formal setting.

Detailed Description:

  • Subject: A group of around fourteen or fifteen men is featured in the photograph. The main focus is on a row of seven men seated in a line. They are wearing formal attire, consisting of long robes, jackets or coats, and hats, indicating they likely held positions of authority or status. They have a stately presence. Behind these seven men are a group of people standing, the people are in similar outfits but they seem more relaxed than the group in the front.
  • Setting: The photograph appears to have been taken outdoors, in a courtyard or a space associated with traditional Chinese architecture. A building with a tiled roof and ornate decorative elements is visible in the background. There is a large tree or pillar in the center.
  • Composition: The seated men are arranged in a straight line. The background provides context, hinting at the location and period.
  • Tone: The overall tone is formal and possibly celebratory, given the attire and setting. The sepia tone and the aging of the album page give a sense of historical significance.
  • Album Page: The photograph is enclosed within a page from an old album. The page itself shows signs of wear and tear, indicating its age.

Inference:

Based on the clothing, setting, and overall aesthetic, it's highly probable that this photograph captures a group of officials or members of the upper class during the Qing Dynasty in China. It could be a formal portrait, a record of a gathering, or a celebration of some kind.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image depicts a group of individuals, likely from an East Asian culture, dressed in traditional attire. The photograph appears to be quite old, possibly from the late 19th or early 20th century, given the style of clothing and the quality of the photograph.

Key details include:

  1. Clothing: The individuals in the front row are wearing traditional robes with distinctive rank badges on their chests, which were common in imperial China. These badges typically indicated the wearer's official rank or status. The robes also have ornate borders and trims.

  2. Setting: The group is posed in front of a traditional building with ornate carvings and decorations. The architecture suggests a setting in an East Asian country, possibly China.

  3. Composition: The group is arranged in rows, with some individuals seated in the front and others standing behind them. This arrangement is typical of formal group portraits from that era.

  4. Background: The background includes a tree and more individuals, suggesting that this might be a significant gathering or event.

  5. Photographic Style: The photograph is in black and white and has a sepia tone, which was common for photographs from that period. The image is framed within a larger border, indicating it might be part of an album or a collection.

Overall, the image captures a formal gathering of individuals in traditional attire, likely of historical or cultural significance.

Text analysis

Amazon

H{@HOH
taes