Human Generated Data

Title

Untitled (large family gathering around dining table)

Date

1959

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3024

Human Generated Data

Title

Untitled (large family gathering around dining table)

People

Artist: Harry Annas, American 1897 - 1980

Date

1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3024

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Human 97.8
Furniture 87.4
People 78.7
Room 78
Indoors 78
Clinic 70
Shorts 65.6
Clothing 65.6
Apparel 65.6
Classroom 59.8
School 59.8
Table 58.8
Suit 57.6
Coat 57.6
Overcoat 57.6

Clarifai
created on 2023-10-26

people 99.9
group 98.5
man 98.2
education 98
many 97.8
group together 97.6
school 97.6
adult 97.3
crowd 96.8
woman 96.7
child 93.5
boy 92.3
teacher 92
squad 88.6
audience 88.4
wear 85.9
classroom 85.4
class 84.6
uniform 84.3
actor 83.5

Imagga
created on 2022-01-21

classroom 48.5
brass 43
room 40.6
wind instrument 34.4
group 32.2
people 31.8
outfit 31.3
person 27
male 26.2
musical instrument 24.3
man 22.8
businessman 21.2
business 20
adult 19.5
silhouette 18.2
men 18
teacher 14.7
table 14.7
crowd 14.4
chair 14.2
women 13.4
team 13.4
happy 13.1
sitting 12.9
work 12.5
lifestyle 12.3
smiling 11.6
job 11.5
couple 11.3
professional 11.1
together 10.5
boy 10.4
meeting 10.3
portrait 10.3
learning 10.3
corporate 10.3
casual 10.2
communication 10.1
copy space 9.9
education 9.5
blackboard 9.2
stage 9.2
businesswoman 9.1
worker 9
cheerful 8.9
office 8.8
student 8.8
class 8.7
gymnasium 8.4
friendship 8.4
modern 8.4
teamwork 8.3
executive 8.3
holding 8.2
confident 8.2
suit 8.1
success 8
graphic 8
cornet 7.9
day 7.8
happiness 7.8
dancer 7.8
conference 7.8
teaching 7.8
drinking 7.6
friends 7.5
human 7.5
fun 7.5
manager 7.4
company 7.4
training 7.4
girls 7.3
laptop 7.3
board 7.2
trombone 7
indoors 7

Google
created on 2022-01-21

Black 89.6
Font 82.2
Art 78.2
Chair 71.8
Team 70.6
Event 67
Rectangle 66.1
Illustration 65.1
Room 62.9
Photo caption 62.3
Visual arts 58.1
Painting 57.9
Crew 56.4
Picture frame 54.9
History 54.5
Sitting 53.6
Monochrome 53.2

Microsoft
created on 2022-01-21

text 97.7
person 95.8
outdoor 94.7
player 89.7
posing 47.9
old 43.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 84.7%
Calm 99.5%
Sad 0.2%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 23-31
Gender Male, 74.8%
Calm 58%
Sad 24.8%
Confused 9.8%
Happy 4.2%
Fear 0.9%
Angry 0.9%
Disgusted 0.7%
Surprised 0.7%

AWS Rekognition

Age 37-45
Gender Male, 98.2%
Sad 91.1%
Calm 3.8%
Angry 2%
Fear 0.9%
Confused 0.7%
Disgusted 0.7%
Happy 0.5%
Surprised 0.4%

AWS Rekognition

Age 36-44
Gender Female, 92.9%
Happy 60.2%
Sad 32.1%
Confused 2.4%
Calm 2%
Fear 1.2%
Angry 0.9%
Disgusted 0.7%
Surprised 0.7%

AWS Rekognition

Age 31-41
Gender Male, 58.7%
Sad 74.4%
Calm 13.3%
Confused 5.6%
Happy 4.4%
Fear 0.8%
Disgusted 0.6%
Angry 0.5%
Surprised 0.3%

AWS Rekognition

Age 48-54
Gender Male, 98.5%
Sad 71.5%
Calm 25.5%
Happy 1.2%
Confused 0.8%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Sad 50.1%
Calm 20.6%
Happy 10.9%
Disgusted 6.7%
Angry 4.6%
Confused 2.6%
Surprised 2.6%
Fear 2.1%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Sad 76.8%
Happy 9.8%
Calm 6.9%
Confused 4%
Surprised 1.1%
Disgusted 0.6%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 20-28
Gender Male, 97.2%
Sad 74.1%
Angry 11.2%
Calm 5%
Disgusted 2.7%
Happy 2.5%
Confused 2%
Surprised 1.3%
Fear 1.2%

AWS Rekognition

Age 43-51
Gender Male, 98.8%
Calm 99.6%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Female, 90.7%
Sad 51.3%
Happy 38.6%
Confused 3.1%
Disgusted 2.6%
Calm 2%
Fear 0.8%
Surprised 0.8%
Angry 0.6%

AWS Rekognition

Age 43-51
Gender Female, 98.1%
Sad 87.2%
Calm 9.4%
Happy 1.7%
Confused 0.8%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Calm 39%
Sad 26.7%
Happy 16%
Confused 8%
Angry 5.1%
Surprised 2.2%
Disgusted 1.9%
Fear 1%

AWS Rekognition

Age 36-44
Gender Male, 97.1%
Calm 92.7%
Happy 3.9%
Sad 0.8%
Angry 0.7%
Confused 0.7%
Fear 0.4%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 29-39
Gender Male, 95.5%
Sad 91.3%
Calm 4.1%
Confused 2.5%
Happy 0.8%
Angry 0.4%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 42-50
Gender Female, 99.6%
Sad 63.6%
Happy 19%
Calm 8.1%
Confused 4.3%
Disgusted 2%
Angry 1.2%
Fear 1%
Surprised 0.8%

AWS Rekognition

Age 28-38
Gender Female, 57%
Sad 60.8%
Calm 26.1%
Disgusted 3.6%
Happy 2.6%
Surprised 2.3%
Fear 1.9%
Angry 1.6%
Confused 1.2%

AWS Rekognition

Age 27-37
Gender Male, 81.9%
Sad 48.5%
Happy 22.7%
Calm 15.4%
Fear 3.9%
Confused 3.8%
Surprised 2.6%
Angry 2%
Disgusted 1.2%

AWS Rekognition

Age 27-37
Gender Male, 86.2%
Sad 87.2%
Happy 8.3%
Confused 1.8%
Calm 1.5%
Fear 0.4%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 47-53
Gender Female, 77.3%
Calm 59.7%
Sad 22.8%
Happy 14.8%
Confused 1.5%
Surprised 0.4%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Male, 95.6%
Sad 78.2%
Calm 13.3%
Angry 2.8%
Surprised 2.3%
Confused 1.5%
Fear 0.7%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 29-39
Gender Female, 64.1%
Sad 68.8%
Calm 23.2%
Happy 4.2%
Confused 2.6%
Fear 0.4%
Disgusted 0.3%
Angry 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Feature analysis

Amazon

Person
Chair

Clarifai

Person
Chair
Clothing
Table
Footwear
Man
Human face

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 95.7%

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 91.8%

AWS Rekognition

Person 91.5%

AWS Rekognition

Person 91%

AWS Rekognition

Person 87.4%

AWS Rekognition

Person 87.2%

AWS Rekognition

Person 87%

AWS Rekognition

Person 80.3%

AWS Rekognition

Person 79.2%

AWS Rekognition

Person 69.4%

AWS Rekognition

Person 67.9%

AWS Rekognition

Person 66.7%

AWS Rekognition

Chair 79.1%

AWS Rekognition

Chair 73.9%

AWS Rekognition

Chair 61.2%

AWS Rekognition

Chair 51.6%

Clarifai

Person 71.7%

Clarifai

Person 62.7%

Clarifai

Person 56.3%

Clarifai

Person 55.1%

Clarifai

Chair 66%

Clarifai

Chair 62.9%

Clarifai

Chair 38.6%

Clarifai

Clothing 62.6%

Clarifai

Clothing 60.6%

Clarifai

Clothing 60.5%

Clarifai

Clothing 60.1%

Clarifai

Clothing 57%

Clarifai

Clothing 56.9%

Clarifai

Clothing 56.6%

Clarifai

Clothing 51.4%

Clarifai

Clothing 49.4%

Clarifai

Clothing 47.4%

Clarifai

Clothing 46.4%

Clarifai

Clothing 45.1%

Clarifai

Clothing 44.5%

Clarifai

Clothing 40.5%

Clarifai

Clothing 38.1%

Clarifai

Table 57.1%

Clarifai

Table 42.9%

Clarifai

Footwear 54%

Clarifai

Footwear 51.5%

Clarifai

Footwear 50.7%

Clarifai

Footwear 47.8%

Clarifai

Footwear 45.4%

Clarifai

Footwear 44.2%

Clarifai

Footwear 42.6%

Clarifai

Footwear 36.4%

Clarifai

Footwear 36.3%

Clarifai

Man 46.8%

Clarifai

Man 45.7%

Clarifai

Man 44.8%

Clarifai

Man 39.1%

Clarifai

Human face 34.4%

Clarifai

Human face 34.2%

Categories

Imagga
created on 2022-01-21

text visuals 67.6%
paintings art 20.1%
beaches seaside 6.6%
streetview architecture 5%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

the cast of the musical.

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a group of people sitting around a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image is a negative of a group photo featuring several people gathered around two tables. The individuals are dressed in a variety of outfits, ranging from casual shirts to dresses. The tables have multiple items placed on them, such as bottles and other objects. Several chairs are arranged around the seated people, while others stand behind the group. The background appears plain and neutral, possibly indicating the setting is indoors. The photo displays a mix of ages, with some children seated in the front row.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a negative of a photograph depicting a large group of people gathered around a table. There are about twenty individuals present, composed of both adults and children. The adults are dressed in various styles; some are wearing patterned tops while others are in plain shirts. The children in the front are seated with their legs crossed, wearing dresses and casual outfits. The table is filled with bottles, glasses, and other objects, suggesting a social gathering or celebration. The background appears to be a simple and spacious room, possibly a hall or indoor venue.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a large group of people seated around a table in a classroom or meeting room setting. The people appear to be of various ages, from young children to older adults. They are all dressed in casual clothing, such as plaid shirts, dresses, and suits. The room is dimly lit, creating a somber and contemplative atmosphere. The people seem to be engaged in some kind of discussion or activity, though the specific nature of the gathering is not clear from the image alone.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-15

The black and white photograph shows a large group of people, both men and women, seated at tables in what appears to be a cafeteria or dining hall setting. The people are dressed in clothing typical of an earlier era, likely the mid-20th century based on the styles. The tables are set with plates, glasses and other dining items. The background is plain and dark, putting the focus on the gathered group. The overall composition gives the impression of a staff or employee meal or event at a workplace or institution.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This appears to be a vintage black and white photograph of a group gathering or celebration. The image shows a large group of people arranged in two rows - some standing in the back and others seated in the front. There appears to be a table with bottles and drinks visible. The setting looks like it could be a community hall or social space. The photo has that distinctive grainy quality characteristic of mid-20th century photography. The people are dressed in casual attire typical of that era, with some wearing plaid shirts and light-colored clothing. The lighting and composition create an interesting contrast between the darker background and the lighter figures in the foreground.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people gathered around tables, with the majority of the individuals appearing to be elderly or senior citizens. The group consists of both men and women, all dressed in casual attire, and they are seated on chairs arranged in a semi-circle around the tables.

The tables are laden with various items, including bottles, glasses, and other objects that are not clearly discernible due to the low image quality. The background of the image is a plain wall, which provides a simple yet effective backdrop for the group photo.

Overall, the image appears to be a gathering of friends or acquaintances, possibly at a social event or celebration. The atmosphere seems relaxed and convivial, with the individuals enjoying each other's company and engaging in conversation.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people gathered around a table, with some standing and others seated. The scene appears to be a social gathering or celebration, possibly a family reunion or party.

Key Features:

  • Group of People: A diverse group of individuals, including men, women, and children, are present in the image.
  • Table Setting: The table is set with various items, such as bottles, plates, and utensils, suggesting a meal or snack is being shared.
  • Seating Arrangement: Some people are seated on chairs, while others are standing behind the table or sitting on the floor.
  • Facial Expressions: The individuals in the image display a range of facial expressions, from smiling to neutral, indicating a relaxed and convivial atmosphere.
  • Background: The background of the image is not clearly defined, but it appears to be a room or outdoor space with a plain wall or surface behind the group.

Overall Impression:

The image conveys a sense of community and camaraderie among the individuals gathered. The relaxed atmosphere and varied facial expressions suggest a enjoyable and social occasion.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph of a group of people sitting at a table. The photograph has a vintage feel, with a grainy texture and a slightly blurred quality. The people in the image are dressed in casual clothing, and some of them are wearing glasses. The table is filled with various items, including bottles, cups, and plates. The room appears to be dimly lit, and there is a large window in the background.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white image shows a group of people sitting around a table. They are wearing formal attire, and some of them are wearing ties. The table has a white tablecloth, and there are several bottles on it. There are also chairs arranged around the table. The people are sitting in a room with a ceiling fan and a wall. The image has a watermark on the bottom right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-05-02

Here is a description of the image:

The image appears to be a photographic negative, featuring a large group of people gathered around a long table. This suggests the setting might be a family gathering, a celebration, or some other social event.

The people in the image vary in age, from children to the elderly. They are dressed in a variety of clothing styles, which may reflect different eras, occasions, or personal preferences.

The table is filled with dishes and bottles. The people seem to be posing for the picture. Some are smiling, while others have more neutral expressions.

The room itself is fairly simple, with a plain wall behind the group. The lighting is somewhat even, suggesting a flash or well-lit environment during the original photograph.

Overall, the image captures a moment in time, showing a group of people connected by some kind of relationship. Due to the negative format, the colors are inverted, giving it an unusual and intriguing visual effect.

Created by gemini-2.0-flash-lite on 2025-05-02

Here is a description of the image:

This is an inverted image of a large group of people gathered around tables. The setting appears to be a simple room, possibly a dining hall or a community space, with a dark background and a long, straight ceiling.

People:

  • There are approximately 25 people, with a mix of adults and children.
  • They are mostly standing or sitting at two long tables that run parallel to each other.
  • The adults are dressed in casual attire, with button-down shirts, dresses, and skirts, likely reflecting the fashion of a mid-20th-century era.
  • Some of the children are in dresses and skirts.
  • The people are posed somewhat formally, typical of a group photo.

Tables and Chairs:

  • The tables are long and seem to be set for a meal, with glasses and bottles visible.
  • Wooden folding chairs are placed around the tables.

Overall Impression:

The photograph conveys a sense of community and a gathering of people. The inverted color scheme creates a unique visual effect, with light areas appearing dark and vice-versa, altering how the image is perceived.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a group of people, likely senior citizens, gathered for a meal or a social event. The group is arranged in two rows, with the front row seated at a long table and the back row standing behind them. The table is set with various items such as bottles, glasses, and possibly food, indicating a communal meal.

The individuals are dressed in casual attire, with some wearing shirts, blouses, and dresses. The setting appears to be indoors, possibly in a community hall or a similar venue, as suggested by the plain backdrop and the arrangement of chairs and tables. The overall atmosphere seems to be one of camaraderie and social interaction.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph of a group of people, likely a community or social gathering, seated around tables in a large indoor space. The group is composed of both men and women, all dressed in casual or semi-formal attire typical of mid-20th-century fashion. They appear to be enjoying a meal or refreshments, with bottles and glasses visible on the tables. The setting looks like a communal dining area, possibly in a school, community center, or similar institution. The individuals are smiling and seem to be engaged in conversation, suggesting a friendly and social atmosphere. The photo has a vintage quality, indicative of an older time period.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph appears to capture a group of people in a dining or communal space, possibly a cafeteria or community center. The setting suggests a mid-20th-century era based on the clothing styles and furniture design.

The group is arranged in several rows:

  • The front row consists of individuals seated on chairs, facing the camera. They are dressed in a mix of casual and semi-formal attire, with some wearing white aprons or uniforms, possibly indicating a specific role or activity.
  • The second row includes individuals seated at long tables, with bottles and glasses visible, suggesting a meal or gathering.
  • The back row is composed of people standing, some holding tennis rackets, indicating they may have just participated in a game or are part of a tennis club or event.

The overall atmosphere appears lighthearted and social, with people engaged in conversation and smiling. The image has a vintage quality, likely from the 1950s or 1960s, given the fashion and photographic style.

Text analysis

Amazon

CAT