Human Generated Data

Title

Crime, Children, Reform Schools: United States. Massachusetts. Westboro. Lyman School for Boys: Lyman School for Boys: Just Before Dinner.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2859.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. Massachusetts. Westboro. Lyman School for Boys: Lyman School for Boys: Just Before Dinner.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2859.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Furniture 99.4
Human 99.1
Restaurant 95.5
Footwear 94
Apparel 94
Clothing 94
Cafeteria 88.6
Room 80.2
Indoors 80.2
School 59.3
Classroom 59.3

Clarifai
created on 2019-06-05

people 100
many 99.8
group 99.7
group together 99.7
adult 99.1
furniture 98.9
several 97.9
man 96.8
woman 96.5
military 95.2
watercraft 95
leader 94.5
chair 94.5
room 94
administration 91.9
vehicle 91.8
seat 91.7
wear 88.9
education 88.3
indoors 87.9

Imagga
created on 2019-06-05

room 72.8
classroom 51.8
interior 47.7
table 42.7
chair 41.3
restaurant 33.1
furniture 31.5
hall 24.7
modern 23.8
dining 23.8
house 20.9
decor 20.3
indoors 20.2
home 18.3
empty 18
floor 17.7
design 17.4
chairs 16.6
indoor 16.4
cafeteria 16.4
glass 16.3
salon 15.8
dinner 15.3
people 15.1
tables 14.8
barbershop 14.8
seat 14.7
window 14.6
teacher 14.6
comfortable 14.3
wood 14.2
shop 14.1
architecture 14.1
luxury 13.7
building 13.3
decoration 13
contemporary 12.2
person 12.2
office 12.2
food 12.1
man 12.1
men 12
elegant 12
style 11.9
life 11.5
urban 11.4
women 11.1
work 11
business 10.9
male 10.6
hospital 10.5
banquet 10.4
place 10.2
service 10.2
inside 10.1
lifestyle 10.1
elegance 10.1
relaxation 10
kitchen 10
city 10
meal 9.9
professional 9.8
lamp 9.5
day 9.4
light 9.4
adult 9.3
drink 9.2
structure 9.1
mercantile establishment 9
stool 8.9
educator 8.8
sofa 8.6
party 8.6
hotel 8.6
sitting 8.6
nobody 8.5
relax 8.4
eat 8.4
bar 8.3
lunch 8
businessman 7.9
wooden 7.9
scene 7.8
3d 7.7
living 7.6
wine 7.4
group 7.2
smiling 7.2

Google
created on 2019-06-05

Room 85.4
Table 58.6
Black-and-white 56.4
Monochrome 54.4

Microsoft
created on 2019-06-05

floor 99.3
indoor 98.9
chair 96.1
person 95.4
furniture 95.2
table 90.4
clothing 86.3
ceiling 83.9
group 66
old 44.5
dressed 25.4
several 22.7
clothes 19.9

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Disgusted 48%
Confused 45.2%
Angry 46.7%
Sad 48.7%
Surprised 45.2%
Happy 45.8%
Calm 45.4%

AWS Rekognition

Age 20-38
Gender Female, 50.8%
Disgusted 45.3%
Confused 45.3%
Angry 45.5%
Calm 46%
Surprised 45.5%
Happy 45.5%
Sad 52%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Sad 48.9%
Angry 45.6%
Calm 47.4%
Happy 46.9%
Disgusted 45.3%
Confused 45.5%
Surprised 45.4%

AWS Rekognition

Age 11-18
Gender Female, 54.5%
Sad 45.6%
Happy 45.2%
Disgusted 46.8%
Calm 45.2%
Angry 51.1%
Confused 45.5%
Surprised 45.5%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Happy 49.6%
Disgusted 49.6%
Sad 50.1%
Confused 49.5%
Angry 49.6%
Surprised 49.6%
Calm 49.5%

AWS Rekognition

Age 17-27
Gender Male, 50.5%
Sad 49.7%
Angry 49.6%
Calm 50%
Confused 49.5%
Happy 49.6%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Angry 49.6%
Happy 49.5%
Surprised 49.5%
Calm 49.6%
Confused 49.5%
Sad 50.2%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.6%
Happy 49.8%
Confused 49.5%
Sad 49.8%
Calm 49.6%
Disgusted 49.7%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Surprised 45.2%
Angry 45.4%
Disgusted 45.2%
Sad 51.9%
Happy 45.2%
Confused 45.2%
Calm 46.8%

AWS Rekognition

Age 20-38
Gender Female, 50%
Surprised 49.5%
Calm 49.7%
Happy 49.6%
Sad 49.9%
Confused 49.6%
Angry 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Sad 49.6%
Disgusted 49.9%
Calm 49.7%
Confused 49.5%
Angry 49.6%
Surprised 49.6%
Happy 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Happy 49.6%
Disgusted 49.6%
Confused 49.6%
Surprised 49.6%
Sad 49.9%
Angry 49.6%
Calm 49.7%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Sad 49.8%
Calm 49.8%
Disgusted 49.5%
Happy 49.7%
Confused 49.5%
Angry 49.5%
Surprised 49.6%

AWS Rekognition

Age 4-7
Gender Female, 51.3%
Disgusted 46.6%
Calm 45.4%
Confused 45.3%
Surprised 45.3%
Happy 45.4%
Angry 45.5%
Sad 51.6%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Chair
Person
Shoe

Clarifai

Clothing
Building
Man
Footwear
Human face
Chair
Table
Human arm
Human hair

AWS Rekognition

Chair 99.4%

AWS Rekognition

Chair 97.8%

AWS Rekognition

Chair 52.7%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 96.9%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 94.1%

AWS Rekognition

Person 86%

AWS Rekognition

Person 80.4%

AWS Rekognition

Person 78.3%

AWS Rekognition

Person 74%

AWS Rekognition

Person 73.7%

AWS Rekognition

Person 69.6%

AWS Rekognition

Person 68%

AWS Rekognition

Person 66.2%

AWS Rekognition

Person 56.2%

AWS Rekognition

Person 44.7%

AWS Rekognition

Shoe 94%

Clarifai

Clothing 87.8%

Clarifai

Clothing 70%

Clarifai

Clothing 60.5%

Clarifai

Clothing 54.4%

Clarifai

Clothing 52.8%

Clarifai

Clothing 51.9%

Clarifai

Clothing 48%

Clarifai

Clothing 47.6%

Clarifai

Clothing 45.9%

Clarifai

Clothing 43%

Clarifai

Clothing 35.4%

Clarifai

Building 75.8%

Clarifai

Man 73.8%

Clarifai

Man 73.4%

Clarifai

Man 61.1%

Clarifai

Man 60.1%

Clarifai

Man 58.1%

Clarifai

Man 53.4%

Clarifai

Man 51.3%

Clarifai

Man 49.3%

Clarifai

Man 45.5%

Clarifai

Man 42.2%

Clarifai

Man 42.2%

Clarifai

Man 38.2%

Clarifai

Man 36.3%

Clarifai

Man 36.2%

Clarifai

Man 35.8%

Clarifai

Man 34.7%

Clarifai

Footwear 73.2%

Clarifai

Footwear 72.3%

Clarifai

Footwear 70.2%

Clarifai

Footwear 65.2%

Clarifai

Footwear 61.9%

Clarifai

Footwear 58.1%

Clarifai

Footwear 57%

Clarifai

Footwear 53.7%

Clarifai

Footwear 52.4%

Clarifai

Footwear 49.9%

Clarifai

Footwear 49.2%

Clarifai

Footwear 48.8%

Clarifai

Footwear 46.6%

Clarifai

Footwear 44.4%

Clarifai

Footwear 42.1%

Clarifai

Footwear 37.4%

Clarifai

Footwear 37.2%

Clarifai

Footwear 37%

Clarifai

Footwear 36.9%

Clarifai

Human face 61.5%

Clarifai

Human face 56.2%

Clarifai

Human face 54.5%

Clarifai

Human face 48%

Clarifai

Chair 48.2%

Clarifai

Chair 35%

Clarifai

Table 36.7%

Clarifai

Table 35.1%

Clarifai

Human arm 35.4%

Clarifai

Human arm 33.3%

Clarifai

Human hair 34.6%

Categories

Imagga
created on 2019-06-05

paintings art 38.3%
people portraits 29.7%
interior objects 11.4%
streetview architecture 9.9%
events parties 8.8%
pets animals 1.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people sitting around a table

Created by general-english-image-caption-blip-2 on 2025-07-06

an old black and white photo of a group of men sitting at tables

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts a room filled with young men engaging in various activities, such as reading and socializing. The setting has a vintage feel, possibly from the early to mid-20th century, with wooden floors, simple furniture, and large windows featuring slatted blinds. Papers and books are scattered across the tables, suggesting this could be a recreation or study area. The men are dressed in work-style clothing, including suspenders and shirts, indicative of that era. The space appears orderly and well-lit, with natural light streaming through the windows.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a group of young boys gathered in a room that appears to be a common area or classroom. The boys are dressed in period clothing, likely from the early 20th century, with some wearing suspenders and shirts. Some of them are sitting at a table engaged in reading, while others are observed standing or sitting in different parts of the room. The room has hardwood floors and features several windows with blinds, allowing natural light to enter. There are also wooden chairs scattered around and a radiator visible near the windows. The overall atmosphere suggests a study or leisure time setting in an institutional or educational environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a black and white photograph of an interior space, likely a classroom or meeting room. There are several people seated around a large table, engaged in what seems to be a discussion or activity. The room has wooden floors and walls, with windows and blinds visible. The overall atmosphere suggests this is a formal, educational or professional setting from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a historical black and white photograph of what looks like a classroom or study hall setting, likely from the early to mid-20th century. The room has several wooden windows with shutters and a hardwood floor. Students are seated in wooden chairs, appearing to be engaged in reading or studying. The lighting comes from both the windows and what appears to be overhead lighting fixtures. The architecture and furniture style is typical of educational institutions from that era, with high ceilings and traditional woodwork details. The image has the characteristic grainy quality of vintage photography from this period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of a group of young men in a room, likely a school or community center. The room is well-lit, with natural light coming from windows on the right side of the image. The walls are white, and the floor is made of dark wood.

In the foreground, there are several young men sitting at a long table in the center of the room. They are all wearing casual clothing, such as button-down shirts and pants. Some of them are holding books or papers, while others are engaged in conversation.

To the left of the table, there are several more young men standing or sitting on chairs. One of them is wearing overalls and has his back turned to the camera. Another young man is sitting on a chair, reading a book.

In the background, there is a doorway leading to another room. There is also a radiator under one of the windows, suggesting that the room may be used for educational purposes.

Overall, the image suggests that the young men in the photo are engaged in some kind of educational or recreational activity. The atmosphere appears to be relaxed and informal, with the young men chatting and laughing with each other.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image depicts a black-and-white photograph of a room filled with young men, likely teenagers or pre-teens, engaged in various activities. The room is spacious, featuring dark wood floors and white walls adorned with windows on the right side, which are covered by blinds. A radiator is visible beneath one of the windows.

In the center of the room, a large table is surrounded by chairs, where several boys are seated, some reading newspapers or books. Other boys are standing around the room, while a few sit on chairs against the walls. The atmosphere appears relaxed, with the boys seemingly enjoying each other's company.

The overall ambiance of the image suggests a casual gathering or social event, possibly taking place in a school, community center, or other public space. The presence of newspapers and books indicates that the boys may be engaged in educational or recreational activities.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

In the image, there are several people sitting in a room, and some of them are reading. The room has a wooden floor, and the walls are white. The room has a long table with several chairs, and some people are sitting on them. The room has several windows with blinds. The room has a radiator on the wall. The room has a door on the left side.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white image depicts a group of men sitting in chairs inside a room. Some of them are wearing suspenders, while others are wearing ties. Some of them are holding a book, while others are looking at the book. There is a radiator on the right side, and there are windows on the wall. There are two doors on the left side of the room. There are lamps on the ceiling.

Google Gemini

Created by gemini-2.0-flash on 2025-05-09

The sepia-toned photograph showcases a group of people in a large, well-lit room, possibly a common area or library. The room is furnished with a long, rectangular table around which several individuals are seated, either reading or engaged in quiet conversation. Others are positioned near the windows, some holding books or magazines.

The room's interior features dark-stained wood trim and window frames. Large windows are fitted with blinds, allowing natural light to filter into the space. Overhead, simple light fixtures are evenly spaced across the textured ceiling. The floor is made of dark hardwood, adding to the room's warm, classic atmosphere.

The people in the photo appear to be mostly young men, dressed in clothing typical of the era, including suspenders, collared shirts, and slacks. The overall setting and attire suggest the photograph was taken sometime in the early to mid-20th century. The image exudes a sense of scholarly or leisurely activity within a structured and comfortable environment.

Created by gemini-2.0-flash-lite on 2025-05-09

This image is a sepia-toned photograph depicting a group of young men in what appears to be a common room or study hall, possibly from the early 20th century.

Here's a breakdown of what's visible:

  • Setting: The room is spacious with a high ceiling, possibly with exposed beams. There are large windows with blinds, suggesting it could be a school or institutional setting. The walls are painted a light color.
  • Furnishings: There's a large, round table dominating the center of the room, with several chairs around it. Other furnishings include what looks like a radiator and a small bookshelf next to the windows.
  • People: The image features a group of young men, most dressed in shirts, ties, suspenders, and trousers. Several are sitting around the table, engrossed in books or papers. Others are standing or sitting nearby, possibly socializing.
  • Activities: The central activity seems to be reading or studying. Several of the men are reading or looking at publications. There seems to be some conversation and movement in the room as well.
  • Atmosphere: The image has a quiet, studious atmosphere. It evokes a sense of a time when education and intellectual pursuits were highly valued.

Overall, it's a historical photograph offering a glimpse into the everyday life of young men, likely students, in an earlier era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts a group of men gathered in a large room, likely from the early 20th century, based on the clothing and setting. The men are dressed in work attire, which includes overalls, suspenders, and hats, suggesting they may be laborers or factory workers. Some of the men are seated on chairs arranged in a semi-circle, while others are standing or leaning against the walls. The room appears to be a communal space, possibly a waiting area or a break room.

The room has wooden flooring and walls, with several windows on the right side, which have shutters partially open. There is a radiator visible under the windows, indicating the room has heating. The men seem to be engaged in conversation or waiting for something, as some are looking towards the camera while others are talking to each other. The overall atmosphere suggests a moment of rest or a break from work.

Qwen

No captions written