Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: A Boys Club.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2882.3

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: A Boys Club.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2882.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.1
Person 99.1
Room 99
Classroom 99
Indoors 99
School 99
Person 99
Person 98.9
Person 98.5
Person 98.3
Person 97
Person 95.2
Person 94.6
Audience 92.3
Crowd 92.3
Person 81.1
Person 80
Architecture 79.5
Clock Tower 79.5
Tower 79.5
Building 79.5
Person 75
Accessories 70.7
Tie 70.7
Accessory 70.7
Tie 70.5
Person 68.8
Furniture 62.3
Speech 62
Waiting Room 57.6
Chair 55.7
Person 47.3
Person 43.7

Clarifai
created on 2019-06-05

people 99.9
many 99.6
group 99.2
child 98.2
education 97.9
school 97.3
group together 97.3
elementary school 95.4
adult 94.5
administration 93.8
teacher 93.6
woman 92.4
man 92.2
room 91.7
several 89
war 88.9
classroom 88.3
leader 86.8
wear 85
indoors 84.7

Imagga
created on 2019-06-05

room 88.4
classroom 76.4
interior 37.1
table 26.5
home 25.5
chair 24.4
people 20.6
furniture 20.6
house 20
person 19.1
man 18.1
indoors 17.6
window 17.4
hall 16.6
modern 14.7
design 14.6
business 14.6
adult 14
luxury 13.7
male 13.5
architecture 13.3
service 13
indoor 12.8
restaurant 12.6
work 12.6
decor 12.4
lifestyle 12.3
office 12
glass 11.8
chairs 11.7
wood 11.7
floor 11.1
wall 10.6
women 10.3
3d 10.1
light 10
nurse 9.8
group 9.7
style 9.6
comfortable 9.5
living 9.5
desk 9.4
happy 9.4
student 9.3
dinner 9.3
inside 9.2
teacher 9.1
tables 8.9
hotel 8.6
life 8.4
horizontal 8.4
relaxation 8.4
metal 8
success 8
smiling 8
space 7.8
sofa 7.7
empty 7.7
couch 7.7
men 7.7
apartment 7.7
dining 7.6
blackboard 7.6
kitchen 7.2
shop 7.1
portrait 7.1
center 7.1
day 7.1
businessman 7.1
travel 7

Google
created on 2019-06-05

Photograph 95.8
Social group 93
Snapshot 84.7
Team 72.7
History 72.6
Room 65.7
Family 62.7
Crew 56.9
Vintage clothing 52.1

Microsoft
created on 2019-06-05

clothing 96.7
group 95.5
person 92
smile 88.3
posing 81.7
standing 81.5
old 78
woman 72
human face 69.1
white 64.3
school 59.1
clock 58.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Angry 45.6%
Surprised 45.2%
Confused 45.2%
Sad 51.7%
Disgusted 45.1%
Happy 45.1%
Calm 47.2%

AWS Rekognition

Age 14-25
Gender Male, 54.3%
Sad 48.6%
Confused 45.4%
Calm 49.4%
Disgusted 45.2%
Happy 45.1%
Angry 45.9%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Male, 52.5%
Surprised 45.1%
Calm 45.1%
Happy 45%
Sad 53.8%
Confused 45.3%
Angry 45.5%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Male, 53.3%
Disgusted 45.2%
Happy 45.2%
Surprised 45.7%
Angry 46%
Confused 45.4%
Calm 51.1%
Sad 46.5%

AWS Rekognition

Age 35-53
Gender Female, 50.7%
Disgusted 45.2%
Surprised 45.2%
Angry 45.3%
Confused 45.2%
Sad 47.3%
Calm 51.7%
Happy 45.2%

AWS Rekognition

Age 17-27
Gender Male, 51.2%
Sad 51.5%
Disgusted 45.3%
Confused 45.4%
Surprised 45.3%
Calm 47%
Happy 45.2%
Angry 45.4%

AWS Rekognition

Age 6-13
Gender Female, 50.4%
Sad 52.9%
Surprised 45.2%
Disgusted 45.1%
Calm 46%
Happy 45%
Confused 45.2%
Angry 45.6%

AWS Rekognition

Age 45-63
Gender Female, 50.8%
Surprised 45.1%
Confused 45.1%
Sad 52.5%
Disgusted 45.1%
Calm 46.8%
Angry 45.1%
Happy 45.3%

AWS Rekognition

Age 14-25
Gender Female, 53.9%
Disgusted 45.3%
Confused 45.6%
Angry 45.7%
Sad 49.3%
Surprised 46.2%
Happy 45.1%
Calm 47.8%

AWS Rekognition

Age 20-38
Gender Female, 54.4%
Confused 45.3%
Happy 45.6%
Angry 45.4%
Sad 51.6%
Calm 46%
Disgusted 45.7%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Male, 54%
Sad 46.5%
Surprised 45.5%
Angry 47.6%
Disgusted 45.8%
Confused 45.3%
Happy 45.3%
Calm 49%

AWS Rekognition

Age 15-25
Gender Male, 53.5%
Surprised 45.2%
Calm 50.4%
Happy 46.5%
Sad 47.3%
Angry 45.3%
Confused 45.2%
Disgusted 45.2%

AWS Rekognition

Age 4-9
Gender Female, 50.6%
Sad 45.8%
Disgusted 45.2%
Calm 53.3%
Confused 45.1%
Angry 45.3%
Surprised 45.2%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 51.4%
Confused 45.2%
Disgusted 45.3%
Calm 46.4%
Angry 45.3%
Happy 45.1%
Surprised 45.1%
Sad 52.6%

AWS Rekognition

Age 15-25
Gender Female, 51.8%
Sad 46.1%
Angry 47.9%
Happy 45.3%
Confused 45.4%
Surprised 45.7%
Disgusted 45.9%
Calm 48.6%

AWS Rekognition

Age 26-43
Gender Male, 52.4%
Confused 45.1%
Disgusted 45.1%
Happy 45.2%
Calm 52.5%
Surprised 45.1%
Sad 46.6%
Angry 45.3%

AWS Rekognition

Age 35-52
Gender Female, 50.6%
Sad 48.8%
Surprised 45.6%
Disgusted 45.3%
Calm 46.7%
Happy 47.9%
Confused 45.4%
Angry 45.4%

AWS Rekognition

Age 15-25
Gender Female, 52.1%
Sad 53.4%
Calm 46.2%
Disgusted 45.1%
Happy 45.1%
Confused 45.1%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 9-14
Gender Female, 50.6%
Disgusted 45.4%
Surprised 47.1%
Angry 45.8%
Confused 45.5%
Sad 47%
Calm 46.7%
Happy 47.4%

AWS Rekognition

Age 20-38
Gender Female, 54.4%
Disgusted 45.2%
Confused 45.2%
Happy 45.1%
Calm 45.7%
Surprised 45.2%
Sad 53.3%
Angry 45.3%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Calm 47.5%
Angry 45.4%
Confused 45.2%
Sad 51.2%
Happy 45.2%
Disgusted 45.2%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Happy 45.1%
Disgusted 45.2%
Confused 45.3%
Surprised 45.2%
Sad 51.7%
Angry 46.9%
Calm 45.6%

AWS Rekognition

Age 17-27
Gender Female, 52.3%
Calm 46.1%
Sad 53%
Disgusted 45.2%
Happy 45.1%
Surprised 45.1%
Angry 45.3%
Confused 45.2%

AWS Rekognition

Age 15-25
Gender Female, 53.1%
Surprised 46.2%
Disgusted 45.4%
Confused 46.2%
Sad 47.5%
Calm 47.6%
Happy 46.4%
Angry 45.8%

AWS Rekognition

Age 27-44
Gender Male, 52.9%
Calm 45.7%
Surprised 45.5%
Disgusted 45.6%
Confused 45.5%
Sad 46.6%
Happy 50.7%
Angry 45.5%

AWS Rekognition

Age 26-43
Gender Female, 54.3%
Happy 47.4%
Angry 45.5%
Calm 46.9%
Confused 45.4%
Surprised 45.6%
Disgusted 46.7%
Sad 47.5%

AWS Rekognition

Age 10-15
Gender Female, 50.8%
Disgusted 45%
Sad 46.5%
Surprised 45.1%
Calm 52.5%
Happy 45.6%
Confused 45.2%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.3%
Disgusted 45.3%
Confused 45.1%
Happy 45.1%
Calm 51.8%
Surprised 45.2%
Sad 47.2%
Angry 45.3%

AWS Rekognition

Age 10-15
Gender Male, 53%
Sad 46.6%
Surprised 45.7%
Confused 45.4%
Disgusted 45.5%
Happy 45.4%
Calm 50.8%
Angry 45.6%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Clock Tower
Tie
Chair
Person 99.1%
Person 99%
Person 98.9%
Person 98.5%
Person 98.3%
Person 97%
Person 95.2%
Person 94.6%
Person 81.1%
Person 80%
Person 75%
Person 68.8%
Person 47.3%
Person 43.7%
Clock Tower 79.5%
Tie 70.7%
Tie 70.5%
Chair 55.7%

Categories

Imagga

interior objects 99.6%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-28

a photograph of a group of people sitting in a room -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image depicts a group of individuals, likely a school or formal gathering, posed for a group photograph in what appears to be an indoor setting. The room features a piano on the left-hand side, framed artwork on the walls, and a clock mounted centrally. The individuals are dressed predominantly in formal attire, including suits and ties. The space has a classic and vintage ambiance, suggesting the photo is from an earlier period.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a group of individuals gathered in a room with various elements of interior decor and furnishings. There is a piano visible on the left side of the image, and several framed pictures or artworks are hanging on the walls. One of the most prominent features on the wall is an ornate clock. The room appears to have a traditional or older style, indicated by the decor and attire. The individuals are dressed in formal or semi-formal clothing typical of a past era, suggesting that the photo may have historical significance. There are two rows, with some individuals seated and others standing behind them. There is some decorative detail on the walls, and the general atmosphere feels like an organized group setting, perhaps a class or formal gathering.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph of a large group of people, likely students or members of an organization, gathered in what seems to be a classroom or meeting room. The room has various decorations and furnishings, including a clock, framed artwork, and other items on the walls. The individuals in the photograph are seated and standing, and they appear to be dressed in formal attire, suggesting this may be an official or formal gathering of some kind.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-12

The black and white photograph shows a large group of young boys or young men, likely students, sitting together in what appears to be a classroom or school setting. They are all wearing suits or formal attire typical of the early 20th century time period. The walls contain framed artwork or photographs. The serious expressions and formal poses of the group suggest this may be a class photo or portrait to mark a special occasion or school year. The overall scene provides a glimpse into education and school life from around 100 years ago.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a vintage black and white photograph that appears to be from the early 1900s. It shows a group of young boys in what looks like a classroom or meeting room. They are all dressed formally in suits and ties, which was common for that era. The room has a clock on the wall and some framed pictures or artwork. The boys are arranged in two rows - some seated in the front and others standing behind them. The image has the quality and style typical of early photography, with slightly faded edges and sepia tones. The formal arrangement and setting suggests this might be a class photo or some kind of school or youth organization group picture.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

The image depicts a group of young boys posing for a photograph in a room with a piano and several framed pictures on the walls. The boys are dressed in dark-colored suits, some with ties, and are arranged in rows, with the front row seated on chairs. The background features a wall adorned with various framed pictures, including a clock, and a piano situated to the left of the group. The overall atmosphere suggests a formal or posed setting, possibly a school or studio environment.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image is a black and white photograph of a group of young boys in a room, likely taken in the early 20th century.

  • The room is dimly lit, with the only light source coming from the left side of the image.
    • The walls are painted a dark color, and the floor is made of wood.
    • There are several pieces of furniture in the room, including a desk, chairs, and a bookshelf.
    • The boys are all dressed in formal attire, with most of them wearing suits and ties.
    • They are arranged in rows, with some of them sitting on chairs and others standing behind them.
    • The boys appear to be of similar age, likely between 10 and 15 years old.
    • They all have short haircuts, and most of them are clean-shaven.
    • Some of the boys are looking directly at the camera, while others are looking away or at each other.
    • The overall atmosphere of the image is one of formality and seriousness, suggesting that the boys may be in a school or church setting.

The image provides a glimpse into the lives of young boys in the early 20th century, highlighting their formal attire and serious demeanor.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-30

The image is a black-and-white photograph of a group of young boys, likely students, standing and sitting in a room. They are all dressed in formal attire, including suits and ties. The room appears to be a classroom or a studio with a piano on the left side and a clock mounted on the wall. There are also some paintings and a frame mounted on the wall.

Created by amazon.nova-lite-v1:0 on 2025-05-30

A group of children and young boys are gathered in a room, likely for a group photo. They are all dressed in suits and ties, with some wearing hats. They are sitting on chairs and standing in front of a wall with various picture frames, a clock, and a piano. The room has a vintage feel, with old-fashioned furniture and decor. The image has a sepia tone, giving it a nostalgic and old-fashioned look.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

Here's a description of the image:

This is a sepia-toned photograph of a group of young boys, likely a class picture, taken indoors. The boys are arranged in a mix of standing and seated positions. Most of them are dressed in dark-colored suits, blazers, or uniforms. A few are wearing ties or bow ties.

In the background, there are several framed pictures hanging on the wall, along with a round clock. To the left, there's a piano. The room appears to be a classroom or a similar gathering space.

There are some markings or writing visible on the upper part of the image, possibly annotations or date stamps. The overall impression is that of a formal or semi-formal gathering in a vintage setting.

Created by gemini-2.0-flash-lite on 2025-06-05

Here's a description of the image:

Overall:

The image is a sepia-toned, old photograph showing a group of young boys. They are likely posing for a formal portrait in a well-lit room.

Setting and Details:

  • Environment: The scene appears to be indoors, possibly a classroom or a formal meeting room. There are several framed pictures on the walls, a piano, and a clock.
  • Composition: The boys are arranged in a roughly grouped format. A few rows. Most are standing, some in front and some in the back. There are a few boys seated in chairs.
  • Attire: The boys are all dressed in similar dark suits, shirts and ties.
  • Tone: The photograph has a serious and formal tone, typical of the period.

Inscriptions:

In the upper left corner, a marker writes out "SJ12".
In the upper right corner, a marker writes out "5,3".

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a historical classroom setting, likely from the early 20th century. It features a group of students, predominantly boys, posing for a formal photograph. Here are some detailed observations:

  1. Students:

    • The students are dressed in formal attire typical of the era, with many wearing suits, ties, and some with bow ties.
    • The students are arranged in rows, with some seated in the front and others standing behind them.
    • The expressions on their faces are mostly serious, which is common for formal photographs of this period.
  2. Classroom Setting:

    • The room has a simple, utilitarian design with plain walls.
    • There are several framed pictures and a clock hanging on the walls.
    • The back wall features a blackboard, suggesting this is a classroom.
    • A cabinet or storage unit is visible on the left side of the image.
    • The floor appears to be wooden, and there are a few benches or chairs where the students are seated.
  3. Decorations and Items:

    • The wall decorations include what appear to be portraits or illustrations, possibly of historical figures or educational charts.
    • The clock on the wall indicates the time as approximately 10:10.
    • There is a decorative element on the right side of the image, possibly a plant or a piece of artwork.
  4. Photographic Details:

    • The photograph is in sepia tone, which was common for photographs from the early 20th century.
    • There are some markings or annotations at the top of the image, which might indicate the date or the class name.

Overall, the image captures a moment in time in an early 20th-century classroom, showcasing the formal attire and serious demeanor of the students, as well as the simple and functional design of the classroom.

Text analysis

Amazon

SJ,a
lroll