Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Association of Neighborhood Workers": Arts and Festival Committee: Association of Neighborhood Workers of New York, Arts and Festivals Committee

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3141.4

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Association of Neighborhood Workers": Arts and Festival Committee: Association of Neighborhood Workers of New York, Arts and Festivals Committee

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3141.4

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 98.6
Person 98.6
Person 98
Military 96.8
Military Uniform 95.4
Army 89.6
Armored 89.6
Officer 86
Crowd 85.9
People 84.7
Person 83.6
Apparel 79.7
Clothing 79.7
Person 79.5
Person 75.5
Soldier 74.6
Person 74.4
Person 71.7
Person 67.3
Person 64.3
Troop 63.7
Person 63.6
Plant 57.2
Tree 56.7
Marching 56.1
Musician 56
Musical Instrument 56

Clarifai
created on 2019-06-06

people 99.9
group 99.4
many 98.9
group together 96.8
adult 96.6
cavalry 96.6
military 93.5
man 92.9
print 91.1
wear 90.6
home 89.3
crowd 88.8
child 88.1
mammal 87.4
vehicle 86.8
art 86.5
soldier 86.2
leader 83.7
outfit 82.4
war 80

Imagga
created on 2019-06-06

military uniform 69.5
uniform 60
clothing 41.3
rifle 40.1
covering 29.3
consumer goods 27.8
gun 27.2
firearm 27
weapon 19.7
people 16.7
trees 16
sky 15.9
landscape 14.9
travel 14.8
man 14.8
outdoors 13.9
commodity 13.9
military 13.5
person 13.1
outdoor 13
summer 12.9
male 12.8
old 12.5
tourism 12.4
tree 11.9
child 11.8
soldier 11.7
city 11.6
history 11.6
boy 11.3
mountains 11.1
mountain 10.7
stone 10.7
day 10.2
architecture 10.2
danger 10
park 9.9
building 9.9
vacation 9.8
war 9.6
forest 9.6
ancient 9.5
autumn 8.8
natural 8.7
grass 8.7
lifestyle 8.7
outside 8.6
walking 8.5
hill 8.4
field 8.4
house 8.4
town 8.3
girls 8.2
road 8.1
rock 7.8
backpack 7.8
adult 7.8
houses 7.7
men 7.7
hiking 7.7
walk 7.6
fun 7.5
sport 7.4
peace 7.3
countryside 7.3
protection 7.3
sun 7.2
life 7.2
recreation 7.2
rural 7

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

tree 98.8
outdoor 98.7
person 89.3
white 88.1
clothing 86.4
black 80.8
old 49.7
posing 35.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 14-25
Gender Female, 54.7%
Angry 45.4%
Calm 46.5%
Disgusted 45.2%
Surprised 45.7%
Sad 47%
Happy 49.9%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 52%
Confused 45.3%
Disgusted 50%
Surprised 45.5%
Sad 45.6%
Angry 46.2%
Happy 45.4%
Calm 46.8%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.6%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Happy 49.5%
Sad 49.9%
Angry 49.9%

AWS Rekognition

Age 10-15
Gender Female, 50.2%
Confused 49.6%
Disgusted 49.7%
Sad 49.6%
Angry 50%
Surprised 49.5%
Happy 49.5%
Calm 49.5%

AWS Rekognition

Age 15-25
Gender Male, 50.4%
Surprised 49.6%
Disgusted 49.6%
Sad 49.6%
Calm 49.9%
Confused 49.6%
Angry 49.6%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Female, 95.3%
Calm 32.9%
Surprised 7.3%
Happy 23.8%
Angry 5.3%
Confused 2.4%
Sad 9.8%
Disgusted 18.4%

AWS Rekognition

Age 16-27
Gender Male, 50.3%
Confused 49.6%
Calm 49.5%
Disgusted 49.5%
Sad 50.3%
Happy 49.5%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Confused 49.5%
Disgusted 49.5%
Angry 50%
Calm 49.5%
Sad 49.6%
Happy 49.7%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Calm 49.9%
Confused 49.5%
Happy 49.6%
Disgusted 49.7%
Angry 49.6%
Surprised 49.5%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Angry 49.8%
Happy 49.7%
Calm 49.6%
Confused 49.6%
Sad 49.7%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Confused 49.5%
Disgusted 49.5%
Sad 50.4%
Angry 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Surprised 49.6%
Happy 49.6%
Confused 49.6%
Calm 50%
Disgusted 49.5%
Angry 49.6%
Sad 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Calm 49.6%
Disgusted 49.6%
Happy 49.6%
Confused 49.5%
Surprised 49.5%
Sad 50.2%
Angry 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Happy 49.6%
Disgusted 49.6%
Surprised 49.6%
Sad 49.9%
Confused 49.5%
Angry 49.6%
Calm 49.7%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Calm 49.6%
Angry 49.6%
Happy 50.1%
Sad 49.6%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Confused 49.6%
Disgusted 49.6%
Angry 49.6%
Calm 49.8%
Sad 49.6%
Happy 49.8%
Surprised 49.5%

AWS Rekognition

Age 4-7
Gender Male, 50.2%
Sad 49.9%
Confused 49.6%
Calm 49.9%
Disgusted 49.5%
Angry 49.6%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.5%
Sad 49.7%
Disgusted 49.5%
Angry 49.6%
Happy 49.6%
Calm 49.9%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Happy 45.1%
Calm 45%
Sad 54.8%
Surprised 45%
Angry 45%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Angry 49.8%
Calm 49.9%
Surprised 49.5%
Sad 49.6%
Disgusted 49.5%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Happy 49.5%
Sad 49.8%
Angry 49.9%
Surprised 49.5%
Calm 49.7%
Confused 49.5%
Disgusted 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Disgusted 49.5%
Happy 49.5%
Angry 49.9%
Surprised 49.5%
Sad 50%
Confused 49.5%
Calm 49.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.6%
Person 98%
Person 83.6%
Person 79.5%
Person 75.5%
Person 74.4%
Person 71.7%
Person 67.3%
Person 64.3%
Person 63.6%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people in costumes and costumes -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a lively outdoor gathering in what appears to be a park or open grassy area surrounded by lush trees. A large crowd in formal or festive attire, including women and children in dresses and hats, is gathered in the background. In the foreground, individuals are dressed in what seems to be elaborate costumes featuring feathers or intricate details, possibly indicative of a parade, theatrical performance, or cultural celebration. The setting suggests a communal event or festivity from a historical time period.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a scene taking place outdoors with a large gathering of people. In the foreground, individuals are dressed in costumes that appear to be ornate and possibly theatrical, featuring what seem to be feathers as part of their attire. The background reveals a crowd of spectators, the majority of whom are dressed in light-colored clothing typical of an early 20th-century style, including hats and dresses. Behind the crowd are tall, leafy trees contributing to a park-like setting. The overall atmosphere suggests a festive or eventful occasion, likely a parade or performance, attracting the interest of a sizable audience.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-11

The image appears to be a historical photograph depicting a large crowd of people gathered in an outdoor setting, likely for some kind of ceremonial or cultural event. The crowd is dressed in traditional or ceremonial attire, with some individuals wearing elaborate costumes or headdresses. The background shows a wooded area with a bridge or structure visible in the distance. The overall scene conveys a sense of a lively, festive occasion taking place in a natural setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-11

This appears to be a historical black and white photograph, likely from the early 1900s. In the foreground, there are several figures wearing what appear to be dark costumes or uniforms. In the background, there's a large crowd of people dressed predominantly in white clothing, many holding parasols or umbrellas. The setting appears to be outdoors with trees visible in the background. The image has the characteristic sepia tones and quality typical of early photography. The crowd seems to be gathered for some kind of outdoor event or celebration, with the people in dark clothing possibly being performers or participants in whatever ceremony or activity is taking place.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

The image depicts a vintage black-and-white photograph of a group of people gathered in a park or garden setting. The scene is set against a backdrop of trees and features a large crowd of individuals, with some dressed in white attire and others wearing dark clothing. In the foreground, a group of people are dressed in dark costumes, which appear to be Native American-inspired outfits, complete with feathered headdresses. The overall atmosphere suggests a festive or celebratory event, possibly a cultural or historical reenactment. The image conveys a sense of community and cultural exchange, with the diverse group of people coming together to share in a common experience.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image depicts a lively outdoor gathering, likely a festival or celebration, with a crowd of people dressed in various attire.

  • Crowd of People
    • The crowd is predominantly composed of children and adults, with some individuals wearing traditional clothing and others in more modern attire.
    • The majority of the crowd is dressed in white, with some individuals wearing hats or headpieces.
    • Some people are standing, while others are seated on the grass.
  • Trees and Building
    • In the background, there are several trees and a building visible.
    • The trees appear to be tall and lush, providing shade for the gathering.
    • The building appears to be a small structure, possibly a shed or a pavilion.
  • Grass and Sky
    • The grass is green and well-manicured, suggesting that the gathering is taking place in a park or other outdoor recreational area.
    • The sky is not visible in the image, but it appears to be a sunny day based on the lighting and the shadows cast by the trees.

Overall, the image suggests that the gathering is a joyful and festive occasion, with people coming together to celebrate and enjoy each other's company.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-29

The image is a black-and-white photograph showing a group of people gathered in an outdoor setting. The image appears to be from the early 20th century, based on the clothing and hairstyles of the people in the photo. The people in the foreground are dressed in traditional costumes, with feathered headdresses and long, flowing skirts. They appear to be performing a dance or ritual of some kind. Behind them, a large group of people is gathered, watching the performance. Some of the people in the background are holding umbrellas, suggesting that the event is taking place outdoors. The background of the image is filled with trees and a building, possibly a church or community center.

Created by amazon.nova-pro-v1:0 on 2025-05-29

The image is a black-and-white photograph of a group of people gathered outdoors. The people are dressed in costumes, and they appear to be performing a dance or ritual. The costumes are elaborate and include feathers and other decorative elements. In the background, there are trees and a building with a roof. The people in the background are dressed in white and appear to be watching the performance. The image has a vintage look, suggesting that it may be an old photograph.

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

Here is a description of the image:

This is a vintage black and white photograph depicting a procession of boys dressed in outfits resembling Native American attire, passing in front of a crowd of people. The foreground is filled with grassy terrain, and the boys are adorned with feathered headwear and fringed costumes.

Behind them, a large group of onlookers of various ages is visible. Many of the women and girls in the audience are wearing white dresses and hats. Some people in the crowd are holding umbrellas.

In the background, there's a dense thicket of trees, and a building with a tiled roof can be seen amidst the foliage. The photograph appears to be taken outdoors, possibly during a community event or parade. The style suggests it might be from the early to mid-20th century.

Created by gemini-2.0-flash-lite on 2025-05-28

Here's a description of the image:

The image is a vintage black and white photograph, likely from the early 20th century. It appears to capture a scene of a costumed procession or parade taking place outdoors.

  • Foreground: A group of young people are walking in a line. They are dressed in what seems to be "Native American" costumes. The costumes consist of outfits.
  • Midground: In the distance behind the costumed performers, there is a large crowd of people. Most of the people are young children and women wearing white dresses. Many are also holding umbrellas, suggesting a sunny day.
  • Background: A lush forest forms the backdrop, creating a natural setting. In the middle of the frame a building can be seen
  • Overall Impression: The photograph has a historical feel. It may be capturing a community event, a school play, or a cultural celebration from a bygone era. It captures an era in which it was commonplace to dress in "Native American" costumes.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image appears to be an old black-and-white photograph capturing a large outdoor gathering, likely from the early 20th century. The setting is a grassy area with trees in the background, suggesting a park or a similar open space.

In the foreground, there are several individuals who are out of focus, wearing what appears to be traditional or ceremonial attire, possibly including headdresses and other decorative elements. Their blurred appearance indicates motion, suggesting they might be performing a dance or some form of ritual.

In the background, a large crowd of people is seated on the grass, watching the event. The attendees are dressed in what seems to be formal or semi-formal attire typical of the period, with many women wearing dresses and hats. Some individuals are holding umbrellas, possibly to shield themselves from the sun. The overall atmosphere suggests a communal or cultural event, possibly a festival, ceremony, or public gathering.