Human Generated Data

Title

Social Settlements: United States. Louisiana. New Orleans. Kingsley House: The Kingsley House, New Orleans, La.: The Side Yard.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.270.2

Human Generated Data

Title

Social Settlements: United States. Louisiana. New Orleans. Kingsley House: The Kingsley House, New Orleans, La.: The Side Yard.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.270.2

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Human 99.5
People 80.3
Kindergarten 77.7
Room 73
Indoors 73
Crowd 64.2
Building 63
Audience 57.5
Clothing 57.4
Apparel 57.4
Outdoors 56
Urban 55.1

Clarifai
created on 2025-01-10

people 100
many 99.9
group 99.9
child 99.6
group together 99.3
adult 97.3
war 96.8
boy 96.6
administration 95.4
man 94.4
woman 93
elementary school 91.6
education 91.2
wear 90.5
several 90.2
recreation 88.6
home 88.2
school 88.2
military 87.2
family 86.2

Imagga
created on 2022-06-25

cemetery 35.6
banjo 27.7
stringed instrument 22.6
musical instrument 22.5
groom 16.9
man 16.1
stone 15.1
old 14.6
outdoors 13.4
garden 13.4
people 13.4
person 12.3
love 11
history 10.7
male 10.7
kin 10.6
bride 10.5
child 10.3
portrait 10.3
building 10.3
grass 10.3
holiday 10
girls 10
family 9.8
couple 9.6
architecture 9.4
tree 9.2
wedding 9.2
traditional 9.1
tourism 9.1
religion 9
happy 8.8
married 8.6
men 8.6
outside 8.5
culture 8.5
marriage 8.5
world 8.5
house 8.4
dark 8.3
city 8.3
sky 8.3
park 8.2
day 7.8
happiness 7.8
antique 7.8
ancient 7.8
travel 7.7
ball 7.7
two 7.6
pumpkin 7.5
dress 7.2
smile 7.1
face 7.1

Google
created on 2022-06-25

Building 74.7
Monochrome 73.6
Event 73.4
Monochrome photography 72.2
Hat 69
Crowd 66.2
History 66.1
Room 64.9
Vintage clothing 62.7
Child 59.9
Class 58.4
House 56.6
Toddler 56.3

Microsoft
created on 2022-06-25

person 98.4
clothing 95.8
indoor 87.8
old 85
house 78.8
black 72.1
group 71.9
man 64.4
people 60.3
woman 56.4
posing 47.5
vintage 32.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 4-12
Gender Male, 58.4%
Surprised 95.1%
Angry 9.9%
Sad 7.8%
Fear 7.4%
Confused 6.8%
Calm 2.7%
Disgusted 1%
Happy 0.7%

AWS Rekognition

Age 1-7
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 5.9%
Angry 0.5%
Calm 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 2-10
Gender Male, 97.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Calm 0.2%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 74.6%
Sad 100%
Fear 7.7%
Surprised 6.7%
Disgusted 5.5%
Confused 2.8%
Calm 0.8%
Angry 0.5%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Female, 54.6%
Sad 68.9%
Calm 50.2%
Angry 10.4%
Fear 7.9%
Surprised 6.4%
Disgusted 1.3%
Happy 0.5%
Confused 0.3%

AWS Rekognition

Age 6-14
Gender Female, 100%
Sad 87.4%
Calm 34.1%
Fear 9.9%
Surprised 6.8%
Angry 6.3%
Happy 5.1%
Disgusted 3%
Confused 1.8%

AWS Rekognition

Age 19-27
Gender Female, 100%
Surprised 59.1%
Confused 30.3%
Calm 13.6%
Fear 10.8%
Sad 5.7%
Disgusted 1.4%
Angry 1.1%
Happy 0.9%

AWS Rekognition

Age 2-8
Gender Female, 89%
Sad 91.6%
Angry 45.5%
Confused 8%
Surprised 6.4%
Fear 6.4%
Calm 0.9%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 100%
Sad 87%
Angry 38.4%
Calm 14.5%
Surprised 6.5%
Fear 6.3%
Disgusted 2.4%
Confused 2%
Happy 1.1%

AWS Rekognition

Age 6-12
Gender Female, 84.5%
Sad 100%
Fear 7.9%
Surprised 6.6%
Angry 4.3%
Calm 2.9%
Confused 2.5%
Disgusted 1.5%
Happy 0.4%

AWS Rekognition

Age 24-34
Gender Female, 59.1%
Calm 54%
Fear 14.3%
Surprised 10.8%
Angry 8.1%
Happy 7.4%
Sad 4.1%
Confused 2.3%
Disgusted 1.9%

AWS Rekognition

Age 2-10
Gender Female, 99.3%
Sad 99.9%
Calm 11%
Fear 6.5%
Surprised 6.5%
Confused 3.4%
Angry 2.4%
Disgusted 1.5%
Happy 1.4%

AWS Rekognition

Age 6-14
Gender Female, 50.4%
Happy 68.2%
Calm 25.7%
Surprised 6.4%
Fear 6.2%
Sad 3.3%
Angry 1.2%
Disgusted 0.4%
Confused 0.1%

AWS Rekognition

Age 4-12
Gender Male, 95.6%
Fear 46.7%
Calm 31.3%
Surprised 29.8%
Sad 2.8%
Happy 2%
Disgusted 1.5%
Confused 1.4%
Angry 0.9%

AWS Rekognition

Age 6-12
Gender Female, 94%
Calm 84.1%
Fear 10.9%
Surprised 6.7%
Sad 2.5%
Confused 1.8%
Angry 1.7%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 16-22
Gender Female, 50.9%
Sad 99.7%
Calm 14.8%
Surprised 7.8%
Fear 7.7%
Disgusted 6.2%
Happy 2.1%
Angry 1.8%
Confused 1.5%

AWS Rekognition

Age 18-26
Gender Male, 68.2%
Sad 37.4%
Calm 27.6%
Surprised 20.8%
Fear 14.8%
Angry 6.4%
Happy 5.7%
Confused 3.1%
Disgusted 2.8%

AWS Rekognition

Age 23-33
Gender Male, 87.3%
Calm 50.1%
Happy 44.1%
Surprised 6.6%
Fear 6.1%
Sad 2.8%
Disgusted 1.1%
Angry 1.1%
Confused 0.4%

AWS Rekognition

Age 18-26
Gender Female, 56.9%
Fear 73.6%
Calm 34.6%
Surprised 6.8%
Sad 4%
Disgusted 1.2%
Confused 1.1%
Angry 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person

Clarifai

Clothing
Human face
Footwear
Human hair
Plant

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 98%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 94.4%

AWS Rekognition

Person 93.9%

AWS Rekognition

Person 93.6%

AWS Rekognition

Person 89.5%

AWS Rekognition

Person 84.2%

AWS Rekognition

Person 83.5%

AWS Rekognition

Person 75.1%

AWS Rekognition

Person 68.6%

AWS Rekognition

Person 67.4%

AWS Rekognition

Person 59.1%

AWS Rekognition

Person 56.2%

AWS Rekognition

Person 55.3%

AWS Rekognition

Person 50.9%

Clarifai

Clothing 90%

Clarifai

Clothing 88.5%

Clarifai

Clothing 84.3%

Clarifai

Clothing 83.2%

Clarifai

Clothing 81.7%

Clarifai

Clothing 81.4%

Clarifai

Clothing 78.9%

Clarifai

Clothing 78.7%

Clarifai

Clothing 78.5%

Clarifai

Clothing 77.4%

Clarifai

Clothing 75.5%

Clarifai

Clothing 72.7%

Clarifai

Clothing 69.6%

Clarifai

Clothing 69.2%

Clarifai

Clothing 68%

Clarifai

Clothing 66.9%

Clarifai

Clothing 66.2%

Clarifai

Clothing 64.9%

Clarifai

Clothing 64.7%

Clarifai

Clothing 58.6%

Clarifai

Clothing 57.8%

Clarifai

Clothing 48.1%

Clarifai

Clothing 47.2%

Clarifai

Clothing 44.2%

Clarifai

Clothing 41.4%

Clarifai

Clothing 39.9%

Clarifai

Clothing 38.6%

Clarifai

Clothing 37.8%

Clarifai

Clothing 36.2%

Clarifai

Clothing 35.6%

Clarifai

Clothing 35.5%

Clarifai

Clothing 35.5%

Clarifai

Clothing 35.3%

Clarifai

Clothing 34.8%

Clarifai

Clothing 33.9%

Clarifai

Human face 79.8%

Clarifai

Human face 79.3%

Clarifai

Human face 79.1%

Clarifai

Human face 76%

Clarifai

Human face 74.6%

Clarifai

Human face 71.5%

Clarifai

Human face 71.5%

Clarifai

Human face 70.7%

Clarifai

Human face 69.4%

Clarifai

Human face 65.1%

Clarifai

Human face 62.4%

Clarifai

Human face 61.8%

Clarifai

Human face 60.6%

Clarifai

Human face 50.7%

Clarifai

Human face 45.6%

Clarifai

Human face 45.2%

Clarifai

Human face 44.6%

Clarifai

Human face 40.6%

Clarifai

Human face 40.2%

Clarifai

Human face 38.5%

Clarifai

Human face 35.8%

Clarifai

Human face 33.6%

Clarifai

Footwear 60.6%

Clarifai

Footwear 59.3%

Clarifai

Footwear 54.9%

Clarifai

Footwear 52.7%

Clarifai

Footwear 52.6%

Clarifai

Footwear 52%

Clarifai

Footwear 50.9%

Clarifai

Footwear 50.4%

Clarifai

Footwear 49.6%

Clarifai

Footwear 47.5%

Clarifai

Footwear 45.2%

Clarifai

Footwear 43.8%

Clarifai

Footwear 39.4%

Clarifai

Footwear 39.2%

Clarifai

Footwear 39%

Clarifai

Footwear 37.1%

Clarifai

Footwear 35.9%

Clarifai

Footwear 35.4%

Clarifai

Footwear 34.7%

Clarifai

Footwear 33.5%

Clarifai

Human hair 37.9%

Clarifai

Human hair 35.4%

Clarifai

Human hair 34.8%

Clarifai

Human hair 34.5%

Clarifai

Plant 35.4%

Categories

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of children sitting on the grass

Created by general-english-image-caption-blip-2 on 2025-07-07

children in the yard of the new york state school for the deaf and dumb, new y

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a group of children gathered outdoors, seated in a circular formation on a grassy surface. A few children are standing nearby. In the background, there is a wooden structure with climbing vines and a large cylindrical tank or silo on the left. Further back, several children are playing on a swing set. The setting appears to be a yard or playground area, surrounded by buildings in a residential area. The photo has a vintage, historical feel due to the clothing and overall composition.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a group of children seated on a grassy area, arranged in a circular formation. They appear to be engaged in some sort of outdoor activity or game. In the background, there is a group of children sitting on a swing set, along with an adult. The setting seems to be a yard surrounded by buildings, with one building covered in vertical siding. Climbing plants can be seen on the wall, adding a touch of greenery. The children are dressed in early 20th-century attire, indicating that the photograph is historical.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of children gathered outdoors in what appears to be a backyard or garden area. The children, both boys and girls, are sitting on the grass and seem to be engaged in some kind of activity or gathering. There are also some adults visible in the background, seated on a porch or balcony. The overall scene conveys a sense of a warm, social gathering or event taking place in a residential setting from an earlier time period, likely in the late 19th or early 20th century based on the style of clothing and surroundings.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a historical black and white photograph, likely from the early 1900s, showing a group of children sitting in a circle on grass or a lawn area. The setting appears to be in a backyard or outdoor space with wooden buildings or houses visible in the background. The children are dressed in period clothing - many of the children are wearing white dresses or shirts typical of that era. The image has a candid, documentary-style quality to it, possibly capturing a school activity, social gathering, or organized children's event. In the background, you can see some children standing or playing near the wooden structures. The photograph provides an interesting glimpse into what appears to be urban or suburban life during that historical period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a black-and-white photograph of a group of children gathered in a circle on the grass, with one child standing at the edge of the circle. The children are dressed in casual attire, with some wearing dresses and others wearing shirts and pants. They appear to be engaged in some form of activity or game, although the exact nature of their play is unclear.

In the background, several adults can be seen standing or sitting on the porch of a house, watching the children. The house itself is made of wood and features a wooden fence surrounding the yard. A few plants and trees are visible in the yard, adding a touch of greenery to the scene.

Overall, the image captures a carefree and joyful moment in the lives of these young children, surrounded by the warmth and comfort of their home environment.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image is a black-and-white photograph of a group of children sitting in a circle on the grass, with a few adults standing in the background. The children are dressed in old-fashioned clothing, and the scene appears to be set in a rural or suburban area.

The children are seated in a circle, facing each other, and appear to be engaged in some sort of activity or game. Some of them are looking at the camera, while others are focused on the activity at hand. The adults in the background are standing near a building, possibly a house or barn, and seem to be supervising the children.

The overall atmosphere of the image is one of innocence and simplicity, capturing a moment in time when children were able to play and enjoy each other's company without the distractions of modern technology. The image also suggests a sense of community and social bonding among the children, as they gather together to share in an activity.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white photo depicts a group of children sitting on the ground in a circle, possibly in a backyard. The children are dressed in white, and some are wearing hats. A girl in the middle is standing, while the others are sitting. Behind them, there is a wooden house with a fence and a barrel. In the distance, there are more houses, and some people are sitting on the bench.

Created by amazon.nova-lite-v1:0 on 2025-06-02

The black-and-white photo shows a group of children sitting on the ground in a circle. The children are all wearing white dresses and white shirts. One child is standing in the middle of the circle, perhaps leading a game or activity. Behind the children, there are houses and a wooden barrel. The photo is a bit blurry, and it appears to be an old photo.

Google Gemini

Created by gemini-2.0-flash on 2025-05-30

The image shows a vintage black and white photograph of a group of children in an outdoor setting. Most of the children are seated in a circle on the grass, facing inwards. They appear to be in the midst of an activity or game.

A few older children stand or sit on the steps of a building in the background, observing the younger children. A wooden building stands to the right of the frame, with climbing plants growing up its side. To the left, there is a tall, cylindrical structure, possibly a silo or water tower, made of wooden planks.

The background also includes other buildings, which suggest the scene is set in a residential area. The lighting in the photo is somewhat diffused, contributing to the image's antique feel. The overall impression is one of a simple, communal childhood activity in a bygone era.

Created by gemini-2.0-flash-lite on 2025-05-30

Here is a description of the image:

The image is a black and white photograph of a group of children gathered outdoors. The scene appears to be from the early 20th century. A majority of the children are seated in a large circle on a grassy area. Most of the children are wearing light colored clothing, some of them also have bows in their hair. In the center of the circle, one girl stands and looks towards the camera. In the background, near a large wooden structure, a group of older children or young adults are sitting on a porch. The scene has a nostalgic feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a group of children gathered outdoors, likely in a school or community setting. The children are seated on the grass in a semi-circle, facing towards the camera. They are dressed in clothing typical of the early 20th century, with the girls wearing dresses and the boys in shirts and pants. One girl, standing to the right of the group, appears to be older or possibly a teacher.

In the background, there are several adults, including a man and a woman, who seem to be engaged in conversation or observing the children. The setting includes a wooden building with a porch, and there are potted plants and a wooden fence visible. The overall atmosphere suggests a casual, community gathering or a school event from a bygone era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

This is a black-and-white photograph depicting a group of children gathered outdoors. The setting appears to be a yard or garden, with a wooden building and a silo visible in the background. The children are sitting in a semi-circle on the grass, and some are facing the camera, while others are looking in different directions. The children are dressed in light-colored clothing, which suggests this may have been taken in the early to mid-20th century. A few adults are also present near the building, seated on the ground. The overall atmosphere of the image conveys a sense of casual outdoor activity, possibly a group gathering or a lesson.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This black-and-white image appears to depict a gathering of children and adults from an earlier time period, likely the early 20th century. The children are seated in a circle on the grass, while several adults are standing or sitting on a wooden bench in the background. There is a wooden building or shed on the right side of the image, and a cylindrical structure, possibly a water tank or silo, on the left. The setting seems to be outdoors, possibly in a backyard or community area. The clothing styles and the overall scene suggest a historical or nostalgic context.

Text analysis

Amazon

S

Google

Meat