Human Generated Data

Title

Social Settlements: United States. New York. New York City. "University Settlement": University Settlement, New York City.: Basket Ball and Base Ball Teams at Recreation Center. Public School No. 20 Near Settlement.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3203.1

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "University Settlement": University Settlement, New York City.: Basket Ball and Base Ball Teams at Recreation Center. Public School No. 20 Near Settlement.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3203.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.7
Human 99.7
Person 99.5
Person 99.4
Person 99.2
Person 99.1
Person 98.9
Person 98.8
Person 98.6
People 91.3
Clothing 86.1
Apparel 86.1
Shorts 86.1
Transportation 73
Vehicle 71.6
Oars 67.6
Field 60.3
Vessel 60.1
Watercraft 60.1
Person 59.6
Team Sport 58
Team 58
Sports 58
Sport 58
Brick 56.6

Clarifai
created on 2019-06-06

people 99.8
group together 99.4
child 97.9
wear 96.8
group 96.2
adult 95.5
man 93.7
two 92
many 91.9
recreation 91.4
several 90.2
four 90.1
boy 89.8
three 89.1
woman 88.7
fun 84.5
athlete 83.5
five 83.2
competition 82.7
sibling 82.5

Imagga
created on 2019-06-06

fountain 100
structure 100
grunge 42.6
texture 38.2
old 29.3
antique 27.7
aged 27.1
vintage 26.5
pattern 24.6
dirty 24.4
grungy 23.7
wallpaper 23
frame 22.5
wall 21.4
border 20.8
art 19.5
design 19.1
surface 18.5
paint 18.1
retro 18
textured 17.5
rough 17.3
damaged 17.2
decoration 16.8
paper 15.7
canvas 15.2
color 15
space 14.7
water 14.7
graphic 14.6
negative 13.8
edge 13.5
aging 13.4
cool 13.3
weathered 13.3
brown 13.2
backdrop 13.2
ancient 13
stain 12.5
text 12.2
material 11.6
messy 11.6
decay 11.6
stained 11.5
natural 10.7
parchment 10.6
backgrounds 10.5
dirt 10.5
rusty 10.5
artistic 10.4
cold 10.3
empty 10.3
blank 10.3
light 10
decorative 10
film 9.7
worn 9.5
ice 9.5
stone 9.4
artwork 9.2
close 9.1
black 9
graffito 9
burnt 8.7
crack 8.7
rust 8.7
detailed 8.7
obsolete 8.6
card 8.5
travel 8.4
blackboard 8.4
dark 8.3
silhouette 8.3
effect 8.2
digital 8.1
detail 8
ocean 7.9
splash 7.9
scratches 7.9
forest 7.8
noise 7.8
grime 7.8
stains 7.8
snow 7.7
textures 7.6
sheet 7.5
grain 7.4
drop 7.3
drawing 7.1

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

outdoor 97.3
clothing 96.9
person 96.5
old 95
smile 91.8
woman 78.1
man 73.5
human face 71
posing 47.7
vintage 29.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 15-25
Gender Male, 53.1%
Confused 45.2%
Disgusted 45.1%
Calm 50.3%
Sad 48.2%
Angry 45.9%
Happy 45.1%
Surprised 45.1%

AWS Rekognition

Age 26-44
Gender Female, 50.8%
Confused 45.1%
Disgusted 45%
Sad 46.4%
Angry 45.1%
Surprised 45.1%
Happy 45.1%
Calm 53.2%

AWS Rekognition

Age 20-38
Gender Male, 53.1%
Angry 45.3%
Happy 46.8%
Confused 45.1%
Surprised 45.2%
Sad 46.7%
Disgusted 45.2%
Calm 50.6%

AWS Rekognition

Age 16-27
Gender Female, 51.6%
Confused 45.3%
Calm 51.6%
Disgusted 45.2%
Sad 47%
Happy 45.2%
Angry 45.5%
Surprised 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Calm 45.5%
Happy 54%
Sad 45.2%
Angry 45.1%
Disgusted 45.1%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Sad 46%
Calm 53.7%
Happy 45.1%
Surprised 45%
Angry 45.1%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 19-36
Gender Male, 54.3%
Calm 51.2%
Confused 45.3%
Happy 45.4%
Surprised 45.2%
Angry 45.2%
Disgusted 45.1%
Sad 47.4%

AWS Rekognition

Age 19-36
Gender Female, 50%
Disgusted 45%
Happy 46.1%
Angry 45.3%
Surprised 45%
Sad 53.3%
Confused 45.1%
Calm 45.2%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Person 99.7%
Person 99.5%
Person 99.4%
Person 99.2%
Person 99.1%
Person 98.9%
Person 98.8%
Person 98.6%
Person 59.6%

Categories

Imagga

paintings art 83.9%
pets animals 10.7%
nature landscape 4.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of men standing in front of a field -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image depicts an old sports team, likely a basketball team from 1901, given the number written on the basketball held by one of the seated players. The group consists of seven individuals. Four players are seated in the front row, wearing tank tops and athletic attire. Behind them, two individuals dressed casually (one in a cardigan-style sweater and one wearing pants and a tank top) are standing, alongside a formally dressed individual wearing a suit. The setting appears to be outdoors in a grassy area, with flags on either side of the group.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image is a sepia-toned photograph of a vintage sports team, likely from the early 20th century. Five members of the team are seated on the grass in the front row, wearing sleeveless shirts and shorts. One of them is holding a basketball inscribed with "1901," indicating the possible year of the photograph. There are two additional individuals standing behind the seated row, one of whom is wearing a suit, suggesting they might be the coach or manager. The background features a grassy area with some vegetation, and a fence is visible at the top of the image. Two small pennants are positioned at either end of the group.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to be a black and white photograph of a group of people, likely from the early 20th century. The group consists of several men and women, some sitting and some standing, in an outdoor setting with a grassy field and some foliage in the background. The individuals are dressed in clothing typical of the time period, with the men wearing suits and the women wearing dresses. The image has a somewhat grainy and aged appearance, suggesting it is an old photograph.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

The image is a sepia-toned photograph of a group of men posing in a field. The men are arranged in two rows, with the back row standing and the front row sitting on the ground.

In the back row, there are three men. The man on the left is wearing a light-colored jacket and dark pants, while the man in the middle is wearing a dark tank top and shorts. The man on the right is dressed in a dark suit and tie.

In the front row, there are five men sitting on the ground. They are all wearing dark tank tops and shorts or pants. One of the men in the middle is holding a basketball with the year "1907" written on it.

The background of the image shows a grassy field with some bushes and trees in the distance. There appears to be a fence or wire running along the top of the hill behind the men. The overall atmosphere of the image suggests that it was taken during a sports event or team photo shoot, possibly for a school or community team.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image is a sepia-toned photograph of a group of young men posing for a team photo, likely from the early 20th century.

  • Background:
    • The background of the image is a grassy field with bushes and trees in the distance.
    • A fence can be seen in the top right corner of the image.
  • Team Members:
    • There are nine team members in the image.
    • Seven of them are sitting on the ground, while two are standing behind them.
    • The team members are all wearing dark-colored tank tops or jerseys.
    • Some of them are also wearing shorts or pants.
    • One of the team members is holding a basketball with the number "1907" written on it.
  • Facilities:
    • There are two flags visible in the image, one on either side of the team.
    • The flags appear to be triangular in shape and have a dark color.
  • Overall:
    • The image appears to be a vintage photograph of a sports team, possibly a basketball team.
    • The team members are all dressed in athletic attire, and the presence of a basketball suggests that they are a sports team.
    • The image may have been taken at a sports event or during a team practice.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-25

The image is a black-and-white photograph depicting a group of people, likely a sports team, posing for a picture in an outdoor setting. The group consists of seven individuals, with three of them standing at the back and four sitting in the front. The person in the middle of the front row is holding a trophy, indicating that they have won a competition. The team members are dressed in sports attire, and some of them are wearing socks. The background of the image shows a grassy field.

Created by amazon.nova-pro-v1:0 on 2025-05-25

The image has a sepia filter and shows a group of young men, possibly a sports team, posing for a photograph. The men are wearing sleeveless shirts and shorts. The man in the middle is holding a trophy, and the man on the left is holding a flag. The men are sitting on the grass, and three men are standing behind them. The background is blurry, but it appears to be a grassy field.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall Impression:

The image is a sepia-toned, vintage photograph. It appears to be a team photo of a group of young men, likely a sports team, taken outdoors.

Composition:

  • Arrangement: There are nine individuals arranged in two rows. Three people are standing in the back row, while six are seated or kneeling in the front.
  • Setting: The backdrop appears to be a field or grassy area, with some vegetation and a fence in the distance.
  • Focus: The image is in focus, and the subjects are the clear focus of the photograph.

People:

  • Clothing: The individuals are dressed in attire that suggests the photo was taken sometime in the early 20th century. They are wearing jerseys, shorts, and knee-high socks. One person in the back row is wearing a suit, and one is wearing a cardigan.
  • Pose: The people are posing for a team photo. Some of them are holding props, like a trophy that reads "1907" and some type of flag.
  • Appearance: The men are young, with short hair.

Details:

  • The people are likely a sports team (basketball).
  • The photograph is in excellent condition.

Overall, the image conveys a sense of history, perhaps of a high school or college sports team from the early 1900s.

Created by gemini-2.0-flash on 2025-04-29

Here is a description of the image:

The image shows a sepia-toned photograph of a basketball team from 1907 posing in a field. There are eight people in total: five seated in the front row and three standing in the back.

The seated players are wearing tank tops and shorts or knee-length pants. One player in the center holds a basketball with "1907" inscribed on it. A couple of the players appear to have what looks like a trophy with them. Two dark-colored pennants sit on either side of the group.

In the back, one individual is wearing a cardigan sweater, another is wearing a tank top with belted trousers, and the third is wearing a suit. The background consists of a field with sparse vegetation and a wire fence.

The photograph has a vintage quality, likely due to its age.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-27

The image appears to be a vintage photograph of a sports team, likely from the early 20th century. The photograph is sepia-toned, which was common for photographs of that era. Here is a detailed description:

  • Setting: The photograph is taken outdoors in a grassy field. The background includes some trees and possibly a building or structure.
  • Team Members: The team consists of seven individuals, all of whom appear to be young men.
  • Poses:
    • Three individuals are standing in the back row. The person on the far left is wearing a light-colored sweater with buttons, the middle person is wearing a dark tank top and pants, and the person on the far right is dressed in a suit and tie, suggesting he might be a coach or manager.
    • Four individuals are seated or kneeling in the front row. They are all dressed in dark tank tops and shorts, typical athletic attire of the time.
  • Props:
    • The individual in the center of the front row is holding a trophy cup, indicating that the team may have won a competition.
    • There are two pennants on either side of the front row, one on the left and one on the right. The pennant on the left has the year "1909" visible on it, suggesting the photograph was taken around that year.

The overall composition and attire of the individuals suggest that this is a team photo, possibly for a sports team that achieved some success, as indicated by the trophy.

Text analysis

Amazon

190

Google

190
190