Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: Lake and Woods.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3044.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: Lake and Woods.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3044.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Hand 99.6
Holding Hands 99.4
Human 99.4
People 87.7
Clothing 73.5
Apparel 73.5
Pants 58.9
Plant 58.5

Clarifai
created on 2019-06-06

people 99.9
child 99.3
two 97.2
boy 96
group 95.2
man 93.8
group together 92.6
family 92.2
sibling 90.1
adult 88.9
son 88.8
wear 88.4
three 85.4
affection 84.3
war 83.3
offspring 80.6
sepia 76.4
monochrome 76.3
four 75.7
portrait 74.8

Imagga
created on 2019-06-06

child 59.8
beach 52.1
sand 34
man 32.4
sea 32.1
mother 29.7
parent 29.6
male 29.6
people 27.4
vacation 26.2
happiness 24.3
sunset 24.3
summer 23.8
lifestyle 23.1
outdoors 22.9
happy 22.6
love 22.1
water 22
couple 21.8
ocean 21.8
family 21.4
person 20.7
adult 20.7
fun 20.2
together 20.2
walking 19.9
sky 19.8
father 19.6
kin 19.3
dad 18.9
silhouette 18.2
sibling 17
outdoor 16.8
juvenile 16.6
walk 16.2
two 16.1
shore 15.8
holiday 15.8
boy 15.7
active 15.3
coast 15.3
kid 15.1
joy 14.2
leisure 14.1
play 13.8
playing 13.7
brother 13.1
smiling 13
sun 12.9
outside 12.8
romance 12.5
running 12.5
son 12.3
relationship 12.2
relax 11.8
run 11.6
holding 11.6
hands 11.3
evening 11.2
youth 11.1
portrait 11
girls 10.9
sunlight 10.7
sport 10.4
sunny 10.3
relaxation 10.1
smile 10
travel 9.9
recreation 9.9
boyfriend 9.6
girlfriend 9.6
dusk 9.5
women 9.5
men 9.5
healthy 9.5
day 9.4
clothing 9.4
life 9.1
romantic 8.9
daughter 8.9
sexy 8.8
jump 8.6
kids 8.5
casual 8.5
coastline 8.5
attractive 8.4
pretty 8.4
health 8.3
children 8.2
exercise 8.2
autumn 7.9
grass 7.9
swimsuit 7.9
standing 7.8
black 7.8
sandy 7.8
jumping 7.7
loving 7.6
vacations 7.5
friends 7.5
free 7.5
sunshine 7.5
waves 7.4
cheerful 7.3
childhood 7.2
river 7.1
look 7

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

outdoor 98.4
ground 96.9
clothing 96.2
child 86.8
person 86.3
athletic game 79.7
man 77.9
boy 77.4
white 72.3
player 69.8
black 68.5
old 53.8

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 45-66
Gender Male, 53.4%
Disgusted 45.5%
Confused 45.7%
Happy 46.4%
Sad 50.4%
Surprised 45.6%
Calm 45.9%
Angry 45.6%

AWS Rekognition

Age 60-90
Gender Male, 54%
Confused 45.2%
Sad 46.2%
Disgusted 45.3%
Angry 45.3%
Happy 46.2%
Calm 51.5%
Surprised 45.2%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person

Clarifai

Tree
Man
Clothing
Footwear
Human face

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99%

Clarifai

Tree 89.7%

Clarifai

Tree 59.7%

Clarifai

Man 88.8%

Clarifai

Clothing 86.8%

Clarifai

Clothing 67.7%

Clarifai

Footwear 53.3%

Clarifai

Footwear 49.7%

Clarifai

Footwear 48.1%

Clarifai

Human face 43.9%

Clarifai

Human face 41.9%

Categories

Imagga
created on 2019-06-06

nature landscape 51.5%
pets animals 40.1%
beaches seaside 7.4%

Captions

Microsoft
created by unknown on 2019-06-06

a black and white photo of a man 93.2%
a vintage photo of a man 93.1%
a black and white photo of a boy 74.2%

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

two men shaking hands in front of a tree

Created by general-english-image-caption-blip on 2025-05-20

a photograph of two men shaking hands in a field

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-06-23

The response was filtered due to the prompt triggering Azure OpenAI's content management policy. The content filter results follow.

hate: safe
self-harm: safe
sexual: safe
violence: high

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image shows two men standing in a wooded area, shaking hands. They appear to be wearing hiking or camping gear, suggesting they may be outdoors on some kind of expedition or journey together. The background is lush and green, with trees and foliage visible. The image has a vintage, black and white aesthetic, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a vintage black and white photograph showing two Boy Scouts shaking hands outdoors. Both are wearing typical Scout uniforms of the era, including knee-high socks and what appears to be Scout shirts. They each have backpacks or camping gear strapped to their backs, suggesting they might be at a camping event or on a hiking expedition. The setting appears to be in a wooded area with dappled sunlight filtering through the trees in the background. The image captures what seems to be a formal Scout greeting or perhaps a farewell moment between fellow Scouts.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image is a black and white photograph of two men shaking hands.

The man on the left has short dark hair and is wearing a light-colored shirt, dark pants, and dark shoes. He is also wearing a backpack and has a bag slung over his right shoulder. The man on the right has short dark hair and is wearing a light-colored shirt with a dark "H" on it, dark pants, and dark shoes. He is also wearing a backpack and has a bag slung over his left shoulder.

The background of the image is blurry but appears to be a wooded area with trees and bushes. There is a small white sign on the ground in the background with some writing on it, but it is not legible.

The overall atmosphere of the image suggests that the two men are meeting for the first time or saying goodbye to each other. They are standing in a natural setting, and their body language suggests a sense of respect and friendship.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

The image depicts two men shaking hands in a wooded area, with the man on the left wearing a backpack and the man on the right carrying a large bag. The scene appears to be set in a forest or wooded area, with trees and foliage visible in the background. The overall atmosphere of the image suggests a sense of camaraderie and friendship between the two men, as they share a moment of mutual respect and appreciation.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image shows two men standing in a forest area, shaking hands. Both men are wearing uniforms, and one of them is carrying a bag. The man on the left has a backpack and is wearing a hat, while the man on the right is wearing a hat and has a bag on his back. The photo has a black border and a watermark in the top left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white image shows two men standing in an outdoor area, possibly in a forest. They are both wearing long-sleeved shirts, pants, and boots. Both of them are carrying backpacks. They are holding hands, probably saying goodbye to each other. Behind them, there is a sign with the text "St 23" on it. The area is surrounded by trees and grass.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

Overall Impression: The image is a vintage black and white photograph. It captures a moment of camaraderie between two men outdoors.

Composition:

  • Subject: Two men are the central focus, standing and shaking hands. They are both dressed similarly with what appears to be hiking gear.
  • Setting: The background is a natural outdoor scene, likely a park or wooded area. There's lush foliage and trees providing a backdrop.
  • Lighting: The lighting suggests it's a sunny day, creating shadows and a somewhat soft overall effect.

Details:

  • The men are wearing light-colored, long-sleeved shirts, shorts that go to the knee, knee-high socks, and boots. They both carry large backpacks.
  • The man on the right appears to have a logo or emblem on his shirt.
  • A sign in the background is partially visible, with the markings "SB 23".

Mood and Tone: The photo evokes a feeling of friendship, possibly adventure, and a simpler time. It has a nostalgic and historical feel.

Created by gemini-2.0-flash on 2025-05-01

Here's a description of the image:

The black-and-white photograph shows two men, possibly in their late teens or early twenties, shaking hands. They are both dressed in similar clothing: light-colored, long-sleeved shirts, breeches, dark socks, and boots. Each man has a large backpack or bedroll slung over their shoulder. The man on the left is in profile, facing right, while the man on the right is facing left. The man on the right has what appears to be an "H" patch on the left shoulder of his shirt.

The setting appears to be outdoors, with a grassy or dirt area in the foreground. Behind the men, there is dense foliage, possibly trees or shrubs. In the lower left corner of the frame, there is what appears to be a sign or marker with some writing on it, though the writing is difficult to decipher. The photograph has a vintage feel, likely taken in the early to mid-20th century. The overall tone is one of camaraderie or a formal farewell.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a vintage black-and-white photograph depicting two men shaking hands outdoors. Both men are dressed in what appears to be military uniforms, which include short-sleeved shirts, trousers, and boots. They are carrying large backpacks, suggesting they might be on a march or a journey. The background shows a natural setting with trees and foliage, indicating they are in a forested or rural area. There is a vehicle in the background, partially obscured by the trees, which has some markings on it, possibly indicating a unit or designation. The overall atmosphere of the image suggests camaraderie and possibly a moment of departure or arrival during a military operation or training exercise. The photograph has an old, sepia-toned quality, giving it a historical feel.

Qwen