Human Generated Data

Title

Untitled (squatter's camp, near U.S. Highway 70, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2080

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (squatter's camp, near U.S. Highway 70, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2080

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Face 100
Head 100
Photography 100
Portrait 100
Sun Hat 99.9
Outdoors 61.9
Smoke 61.1
Plant 57.9
Tree 57.9
Body Part 56.8
Finger 56.8
Hand 56.8
Lady 56.4

Clarifai
created on 2018-05-10

people 100
lid 99.6
one 99.5
adult 98.8
veil 98.5
wear 98.1
child 97.9
two 95
cowboy hat 94.1
portrait 94.1
man 90.2
cowboy 89.3
woman 88.3
boy 87.2
facial expression 86.8
recreation 83
farming 82.3
elderly 82
gun 79.3
war 78.2

Imagga
created on 2023-10-06

hat 91.8
sombrero 52.4
headdress 46.6
clothing 33.8
person 30.1
man 27.6
portrait 25.9
cowboy hat 25.8
male 25.6
outdoors 23.9
people 22.9
happy 20.1
cowboy 17.9
smile 17.1
covering 17.1
consumer goods 16.5
lifestyle 15.2
senior 15
adult 14.9
smiling 14.5
face 14.2
child 13.3
shirt 13.1
ballplayer 12.9
weapon 12.8
athlete 12.7
leisure 12.5
outdoor 12.2
hand 12.2
human 12
old 11.9
happiness 11.8
player 11.7
western 11.6
straw 11.6
summer 11.6
pretty 11.2
outside 11.1
hold 11.1
guy 11
gun 10.9
sport 10.9
fun 10.5
men 10.3
model 10.1
cute 10
handsome 9.8
fashion 9.8
attractive 9.8
sky 9.6
water 9.3
two 9.3
beach 9.3
farmer 9.1
cheerful 8.9
posing 8.9
sexy 8.8
looking 8.8
hair 8.7
casual 8.5
mature 8.4
field 8.4
one 8.2
recreation 8.1
rustic 8.1
boy 7.8
contestant 7.7
married 7.7
tropical 7.7
elderly 7.7
husband 7.6
wearing 7.6
healthy 7.6
head 7.6
joy 7.5
style 7.4
alone 7.3
playing 7.3
sun 7.2
romance 7.1
romantic 7.1
love 7.1
day 7.1
autumn 7
look 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.9
tree 99
person 98.7

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 36-44
Gender Female, 99.4%
Sad 94.3%
Calm 39%
Angry 12.8%
Surprised 6.5%
Fear 5.9%
Confused 0.5%
Disgusted 0.5%
Happy 0.2%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Female
Woman
Hat

Clarifai

Tree
Human face
Sun hat
Human hand
Human arm
Human nose
Human eye

AWS Rekognition

Person 99.4%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Female 99.4%

AWS Rekognition

Woman 99.4%

AWS Rekognition

Hat 99.1%

Clarifai

Tree 94.9%

Clarifai

Tree 65.6%

Clarifai

Tree 60.9%

Clarifai

Tree 54.9%

Clarifai

Tree 41.1%

Clarifai

Tree 38.7%

Clarifai

Tree 36.8%

Clarifai

Tree 34.3%

Clarifai

Tree 33.4%

Clarifai

Human face 93.4%

Clarifai

Sun hat 83%

Clarifai

Human hand 52.7%

Clarifai

Human hand 36.7%

Clarifai

Human arm 44.7%

Clarifai

Human nose 43.5%

Clarifai

Human eye 33.1%

Categories

Imagga
created on 2023-10-06

paintings art 54.2%
nature landscape 21.7%
streetview architecture 19.2%
beaches seaside 1.8%
pets animals 1.1%

Captions

Microsoft
created by unknown on 2018-05-10

a boy wearing a hat 74.4%
a young boy wearing a hat 62.5%
a person wearing a hat 62.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a woman in a straw hat holding a large wooden stick

Created by general-english-image-caption-blip-2 on 2025-07-08

a woman holding a stick in her hand while wearing a hat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image shows a person carrying a wooden beam on their shoulder with one hand, while wearing a woven straw hat and a textured shirt. The background features an outdoor rural setting with plants, trees, and an open ground area. The scene conveys a sense of manual labor or agricultural activity.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a person wearing a large, woven straw hat, carrying a long wooden pole or log over their shoulder. The individual is standing in an outdoor rural setting, possibly a farm or a field, with trees and vegetation visible in the background. They are dressed in casual clothing with a light-colored shirt, and their posture suggests they are engaged in manual labor, possibly in an agricultural context.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a person wearing a large straw hat, standing in a rural outdoor setting. The person appears to be leaning against a wooden structure, possibly a fence or log. The background suggests a natural, wooded environment. The image is in black and white, giving it an older, historical feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, possibly the early-to-mid 20th century. The image shows someone wearing a wide-brimmed straw hat and light-colored work clothes carrying what appears to be a large wooden beam or log on their shoulder. The photograph has a documentary or journalistic quality to it, capturing what seems to be a moment of manual labor or farm work. The background shows an outdoor rural setting with some vegetation visible. The composition emphasizes the physical effort involved in this type of work, with the diagonal line of the wooden beam creating visual interest in the frame.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a woman carrying a log on her shoulder. She is wearing a wide-brimmed straw hat and a light-colored dress with short sleeves. The woman has her right hand raised to her chin, and she is holding a long, thin log horizontally across her left shoulder. The log is resting on her left shoulder, and her right hand is touching her chin.

In the background, there are trees and bushes, suggesting that the woman is in a rural or wooded area. The overall atmosphere of the image suggests that the woman is engaged in some kind of physical labor or work, possibly related to forestry or agriculture.

The image appears to be a vintage photograph, possibly from the early 20th century, given the style of clothing and the quality of the image. The woman's expression is serious and focused, conveying a sense of determination and hard work.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a woman carrying a large log on her shoulder. The woman is wearing a wide-brimmed straw hat and a short-sleeved shirt with a floral pattern. She has her right hand raised to her chin, and her left hand is holding the log in place. The log is positioned diagonally across her shoulders, with one end resting on her right shoulder and the other end extending behind her head.

In the background, there appears to be a field or clearing with trees and bushes visible in the distance. The overall atmosphere of the image suggests that the woman is engaged in some kind of physical labor or activity, possibly related to agriculture or forestry.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black and white photograph of a woman. She is standing and holding a wooden stick with both hands. She is wearing a straw hat and a dress. She has her left hand on her chin, and her right hand is holding the stick. The background is blurry, and there are trees and plants in the distance. The image conveys a sense of hard work and determination, as the woman appears to be engaged in some form of physical labor.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is in black and white. It shows a person standing on the ground, holding a wooden stick with both hands, and posing for a photograph. The person is wearing a hat and a white dress. The person's left hand is on his chin, and his right hand is holding the wooden stick. The background is blurry, and it seems to be a forest.

Google Gemini

Created by gemini-2.0-flash on 2025-05-27

The black-and-white photograph presents a woman donning a straw hat. She has a long wooden beam resting on her shoulder, and her hand is thoughtfully positioned at her chin. The background features an outdoor setting with trees and foliage, casting shadows that suggest a bright, possibly sunny day.

Created by gemini-2.0-flash-lite on 2025-05-27

Here's a description of the image:

The image is a black and white photograph of a woman outdoors. She's wearing a wide-brimmed straw hat and a loose-fitting, patterned shirt. She's holding a large, rough-hewn log over her shoulder with her left arm. Her right hand is raised to her face, and she appears to be biting her nails or possibly deep in thought. The background is blurred, suggesting a natural setting with trees. The composition evokes a sense of hardship and perhaps rural life.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The black and white photograph depicts a person standing outdoors in a rural setting. The individual is wearing a large, wide-brimmed straw hat and a light-colored, long-sleeved dress or shirt. The person has their hand raised to their mouth, possibly in a thoughtful or contemplative pose. They are holding onto a large wooden beam or log that is positioned horizontally across their shoulder, suggesting they might be engaged in some form of manual labor or carrying a heavy load. The background shows a natural environment with trees and possibly a field, indicating a countryside or agricultural setting. The overall mood of the image conveys a sense of hard work and perhaps a moment of pause or reflection.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This is a black-and-white photograph showing a woman outdoors in a rural setting. She is wearing a straw hat and a light, loose-fitting garment. The woman is holding a large wooden log across her shoulder with one hand, and her other hand is raised to her mouth, possibly in thought or fatigue. The background includes trees and vegetation, suggesting a natural, possibly agricultural environment. The overall tone of the image is somber and reflective.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph depicts a woman outdoors in a rural or natural setting. She is wearing a wide-brimmed straw hat and a loose, possibly tattered dress. Her expression appears thoughtful or contemplative, with her hand touching her face. She is holding a wooden pole over her shoulder with her other hand. The background shows trees and what appears to be a dirt path or field. The overall scene suggests a rustic or agricultural environment.