Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

Date

July 30, 1938, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3420

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3420

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Photography 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Adult 98.7
Male 98.7
Man 98.7
Person 98.7
Hat 98.4
Hat 98
Face 96.9
Head 96.9
Portrait 96.9
Accessories 95.3
Glasses 95.3
Shirt 92.8
Formal Wear 91.3
Suit 91.3
Coat 89.2
Jacket 89.2
Hat 89.1
Hat 88.7
Glasses 87.8
Cowboy Hat 65.8
Glasses 56.3
Cap 55

Clarifai
created on 2018-05-10

lid 99.7
people 99.7
man 99.1
veil 98.1
adult 97.7
elderly 95.4
fedora 95.2
cowboy 94.1
group 93.7
two 93.6
three 93.5
portrait 92.1
wear 91.8
group together 89.8
monochrome 89.6
cowboy hat 89.1
administration 85.6
cowman 84.9
four 84.5
facial expression 84.4

Imagga
created on 2023-10-06

cowboy hat 100
hat 100
headdress 97.7
clothing 66.2
male 41.1
man 40.3
person 35.8
portrait 34.3
consumer goods 33.9
covering 33.7
face 32
adult 28.5
people 27.9
senior 25.3
outdoors 22.4
happy 20.7
cowboy 20.6
men 18.9
elderly 18.2
handsome 17.8
smile 17.8
western 17.4
looking 16.8
old 16.7
mature 15.8
attractive 15.4
casual 15.3
shirt 14.9
boy 14.8
guy 14.7
lifestyle 14.5
hand 13.7
two 13.6
look 13.1
smiling 13
child 12.5
couple 12.2
outside 12
old-timer 11.9
pretty 11.9
kid 11.5
serious 11.4
together 11.4
human 11.2
hair 11.1
expression 11.1
hold 11.1
model 10.9
jacket 10.6
age 10.5
grandfather 10.3
uniform 10.1
head 10.1
cute 10
older 9.7
black 9.6
wearing 9.5
farmer 9.5
happiness 9.4
close 9.1
aged 9
one 9
style 8.9
standing 8.7
straw 8.7
retirement 8.6
alone 8.2
children 8.2
farm 8
rural 7.9
cowgirl 7.9
country 7.9
love 7.9
retired 7.8
cold 7.7
industry 7.7
husband 7.6
walk 7.6
horse 7.6
wife 7.6
pair 7.6
fashion 7.5
cheerful 7.3
lady 7.3
active 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.5
man 98.1
outdoor 96.3
hat 95.8
headdress 82.5
military uniform 82.1
old 70.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 99.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 65-75
Gender Male, 100%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 58.7%
Confused 19.6%
Surprised 7.2%
Sad 7%
Disgusted 6.4%
Fear 6.3%
Angry 2.3%
Happy 1.5%

Microsoft Cognitive Services

Age 73
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Glasses
Suit
Jacket
Adult 99.4%
Adult 99.2%
Adult 98.7%
Male 99.4%
Male 99.2%
Male 98.7%
Man 99.4%
Man 99.2%
Man 98.7%
Person 99.4%
Person 99.2%
Person 98.7%
Hat 98.4%
Hat 98%
Hat 89.1%
Hat 88.7%
Glasses 95.3%
Glasses 87.8%
Glasses 56.3%
Suit 91.3%
Jacket 89.2%

Categories

Captions

Microsoft
created by unknown on 2018-05-10

a man wearing a hat 98.4%
a man wearing a black hat 97.5%
a man wearing a black hat and looking at the camera 96.4%

Clarifai
created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of men in hats and overalls -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts a group of individuals standing and engaging in conversation outdoors, in what appears to be a rural setting. The men are dressed in work shirts, overalls, and hats, suggesting a farming or agricultural context. The background shows open land with trees and possibly livestock grazing in the distance.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image shows a group of men gathered outdoors, engaged in conversation. They are wearing hats and casual clothing typical of a rural or agricultural setting. One man is in overalls, and another man has a striped shirt. The background features an open field with trees, and the atmosphere suggests a meeting or discussion, possibly related to farming or rural affairs. The photo has a vintage, black-and-white style.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows three men wearing hats and working clothes, likely farmers or laborers. They appear to be in a rural or outdoor setting, with trees visible in the background. The men have serious expressions on their faces, suggesting they are engaged in some kind of discussion or work-related activity. The image has a black and white, vintage aesthetic, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from an earlier era, possibly the 1930s or 1940s. It shows a group of men wearing fedora-style hats and work clothes - some in white shirts and others in what appears to be denim overalls. The men are standing close together as if in conversation or observing something. One of the men is wearing glasses. The style of dress and the quality of the photograph suggests this is from a rural or agricultural setting. The image has a documentary or historical quality to it.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image is a black-and-white photograph of four men standing together in a field, likely taken in the mid-20th century. The men are dressed in casual attire, with three of them wearing hats and two sporting glasses.

Here is a detailed description of the image:

  • Man on the Left
    • The man on the left is facing the other three men, with his back to the camera.
    • He is wearing a light-colored shirt and a dark-colored hat.
    • His facial expression is not clearly visible due to the angle of the photo.
  • Man in the Middle
    • The man in the middle is also facing the other three men.
    • He is wearing a dark-colored shirt and a dark-colored hat.
    • He has a neutral expression on his face.
  • Man on the Right
    • The man on the right is facing the other three men, with his back to the camera.
    • He is wearing a light-colored shirt and a dark-colored hat.
    • His facial expression is not clearly visible due to the angle of the photo.
  • Man in the Background
    • The man in the background is partially visible behind the other three men.
    • He is wearing a light-colored hat and a light-colored shirt.
    • His facial expression is not clearly visible due to the angle of the photo.

In summary, the image is a black-and-white photograph of four men standing together in a field, likely taken in the mid-20th century. The men are dressed in casual attire, with three of them wearing hats and two sporting glasses. The image provides a glimpse into the lives of these men, who appear to be engaged in conversation or discussion.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image is a black-and-white photograph of four men standing in a field, with the man on the left wearing a light-colored shirt and a hat, and the man on the right wearing a dark-colored shirt and a hat. The background is blurry, but it appears to be a field or meadow with trees in the distance. The overall atmosphere suggests a casual gathering or meeting among friends or acquaintances.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The black-and-white photo features four men standing in an outdoor area, probably on a farm. Three of them are wearing hats, while the other one is wearing a cap. Two of them are wearing eyeglasses. The man in the middle is wearing a hat and an apron, and he is looking at the man on the left, who is wearing a hat and a shirt. Behind them is a blurry view of trees.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image is a black-and-white photograph of four men standing in an outdoor setting, possibly a field. The men are wearing hats and glasses, and they seem to be engaged in a conversation. The man on the left is wearing a white shirt and a hat, while the man in the middle is wearing a denim overall with a pin on the left chest and a hat. The man on the right is wearing a striped shirt and a hat.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

Here's a description of the image:

The photograph is a black and white image depicting a group of four men, likely from an earlier era, possibly the mid-20th century. They appear to be engaged in a conversation. The men are all wearing hats, which were common attire at the time. The man on the left has his back to the camera. The man in the center has a pensive expression on his face, and is wearing overalls. The other two men look in the same direction. The backdrop consists of a grassy field and a hint of trees, suggesting an outdoor setting. The photograph has a slightly grainy texture, which is common for older black and white photos. A handwritten inscription, "58%F" appears at the bottom.

Created by gemini-2.0-flash on 2025-04-30

Here is a description of the image:

The black and white photograph shows a group of four men standing in a field, engaged in conversation. They all appear to be farmers or agricultural workers.

The man on the left, seen from the back, is wearing a light-colored shirt with suspenders and a wide-brimmed hat. The man next to him is wearing overalls, a collared shirt, and glasses.

The man in the middle, wearing a striped shirt, glasses, and a hat, is looking slightly off-camera. Beside him, the fourth man is wearing a hat and vest.

The background is slightly blurred and shows a field with some indistinct objects and a tree on the right side. There appears to be writing at the bottom.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph featuring three older men engaged in conversation. They appear to be outdoors, possibly in a rural or agricultural setting, given the open sky and the hint of trees in the background.

  • The man on the left is wearing a light-colored shirt and a wide-brimmed hat. He is facing the man in the center and appears to be speaking to him.
  • The man in the center is dressed in overalls and a long-sleeved shirt, also wearing a hat. He is looking at the man on the left, seemingly listening intently.
  • The man on the right is wearing a light-colored shirt and a hat similar to the man on the left. He is also engaged in the conversation, looking towards the man in the center.

All three men are wearing glasses, and their expressions suggest a serious or focused discussion. The attire and setting suggest that they might be farmers or laborers from a past era, possibly the early to mid-20th century. The photograph captures a candid moment of interaction, providing a glimpse into their daily lives and relationships.

Text analysis

Amazon

58%F,