Human Generated Data

Title

Scene at Smithland, Kentucky

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2998

Human Generated Data

Title

Scene at Smithland, Kentucky

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2998

Machine Generated Data

Tags

Amazon
created on 2024-01-31

Clothing 100
Coat 100
Jacket 100
Formal Wear 99.8
Suit 99.8
Adult 99.7
Male 99.7
Man 99.7
Person 99.7
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Hat 98.2
Hat 97
Overcoat 93.9
Sun Hat 92.8
Accessories 91.9
Belt 91.9
Blazer 89.7
Face 89.3
Head 89.3
Jeans 86.2
Pants 86.2
Cap 85.6
Person 75.3
Hat 71.2
Shirt 57.4
Tie 57
Smoke 55.9
Vest 55.9
Tuxedo 55.8

Clarifai
created on 2024-01-31

people 99.9
lid 98.4
administration 98.2
group together 98.1
leader 97.8
two 97.7
group 97
adult 96.6
veil 96.5
man 96.5
three 96.1
four 95.9
fedora 92
several 91.6
wear 91.5
military 89.9
outfit 89
five 88.1
vehicle 86.9
uniform 86.8

Imagga
created on 2024-01-31

man 51.7
male 43.2
bow tie 37.5
person 34.2
people 31.8
necktie 31.4
hat 27.2
men 26.6
adult 25.4
clothing 24.3
worker 20.9
work 20.4
portrait 20
suit 19.1
professional 19.1
business 18.8
senior 18.7
old 18.1
uniform 18
grandfather 17.5
garment 16.7
face 15.6
occupation 15.6
happy 15
smile 15
job 14.1
businessman 14.1
military uniform 13.6
hand 12.9
industry 12.8
attractive 12.6
construction 12
smiling 11.6
nurse 11.5
black 11.4
manager 11.2
elderly 10.5
couple 10.4
standing 10.4
safety 10.1
model 10.1
executive 10
engineer 9.9
covering 9.8
human 9.7
working 9.7
success 9.6
looking 9.6
serious 9.5
tie 9.5
happiness 9.4
lifestyle 9.4
site 9.4
helmet 9.3
old-timer 9
handsome 8.9
building 8.8
home 8.8
look 8.8
architect 8.7
consumer goods 8.6
cowboy hat 8.4
fashion 8.3
vintage 8.3
guy 8.3
holding 8.2
care 8.2
team 8.1
eye 8
family 8
builder 7.9
hair 7.9
scholar 7.9
beard 7.8
foreman 7.8
skill 7.7
hospital 7.7
engineering 7.6
head 7.6
doctor 7.5
one 7.5
room 7.4
retro 7.4
office 7.3
cheerful 7.3
lady 7.3
pose 7.2
interior 7.1
medical 7.1

Google
created on 2024-01-31

Outerwear 95.1
Hat 90.4
Black 89.7
Coat 87.2
Standing 86.4
Style 84
Black-and-white 83.8
Sun hat 82.6
Headgear 81.4
Collar 79.1
Fedora 76.5
Monochrome photography 75
Monochrome 75
White-collar worker 74.8
Vintage clothing 69.8
Belt 68.5
Font 67.2
Event 66.4
History 62.8
Street 60.7

Microsoft
created on 2024-01-31

person 99.9
man 96.8
clothing 96.4
outdoor 95.3
standing 91.4
hat 90
text 87.8
old 87
fashion accessory 79.1
drawing 77.8
suit 75.2
fedora 68
people 59.4
coat 51.6
posing 51.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-35
Gender Male, 100%
Angry 98.4%
Calm 1.7%
Fear 0%
Confused 0%
Surprised 0%
Disgusted 0%
Happy 0%
Sad 0%

AWS Rekognition

Age 65-73
Gender Male, 100%
Calm 97.7%
Confused 0.9%
Angry 0.2%
Sad 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Belt
Jeans
Adult 99.7%
Adult 99.4%
Adult 99.3%
Male 99.7%
Male 99.4%
Male 99.3%
Man 99.7%
Man 99.4%
Man 99.3%
Person 99.7%
Person 99.4%
Person 99.3%
Person 75.3%
Hat 98.2%
Hat 97%
Hat 71.2%
Belt 91.9%
Jeans 86.2%

Categories

Captions

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image shows three men standing outside what appears to be a grocery store, based on the signage visible in the background. The men are dressed in early 20th century attire, with hats, coats, and suits. The middle man has a gruff, elderly appearance, while the other two appear younger. The image has a vintage, black and white aesthetic, capturing a moment from a bygone era.

Created by claude-3-opus-20240229 on 2025-01-01

The black and white image shows three men standing outside a storefront with the name "M. SMALL MD GROCERY Co." painted on the window. The man in the center appears to be an older gentleman wearing a hat, suit jacket, and cravat or scarf. He has a serious expression and his hands clasped in front of him. To his right is a younger man, likely an employee, also wearing a hat. In the doorway to the left is a third man, possibly another employee, looking out at the camera. Based on their clothing and the style of the store signage, this photograph seems to have been taken in the early 20th century, likely depicting the proprietor and staff of a small grocery business from that era.

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This is a black and white historical photograph taken in front of a grocery store. In the image, there are three men dressed in early 20th century attire. The storefront shows "GROCERY CO." signage in the window. Two men are wearing formal hats and suits, engaged in conversation, while a third man in a flat cap and lighter colored clothing stands slightly apart. The composition and style of dress suggests this photo was likely taken in the early 1900s. The setting appears to be a small town or city street, with the traditional storefront architecture typical of that era.

Text analysis

Google

S ND GROCERY CO RU
S
ND
GROCERY
CO
RU