Human Generated Data

Title

Home of Postmaster Brown, Old Rag, Virginia

Date

1935

People

Artist: Arthur Rothstein, American 1915 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.1058

Human Generated Data

Title

Home of Postmaster Brown, Old Rag, Virginia

People

Artist: Arthur Rothstein, American 1915 - 1985

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.1058

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Furniture 97.5
Human 97.4
Clothing 86.2
Apparel 86.2
Sitting 80.6
Table 78.9
Face 76.8
Screen 68.7
Electronics 68.7
Desk 66.2
Monitor 63.4
Display 63.4
Text 63.3
Living Room 59.8
Room 59.8
Indoors 59.8
Shelf 57.6
LCD Screen 56.9
Cabinet 56.3

Clarifai
created on 2023-10-30

people 100
adult 98.8
one 98.7
two 96.5
man 95.9
leader 95.1
group 94.2
furniture 93.5
administration 93.2
typewriter 93.1
three 92.8
group together 92.5
chair 89.6
wear 88.5
elderly 86.2
writer 85.3
sit 84.4
vehicle 82.4
newspaper 82.2
war 80.4

Imagga
created on 2022-05-28

room 28.1
man 26.2
home 20.7
people 19
barbershop 18.7
person 18.6
indoors 18.4
male 17.7
chair 17.5
shop 16.8
interior 15.9
old 13.9
hospital 13.8
sitting 13.7
adult 13.7
mercantile establishment 13.3
office 12.6
table 12
television 11.5
senior 11.2
computer 11
window 11
indoor 10.9
architecture 10.9
house 10.9
smiling 10.8
couple 10.4
lifestyle 10.1
patient 10.1
lamp 10.1
smile 10
equipment 9.9
furniture 9.8
building 9.7
device 9.7
ancient 9.5
glass 9.3
health 9
place of business 9
seat 8.7
men 8.6
grandfather 8.6
modern 8.4
inside 8.3
happy 8.1
working 7.9
medical 7.9
work 7.8
portrait 7.8
couch 7.7
monitor 7.7
industry 7.7
illness 7.6
bed 7.6
technology 7.4
phone 7.4
light 7.3
family 7.1
love 7.1
happiness 7
medicine 7

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

wall 97.1
man 94.2
indoor 93.3
black and white 88.7
person 86.5
drawing 85.7
clothing 85.4
sketch 82.1
text 77.2
old 49

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 56-64
Gender Male, 94.6%
Calm 97.7%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Confused 0.7%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Calm 51.1%
Sad 27.3%
Surprised 11.5%
Fear 8.9%
Confused 6.5%
Disgusted 5.7%
Angry 1.9%
Happy 0.6%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person

Clarifai

Man
Table
Human face
Picture frame
Human hair
Human arm
Furniture
Human hand
Clothing

AWS Rekognition

Person 97.4%

Clarifai

Man 81%

Clarifai

Man 46.8%

Clarifai

Table 74.6%

Clarifai

Human face 65.3%

Clarifai

Human face 58.5%

Clarifai

Picture frame 53.7%

Clarifai

Human hair 42.2%

Clarifai

Human arm 40.7%

Clarifai

Human arm 36.7%

Clarifai

Furniture 40.2%

Clarifai

Human hand 34.8%

Clarifai

Clothing 34.1%

Categories

Imagga
created on 2022-05-28

interior objects 48.6%
food drinks 41%
paintings art 8.4%

Captions

Microsoft
created by unknown on 2022-05-28

a man sitting on a table 83.7%
a man sitting at a table 83.6%
a man sitting at a desk 83.5%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-11

a photograph of a man sitting at a table with a book

Created by general-english-image-caption-blip-2 on 2025-07-01

an old man sitting at a table with a book

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image depicts a vintage interior scene featuring a man sitting in a modest room. The walls are made of wooden panels, and there is minimal furniture visible, including a small table with a lace-edged cloth and two old-fashioned oil lamps placed on it. Several books are stacked on the table, alongside an open book in the man's hand. A chest of drawers is against the wall, topped with a mirror and a hat. On the walls, there are framed items, including a picture and a written plaque that reads: "Christ is the head of this house, The unseen guest at every meal, The silent listener to every conversation." Another framed artwork appears to display the Colosseum, enhancing the vintage and somewhat rustic aesthetic of the space.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image depicts an interior scene featuring a man seated in a room with rustic decor. He is holding a book, and there are several other books placed on a table covered with a lace-edged cloth. Two oil lamps sit on the table. Behind the man, a dresser with a cloth draped over it holds a couple of hats and a framed mirror propped against the wall. The walls are wooden with several items hanging, including a framed portrait, a picture of a building, and a sign that reads: "CHRIST is the HEAD of this house THE UNSEEN GUEST at every meal THE SILENT LISTENER to every conversation."

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-10

The image shows an elderly man sitting in a chair, reading a book. He has a long, gray beard and is wearing a coat. The room appears to be a simple, rustic interior with wooden walls and a table in front of the man, on which there are various items such as lamps, books, and a framed picture on the wall. The overall atmosphere suggests a quiet, contemplative setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-10

This is a black and white photograph that appears to be from an earlier era, showing an elderly gentleman with a beard reading a book in what looks like a modest home interior. The room has white wooden walls and contains several interesting details: a mirror and some military-style caps on a dresser in the background, framed artwork including what appears to be the Colosseum, and two oil lamps on a table covered with a lace tablecloth. There's also a religious sign visible that reads "CHRIST is the HEAD of this HOUSE." The scene has a quiet, contemplative quality to it, suggesting a moment of personal study or reflection.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-23

The image is a black-and-white photograph of an elderly man sitting in a chair, reading a book. The man has short hair and a beard, and is wearing a dark jacket over a collared shirt. He is seated in a wooden chair with his left hand holding the book open on his lap.

In front of him, there is a small table covered with a white lace tablecloth. On the table, there are three books and two oil lamps. Above the table, there is a sign that reads "Christ is the head of this house, the unseen guest at every meal, the silent listener to every conversation."

The background of the image features a white paneled wall with various items hanging on it, including a mirror, a picture frame, and a hat. The overall atmosphere of the image suggests a quiet, contemplative moment in the life of the elderly man.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-23

The image is a black-and-white photograph of an older man sitting in a chair, reading a book. The man is dressed in a dark suit jacket, a light-colored shirt, and dark pants. He has short hair and a beard. He is sitting in a wooden chair with his right arm resting on the armrest and holding the book open with his right hand. The book is resting on a table covered with a white cloth. There are two books on the table, and two oil lamps on either side of the table. Behind the man, there is a dark wooden cabinet with a mirror hanging above it. The mirror is leaning against the wall, and the frame is broken. On top of the cabinet, there are a few items, including a hat, a picture frame, and a sign that reads "Christ is the head of this house. The unsen guest at every meal. The silent listener to every conversation." The background of the image is a white paneled wall. The overall atmosphere of the image suggests a quiet, intimate moment, with the man lost in thought as he reads his book.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-23

A black-and-white photo shows an old man sitting on a chair in a room. He is wearing glasses and a jacket. He is reading a book while sitting in front of a desk. There are books, lamps, and a sign on the desk. On the left side, there is a cabinet with a mirror and a hat on top. On the right side, there is a picture frame with a picture of a woman.

Created by amazon.nova-pro-v1:0 on 2025-05-23

The image is a black-and-white photograph of an elderly man sitting on a chair and reading a book. He is wearing a suit and a white shirt. In front of him, there is a table with a white cloth, and on top of it, there are four books, two glass lamps, and a sign with the words "Christ is the head of this house. The unseen guest at every meal. The silent listener to every conversation." Behind him, there is a cabinet with a mirror, and above it, there are three picture frames hanging on the wall. The picture frames contain pictures of a woman, a mirror, and a building.

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

Here is a description of the image:

A black and white photograph shows an elderly man sitting in a room, reading a book. He has a long, white beard and is wearing glasses, a button-up shirt, a jacket, and dark pants. He is seated in what appears to be an armchair.

The room is furnished simply. Behind the man is a dark wooden dresser topped with several items, including a hat, a mirror, and what seems to be a powder box. To the right of the dresser is a small table covered with a white lace cloth. On the table are two glass oil lamps and several books.

The walls are paneled with vertical planks and decorated with various items. Hanging above the dresser is a framed picture of a woman and a framed picture of the Colosseum. Between the two pictures, there's a small sign that reads, "CHRIST IS THE HEAD OF THIS HOUSE, THE UNSEEN GUEST AT EVERY MEAL, THE SILENT LISTENER TO EVERY CONVERSATION." A pair of glasses is hanging to the right of this sign.

The overall impression is one of quiet contemplation and domestic simplicity. The image has a historical feel due to the style of clothing, furnishings, and the black and white medium.

Created by gemini-2.0-flash-lite on 2025-04-29

Here is a description of the image:

This black and white photograph depicts an elderly man seated in a chair indoors, engrossed in reading a book. He has a long, white beard and is wearing a button-down shirt and a dark jacket. His gaze is focused on the open book he holds in his hands.

He is sitting next to a small table covered with a white lace-edged tablecloth. On the table, there are two glass oil lamps and a few small books stacked together. Behind the table, a dark chest of drawers is visible, on top of which several items rest: a hat, a beret, and a mirror.

The wall behind him is made of wooden planks. Hanging on the wall, there are framed pictures - one appears to be a portrait of a woman and the other depicts a building that resembles the Colosseum. Additionally, a sign is hung on the wall that reads "CHRIST IS THE HEAD OF THIS HOUSE THE UNSEEN GUEST AT EVERY MERL THE SILENT LISTENER TO EVERY CONVERSATION".

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image is a black-and-white photograph depicting an elderly man sitting in what appears to be a modest, rustic room. The man has a beard and is wearing a suit jacket and vest. He is holding an open book, which could be a Bible or another religious text, given the context of the room.

The room is adorned with several items that suggest a religious or spiritual setting:

  1. Table and Items: In front of the man is a table covered with a white lace tablecloth. On the table, there are two oil lamps, one on each side, and several books, including the one he is holding.

  2. Wall Decorations:

    • Above the table, there is a framed picture or sign with text that reads: "CHRIST IS THE HEAD OF THIS HOUSE, THE UNSEEN GUEST AT EVERY MEAL, THE SILENT LISTENER TO EVERY CONVERSATION."
    • To the left, there is a framed picture of a young child.
    • To the right, there is a framed picture of a building, possibly a church or a significant religious structure.
  3. Dresser: Behind the man, there is a dresser with a mirror and various items on top, including a hat and what appears to be a bowl.

The overall atmosphere of the image suggests a quiet, contemplative moment, possibly in a home or a small chapel. The man's attire and the religious items in the room indicate a sense of reverence and devotion.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-28

This black-and-white photograph depicts a man seated in a chair in what appears to be a room with white-paneled walls. He is engaged in reading a book, and his expression suggests he is focused. The man is wearing a suit jacket over a collared shirt and has a beard. The room's decor includes a few framed pictures and a poster on the wall behind him. To his right, there is a small table covered with a lace tablecloth, on which sit several books and two oil lamps. The atmosphere of the room suggests a quiet, contemplative setting, possibly a study or a personal space. The poster on the wall reads, "Christ is the Head of this House. The unseen guest at every meal. The silent listener to every conversation," which hints at a religious or spiritual theme.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-28

This black-and-white image depicts an older man with short hair and a beard, wearing glasses and a suit jacket over a buttoned shirt. He is seated in a chair and appears to be reading a book, which is placed on a small table covered with a lace tablecloth. The table also holds several other books and two oil lamps.

The room has a rustic appearance with wooden paneled walls. Above a dark cabinet, there are two framed pictures and a mirror, as well as a hanging sign that reads, "Christ is the Head of this House. The Unseen Guest at every meal. The Silent Listener to every conversation." The cabinet also has a pair of hats placed on top of it. The overall setting suggests a simple, modest living space with religious and personal touches.

Text analysis

Amazon

THE
LISTENER
THE SILENT LISTENER
SILENT
CHRIST
THIS
HEAD
EVERY
GUEST
AT EVERY MER
AT
MER
THE ONSEEN GUEST
CONVERSATION
TO EVERY CONVERSATION
TO
ONSEEN
OF THIS HOUSE
HOUSE
CHRIST IS THE HEAD
OF
IS

Google

CHRIST IS THE HEAD OF THIS HOUSE THE UNSEEN GUEST AT EVERY MERL THE SILENT LISTENER TO EVERY CONVERSATION
CHRIST
IS
THE
HEAD
OF
THIS
HOUSE
UNSEEN
GUEST
AT
EVERY
MERL
SILENT
LISTENER
TO
CONVERSATION