Human Generated Data

Title

Teamster Vice-President James Riddle Hoffa (1913-?1975) (left) and President David Beck (right) Ready to Vote, Miami Beach, Florida

Date

1957

People

Artist: United Press, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.34

Human Generated Data

Title

Teamster Vice-President James Riddle Hoffa (1913-?1975) (left) and President David Beck (right) Ready to Vote, Miami Beach, Florida

People

Artist: United Press, American 20th century

Date

1957

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.34

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Accessory 99.2
Tie 99.2
Accessories 99.2
Advertisement 99
Poster 99
Collage 99
Human 98.8
Person 98.8
Person 95.9
Face 94.7
Suit 93.8
Apparel 93.8
Coat 93.8
Clothing 93.8
Overcoat 93.8
Person 83.3
Female 72.4
Keyboard 66.5
Computer Hardware 66.5
Electronics 66.5
Hardware 66.5
Computer 66.5
Computer Keyboard 66.5
Girl 62.4
Finger 60.7
Text 59.3
Reading 57.2

Clarifai
created on 2018-03-23

people 99.8
man 99.3
adult 99.1
one 97.6
two 96.7
portrait 94.1
administration 92.9
leader 91.4
elderly 90
wear 89.6
sit 88.3
actor 85.6
newspaper 85.2
group 82.7
writer 79.4
three 79.2
furniture 78.7
facial expression 78.2
book series 78
indoors 76.5

Imagga
created on 2018-03-23

man 41
male 36.2
newspaper 31.7
business 30.4
businessman 30
person 30
people 29
bow tie 27
suit 26
office 24.1
work 23.6
necktie 22.9
product 21.4
paper 20.5
corporate 19.8
job 19.5
working 18.6
hand 18.2
creation 17.7
professional 17.2
businesspeople 17.1
laptop 17
scholar 16.4
garment 16.3
computer 16.2
success 16.1
hands 15.6
adult 15.6
worker 15.5
finance 14.4
executive 14.3
money 13.6
portrait 13.6
clothing 13.6
intellectual 13.3
teamwork 13
men 12.9
human 12.8
happy 12.5
holding 12.4
ruler 12.3
black 12.1
currency 11.7
face 11.4
one 11.2
dollar 11.1
team 10.8
workplace 10.5
group 10.5
desk 10.4
meeting 10.4
manager 10.2
occupation 10.1
communication 10.1
financial 9.8
guy 9.7
document 9.5
pen 9.3
successful 9.2
wealth 9
building 8.7
partner 8.7
sitting 8.6
smile 8.6
old 8.4
cash 8.2
technology 8.2
home 8
smiling 8
together 7.9
contract 7.8
education 7.8
table 7.8
expression 7.7
writing 7.6
reading 7.6
career 7.6
keyboard 7.5
room 7.4
businesswoman 7.3
bank 7.2

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.9
man 98.7
text 90.7
newspaper 88
old 72.6
older 39.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 35-52
Gender Male, 90.8%
Happy 2.4%
Sad 16.1%
Disgusted 17.2%
Confused 9.7%
Angry 10.2%
Surprised 4.9%
Calm 39.3%

AWS Rekognition

Age 57-77
Gender Male, 91.2%
Calm 56.3%
Angry 7%
Confused 18.2%
Sad 3.4%
Disgusted 1.8%
Surprised 12.2%
Happy 1.2%

AWS Rekognition

Age 26-43
Gender Male, 98.1%
Angry 6.3%
Confused 7.3%
Happy 1%
Calm 68.4%
Disgusted 7.2%
Sad 5.9%
Surprised 3.8%

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 63
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Tie
Person
Suit
Computer Keyboard
Tie 99.2%
Person 98.8%
Person 95.9%
Person 83.3%
Suit 93.8%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-05

a photograph of a man in a suit and tie is sitting at a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image shows two separate panels featuring people interacting in what seems to be a formal or professional setting. On the left panel, a person is dressed in a suit and tie, holding papers while seated, surrounded by other individuals carrying documents. On the right panel, another person in a short-sleeved polo shirt is holding a paper and gesturing with their hand, while there are visible papers and books nearby. The environment appears busy, suggesting a meeting, discussion, or press-related event.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image consists of two separate photographs placed side by side. The left side shows a person dressed in a formal suit and tie, holding a document or stack of papers. The environment appears to be crowded, possibly indicating a press conference or meeting. On the right side, another person is depicted wearing a short-sleeved polo shirt and a watch on their left wrist. This person is holding a typewritten document across a table or desk. The background includes others with clipboards or note-taking materials, suggesting an interview or discussion setting. The overall tone is monochrome, indicating it may be an older photograph taken in black and white.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-29

The image appears to show two black and white photographs. The one on the left depicts a man in a suit and tie, looking serious and focused. The one on the right shows an older man with gray hair, wearing a white shirt, looking at some papers in his hand with a pensive expression.

Created by claude-3-opus-20240229 on 2024-12-29

The black and white image shows two men in suits sitting at a table and talking. The man on the left is looking intently at the other man while speaking and gesturing with his hands. The man on the right appears to be listening and looking down at some papers or documents on the table in front of him. Based on their clothing and the setting, it seems to depict a serious discussion or meeting taking place, likely in an office or professional environment sometime in the mid-20th century judging by the photographic style.

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This is a black and white photograph split into two side-by-side images that appears to be from a historical context, likely mid-20th century. On the left is a person wearing a formal dark suit with a tie, seated and looking slightly upward. On the right is an older person wearing a white casual shirt, appearing to be in discussion or perhaps giving testimony, with some papers visible on a table in front of them. The image has the look of official or legal proceedings, possibly from a court or government hearing. The composition and style suggests these are press or documentary photographs from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of two men in a room, likely from the 1960s. The man on the left is wearing a dark suit and tie, with short dark hair. He is looking to his right, and his hands are clasped together in front of him. The man on the right is wearing a white polo shirt and has a watch on his left wrist. He is holding a pen in his right hand and appears to be speaking or writing. There are papers and documents on the table in front of them, and several people are standing behind them, some of whom are also holding papers or pens.

The overall atmosphere of the image suggests a meeting or conference of some kind, possibly related to business or politics. The formal attire and serious expressions of the men in the photo contribute to this impression.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of two men, each in their own separate photo. The man on the left is wearing a dark suit jacket, white shirt, and patterned tie. He has short dark hair and is looking to his right. The man on the right is wearing a white polo shirt and has short dark hair. He is holding a pen in his right hand and appears to be writing on a piece of paper.

In the background of both photos, there are other people standing around, some of whom are holding papers or pens. The overall atmosphere suggests that the men are engaged in some kind of professional or business activity, possibly a meeting or conference.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-30

A black-and-white image shows two men with different facial expressions. The man on the left is sitting on a chair, wearing a suit and tie, and holding a pen. He is looking at something in front of him, possibly reading a book. Behind him, there is another man standing, holding a pen. On the right side, there is another man sitting on a chair, wearing a polo shirt and a watch.

Created by amazon.nova-lite-v1:0 on 2025-05-30

The image shows two black-and-white photographs of men. In the first photograph, a man is sitting on a chair and looking forward. He is wearing a suit and tie. He has a serious expression on his face. He is holding a pen in his right hand. Behind him, there is a blurry image of a person standing and holding a book. In the second photograph, a man is sitting on a chair and looking forward. He is wearing a white polo shirt and a watch on his left wrist. He is holding a piece of paper in his right hand. He is looking at something in front of him. Behind him, there is a blurry image of a person standing and holding a book.

Google Gemini

Created by gemini-2.0-flash on 2025-05-05

This is a black and white photograph divided into two panels.

The left panel shows a man seated at a table. He is wearing a suit, a white shirt, and a patterned tie. He has a pen in his right hand, and his gaze is directed slightly upwards and to the left. Behind him, another man can be seen in a dark suit, partially obscured. There are documents or books stacked on the table in front of the seated man.

The right panel shows another man, older and balding, wearing a white polo shirt. He is also seated at a table, holding a document in his hands. His mouth is slightly open, as if he is speaking or surprised. Behind him, a person can be seen wearing a checkered shirt.

Both men appear to be in some sort of official setting, possibly a press conference or a hearing, with a number of people surrounding them. The lighting is even and the composition is focused on the subjects' faces.

Created by gemini-2.0-flash-lite on 2025-05-05

Here is a description of the image:

The image is a black and white photograph divided into two distinct panels.

  • Left Panel: Shows a man in a suit and tie, seated and gazing off to the side with a focused expression. His dark hair is neatly slicked back. He holds a pen in his hand and appears to be in a formal setting with stacks of papers visible. A few other people are visible behind him, some blurred.

  • Right Panel: Displays a different man. This man is bald and wearing a white polo shirt. He is seated and seems to be looking at a document in his hand with a surprised or attentive expression. The details around him are not clear, but there are other people in the background, partially obscured by the frame. A wristwatch is visible on his wrist.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-30

The image consists of two black-and-white photographs side by side.

  1. Left Photograph:

    • The man in the left photograph appears to be seated and is looking upwards, possibly listening or observing something intently.
    • He is dressed in a suit and tie, suggesting a formal or professional setting.
    • There are other people around him, though their faces are not clearly visible.
    • The man has a cigarette in his mouth, which was common in older photographs.
  2. Right Photograph:

    • The man in the right photograph is also seated and appears to be engaged in a conversation or discussion.
    • He is wearing a short-sleeved shirt and has a pen in his hand, which he is using to point or gesture.
    • He is holding some papers, indicating that he might be reading or discussing the content.
    • The man is bald and has a visible wristwatch on his left wrist.
    • There are other people around him, and one person is leaning over, possibly to read the papers or engage in the discussion.

Both photographs seem to capture moments of interaction or discussion in what appear to be formal or professional environments. The attire and the presence of documents suggest that these could be scenes from meetings, conferences, or similar settings.