Human Generated Data

Title

Untitled (Gordon Gahan presenting photograph from National Geographic story to President Richard Nixon)

Date

1972

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.169

Human Generated Data

Title

Untitled (Gordon Gahan presenting photograph from National Geographic story to President Richard Nixon)

People

Artist: Unidentified Artist,

Date

1972

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.169

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Accessories 98.5
Tie 98.5
Accessory 98.5
Person 95.7
Human 95.7
Person 95.2
Sitting 85.2
Apparel 84.8
Clothing 84.8
Overcoat 81.7
Coat 81.7
Suit 79.7
Suit 70.9
Furniture 59.5
Table 59.5
Face 59
Plant 58.6
Leisure Activities 56.9
Tuxedo 56.4
Performer 55.2

Clarifai
created on 2019-03-22

people 99.9
two 99.5
adult 99.2
administration 98.4
man 97.5
group 96.7
woman 95.8
leader 94.5
three 94.2
wear 92.5
furniture 91.3
room 86.9
sit 86.7
outfit 85
side view 83.6
one 81.4
chair 79.4
group together 75.2
home 74.9
four 74.3

Imagga
created on 2019-03-22

businessman 67.2
office 57.1
business 56
man 52.5
meeting 50
businesswoman 48.2
suit 47.9
corporate 44.7
executive 44.4
team 43.1
male 41.9
teamwork 41.8
professional 39.4
businesspeople 38
people 34.1
group 33.1
person 32.4
work 32.2
communication 30.3
colleagues 30.2
happy 28.9
laptop 28.3
job 26.6
successful 26.6
confident 26.4
together 26.3
manager 26.1
success 25.8
working 25.7
adult 23.9
table 23.4
partnership 22.1
groom 20.9
entrepreneur 20.8
smiling 20.3
computer 20.1
looking 20
workplace 19.1
talking 19
men 18.9
discussion 18.5
women 18.2
tie 18.1
building 17.9
conference 17.6
attractive 17.5
portrait 17.5
businessmen 16.6
partners 16.5
sitting 16.3
handsome 16.1
worker 16.1
discussing 15.7
smile 15.7
partner 15.5
modern 15.4
career 15.2
desk 15.1
company 14.9
conversation 14.6
secretary 14.5
employee 14.4
two 14.4
coworkers 13.8
diverse 13.7
corporation 13.5
diversity 13.5
boss 13.4
formal 13.4
occupation 12.9
cooperation 12.6
busy 12.6
staff 12.5
lifestyle 11.6
planning 11.6
collar 11.5
happiness 11
speaker 11
interaction 10.8
cheerful 10.6
ethnic 10.5
room 10.4
presentation 10.3
paper 10.2
phone 10.2
indoor 10.1
holding 9.9
explaining 9.9
businesswomen 9.8
workers 9.7
project 9.6
leadership 9.6
talk 9.6
communicate 9.6
reading 9.5
life 9.3
20s 9.2
friendly 9.2
technology 8.9
indoors 8.8
couple 8.7
30s 8.7
confidence 8.6
notebook 8.5
plan 8.5
mobile 8.5
environment 8.2
guy 8.2
articulator 8.2
boardroom 7.9
documents 7.9
standing 7.8
paperwork 7.8
cellphone 7.8
employment 7.7
mid adult 7.7
director 7.7
call 7.7
sales 7.7
expression 7.7
casual 7.6
finance 7.6
horizontal 7.5
contemporary 7.5
showing 7.5
black 7.3
necktie 7.2
pretty 7

Google
created on 2019-03-22

Microsoft
created on 2019-03-22

person 99.9
indoor 94.9
black 72.2
black and white 11.2
art 8.1
music 5.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 97.4%
Disgusted 3.7%
Calm 39.1%
Confused 11%
Angry 6.3%
Sad 29.6%
Surprised 3.4%
Happy 6.8%

AWS Rekognition

Age 26-43
Gender Female, 58.7%
Confused 1.8%
Happy 1.8%
Angry 2.8%
Disgusted 0.7%
Calm 13.7%
Sad 78%
Surprised 1.2%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Suit
Tie 98.5%
Person 95.7%
Person 95.2%
Suit 79.7%
Suit 70.9%

Categories

Imagga

people portraits 95.9%
events parties 2.8%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a man in a suit and tie is looking at a picture of a man in -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image shows two individuals standing in front of a dark wooden door with a fanlight window overhead. One person is holding and showing a large photograph or artwork to the other. The photo depicts a silhouetted person skiing or engaged in a winter sport against a snowy landscape and a cloudy sky. The image has visible creases indicating it may have been folded or aged over time. Both individuals are dressed in formal clothing.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image depicts two individuals holding and examining a photograph or artwork. The piece they are observing features a silhouette of a person engaged in an activity involving a long pole, possibly skiing or hiking, against a backdrop of an expansive landscape with clouds and open terrain. The photograph appears to be an artistic or action shot, capturing the subject in dynamic motion. The individuals are standing in what seems to be an indoor setting in front of a wooden door and a wall with a semi-circular transom window above it, suggesting an architecture style typical of formal entryways or governmental buildings. The photo has visible creases and marks, indicating it might be an older or frequently handled item.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows two men in suits examining what appears to be a painting or artwork. They are standing in what looks like an office or studio setting, with a window and architectural details visible in the background. The men appear to be engaged in a discussion or examination of the artwork they are holding.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white photograph showing two men in suits examining what appears to be a photograph or document together. Both men are wearing dark business suits with ties, and they're standing in what looks like an elegant interior space with decorative architectural details visible in the background, including an arched doorway with a fanlight above it. The image appears to be vintage, possibly from the 1970s based on the men's clothing and hairstyles. There's a visible crease or tear running through the photograph. The document they're looking at seems to show a silhouetted figure against a light background.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

This image is a black and white photograph of two men standing in front of a doorway, with one man holding a picture. The man on the left is wearing a dark suit and tie, while the man on the right is also dressed in a dark suit and tie. The man on the left is holding a picture that appears to be a photograph of a person skiing down a mountain. The background of the image shows a white wall with a doorway behind the two men. The overall atmosphere of the image suggests that the two men are discussing or admiring the picture being held by the man on the left.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image is a black-and-white photograph of two men standing in front of a door, examining a picture of a person skiing.

The man on the left has short dark hair and is wearing a dark suit jacket over a white shirt. He is holding a large picture in front of him, which appears to be a photograph of a person skiing down a snowy hill. The man on the right has dark hair that is longer on the sides and is wearing a dark suit jacket over a patterned tie and a white shirt. He is looking at the picture with interest.

In the background, there is a white wall with a large arched window above the door. The door itself is dark brown and has a rectangular window in the center. The overall atmosphere of the image suggests that the two men are discussing or admiring the picture of the skier.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The black and white image shows two men in formal attire, with one holding a large picture frame. The man on the left is wearing a suit and tie, while the man on the right is wearing a suit, tie, and glasses. They are standing in front of a door with a window and a white frame. The man on the left is looking at the picture frame, while the man on the right is looking at him.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image features two men standing in front of a door. The man on the left is holding a picture frame with a picture of a man in a suit and tie. The man on the right is looking at the picture. The picture frame is damaged. The man on the left is wearing a suit and tie, while the man on the right is wearing a suit and tie. The picture frame is damaged.

Google Gemini

Created by gemini-2.0-flash on 2025-05-22

Here's a description of the image:

This is a black and white photograph featuring two men in suits standing in front of a door with an arched transom window. The photo appears to be aged with visible lines and marks, particularly a significant streak down the center.

The man on the left is partially turned, facing the artwork being held. He is wearing a suit jacket and a collared shirt with a tie, and his head is bowed slightly as he looks at the piece. The man on the right is facing forward and looking at the artwork as well. He is also wearing a suit, with a patterned tie, and a side part hairstyle.

Both men are holding a large photograph or print. The image on this print shows a silhouette of a figure seemingly skiing down a snowy slope. The contrast is stark, with the silhouette sharply defined against a lighter background.

The background consists of a white wall and the dark door, which has a decorative window above it. The arched transom window has radiating panes of glass.

Created by gemini-2.0-flash-lite on 2025-05-22

Here's a description of the image:

Overall:

The image is a black and white photograph. It appears to be an older photograph, possibly from the mid-20th century, given the style and the wear and tear on the paper. The focus is on two men who are looking at a drawing.

People:

  • Two men are the central figures. They are both dressed in suits, indicating a formal setting.
  • Man on the Left: Is older, has short, dark hair. He is looking down intently at the drawing, suggesting he is studying it.
  • Man on the Right: Appears to be younger, with dark hair. He is also looking at the drawing, and he seems to be showing it to the other man. He has a tie with a complex pattern on it.

Setting:

  • The men are standing in front of what appears to be a doorway with a window above it.
  • The door is made of dark wood, and the window has a semi-circular shape with a fan design.
  • The background is plain, likely a wall.

Drawing:

  • The drawing is held by both men. It depicts a person skiing.
  • The drawing is black and white, matching the photograph itself.

Composition:

  • The image is a medium shot. The men are the main focus, with the setting as a secondary element.
  • The picture is angled slightly, with both men leaning inward towards the drawing.
  • The image is damaged with tears.

Overall Impression: The photograph captures a formal, possibly official moment. It could depict a presentation, a review of artwork, or some other kind of formal interaction between the two men.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-27

The image depicts two men in formal attire, likely from the mid-20th century, standing near a doorway with an arched window above it. The man on the left is wearing a dark suit with a white shirt and a tie, while the man on the right is also in a dark suit, with a patterned tie. They are both looking at a photograph or document that the man on the right is holding. The photograph appears to show a person walking on a beach with a dog. The setting suggests a formal or professional context, possibly an office or a meeting room. The overall tone of the image is serious and focused, indicating that the two men are engaged in a discussion or examination of the document.