Human Generated Data

Title

George Balanchine (1903-1983)

Date

c. 1950

People

Artist: George Platt Lynes, American 1907 - 1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, P1977.24

Human Generated Data

Title

George Balanchine (1903-1983)

People

Artist: George Platt Lynes, American 1907 - 1955

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, P1977.24

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.5
Human 98.5
Skin 91.6
Finger 88.2
Clothing 82.6
Apparel 82.6
Sleeve 80.8
Arm 74.5
Hand 58.6
Man 57.5

Clarifai
created on 2023-10-26

people 99.9
portrait 99.8
adult 99.1
man 99
one 98.4
monochrome 97.9
actor 97.4
art 95
wear 93.2
outfit 92.6
leader 91.9
retro 89.8
writer 88.8
chair 87.1
cigar 86
lid 85.9
furniture 85.9
amusing 85.5
facial expression 84.8
music 84.3

Imagga
created on 2022-01-22

person 43.2
portrait 39.5
adult 37
attractive 30.1
fashion 27.9
sexy 27.3
people 26.8
brunette 25.3
model 24.1
pretty 23.8
hair 22.2
studio 21.3
black 20.7
adolescent 20.3
style 20
face 19.9
lady 19.5
juvenile 18.3
happy 18.2
dress 18.1
smile 17.8
smiling 17.4
male 16.5
posing 16
man 15.5
clothing 15.4
youth 15.3
looking 15.2
lifestyle 13.7
make 13.6
child 13.5
elegance 13.5
happiness 13.3
eyes 12.9
expression 12.8
alone 12.8
one 12.7
women 12.7
clothes 12.2
professional 12.1
human 12
casual 11.9
business 11.6
cute 11.5
home 11.2
elegant 11.1
lips 11.1
love 11.1
businesswoman 10.9
vintage 10.8
cheerful 10.6
standing 10.4
skin 10.2
blond 10
indoors 9.7
bride 9.6
couple 9.6
20s 9.2
modern 9.1
sensual 9.1
holding 9.1
gorgeous 9.1
pose 9.1
single 9
domestic 8.9
brown 8.8
body 8.8
look 8.8
fashionable 8.5
suit 8.5
old 8.4
wedding 8.3
retro 8.2
confident 8.2
eye 8.1
romantic 8
color 7.8
garment 7.7
mother 7.5
dark 7.5
cosmetics 7.5
makeup 7.3
sensuality 7.3
handsome 7.1
smasher 7.1

Google
created on 2022-01-22

Flash photography 88.2
Sleeve 87.2
Gesture 85.3
Black-and-white 84.6
Style 83.9
Waist 83.9
Elbow 81.2
Trunk 77.7
Abdomen 76.9
Monochrome photography 74.8
Chest 74.7
Monochrome 73.7
Vintage clothing 72.2
T-shirt 65.1
Vest 64.7
Room 62.8
Stock photography 62.4
Sitting 61.9
Jewellery 59.6
Portrait 58.6

Microsoft
created on 2022-01-22

person 99.6
wall 97.9
text 95.8
clothing 86.8
human face 86.1
posing 72.9
old 67.9
sketch 55.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 97.4%
Confused 1.5%
Surprised 0.4%
Angry 0.3%
Sad 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.5%

Categories

Imagga

paintings art 99.7%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-18

a photograph of a man in a suit and tie with a baseball bat -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image depicts a man wearing a herringbone-patterned jacket draped over one shoulder with a neatly buttoned shirt and tie underneath. His left arm, which appears to be a sculpted or prosthetic wooden appendage, is holding a hammer, while his right hand grasps a hand crank tool. The composition suggests a juxtaposition of human and mechanical elements, possibly symbolizing themes of labor, craftsmanship, or transformation.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image depicts a person dressed in a formal shirt and trousers, over which is draped a herringbone-patterned jacket with a pocket square. The person is holding a large wrench in front of their chest, using their left hand. Their right arm appears to be unusual, resembling a mechanical or prosthetic arm, and is holding a hammer. The overall tone of the photograph is grayscale.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a man wearing a herringbone tweed coat and holding a cane. He has a serious, pensive expression on his face as he gazes directly at the camera. The black and white photograph captures the man's distinctive features, including his dark hair and strong jawline. The overall composition and lighting create a dramatic, contemplative mood.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white portrait photograph from what appears to be the mid-20th century. The subject is wearing a herringbone tweed jacket and light-colored shirt, and is shown in a dramatic pose holding what appears to be power tools or hand drills. The composition is quite artistic, with the subject positioned at an angle and photographed against a plain background with dramatic lighting. The photograph has a theatrical quality to it, suggesting it may have been taken as part of a promotional or artistic series. The image quality and style is characteristic of professional portrait photography from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a man holding a hammer and a drill.

  • The man is wearing a white shirt, a tweed jacket, and a tweed cape.
    • He has short dark hair and is looking to his right.
    • His left hand is holding a hammer, and his right hand is holding a drill.
    • The background of the image is a plain wall.
    • The overall atmosphere of the image suggests that the man is posing for a photo shoot or advertisement.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

This black-and-white photograph features a man holding a hammer in his right hand and a hand drill in his left. He is dressed in a white shirt, light-colored pants, and a herringbone-patterned coat draped over his shoulders. The man's dark hair is styled back, and he has a serious expression on his face as he looks to the right.

The background of the image is a plain wall, with a subtle vignette effect that draws attention to the subject. The overall atmosphere of the photograph suggests that it may be a promotional or publicity image for a play or film, possibly from the mid-20th century given the style of clothing and hairstyle.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man sitting and posing for a picture. He is dressed in formal attire, including a white shirt, a tie, and a gray jacket with a checkered pattern. He is holding a hammer and a mallet in his hands, which are placed on his lap. His face has a serious expression, and he is looking straight ahead. The background of the image is plain and gray, with no visible objects or people.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white photograph shows a man sitting on a chair and holding a hammer in his left hand. He is wearing a white shirt, a tie, and a gray coat with a pocket square. He is looking forward and seems to be posing for the photograph. The hammer in his left hand is attached to a wooden arm. He is probably a carpenter. The background is blurred.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall: The image is a black and white studio portrait of a man. He is formally dressed and has a thoughtful expression. The style suggests it's a vintage photograph.

The Man:

  • Pose: He is seated, with his body angled slightly towards the left. His gaze is directed off to his right, creating a contemplative or perhaps dramatic feel.
  • Attire: He is wearing a white dress shirt with a tie, light-colored trousers, and a herringbone tweed jacket draped over his shoulders, adding a layer of sophistication. A white handkerchief is tucked into the jacket pocket.
  • Additional detail: He is holding wooden prosthetic arms which hold a hammer and a hand drill.

Setting: The background is a smooth, light gray, typical of a studio portrait, which helps to isolate the subject and focus attention on him.

Created by gemini-2.0-flash on 2025-05-17

The image is a black and white portrait of a man in a suit jacket, sitting and looking off to the side. He has slicked back hair, and wears a light-colored collared shirt. His tweed jacket is draped around his shoulders, and has a white handkerchief in the pocket. In his left hand, he holds a wooden arm with a hammer. In his right hand, he holds a drill. The background is a simple gradient gray.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black-and-white photograph of a man posing with various tools and equipment. He appears to be dressed in a manner that suggests he is a handyman or involved in some form of manual labor. The man is wearing a white shirt with rolled-up sleeves, a tweed jacket draped over his shoulders, and light-colored pants. He is holding a hammer in his left hand and has a paint roller in his right hand. Additionally, there are two paintbrushes tucked into his belt, and a paint can opener is visible on his belt as well. The man has a serious expression on his face and is looking slightly to his right. The background is plain, which puts the focus entirely on the man and the tools he is holding. The image likely aims to convey a sense of readiness and competence in handling various household tasks.