Human Generated Data

Title

Isaac Dupee

Date

1818

People

Artist: Benjamin Greenleaf, American 1769 - 1821

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Howell Family Trust, 2023.487

Human Generated Data

Title

Isaac Dupee

People

Artist: Benjamin Greenleaf, American 1769 - 1821

Date

1818

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Howell Family Trust, 2023.487

Machine Generated Data

Tags

Amazon
created on 2024-04-05

Art 100
Painting 100
Face 100
Head 100
Photography 100
Portrait 100
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Clothing 76.3
Coat 76.3
Drawing 56.6

Clarifai
created on 2024-04-05

people 99.3
portrait 98.3
one 95.6
dinner jacket 94.6
adult 93.1
wear 91.8
man 91.4
actor 90.6
menswear 89.3
jacket 82.1
fashion 80.7
facial expression 79
music 78.4
actress 72.4
woman 70.8
editorial 70.8
art 68.4
painting 64.7
model 63.6
musician 62.7

Imagga
created on 2024-04-05

suit 100
garment 88.5
bow tie 70.3
necktie 68.8
clothing 60.4
man 57.9
businessman 52.2
male 48.3
business 45
adult 35
handsome 34.8
person 34.4
tie 34.2
executive 33.8
portrait 32.4
corporate 30.1
expression 29.9
covering 29.8
consumer goods 28.9
professional 28.3
people 26.3
success 25.8
face 24.2
successful 23.8
confident 23.7
guy 22.5
office 21.7
jacket 20
men 19.8
black 19.6
smile 19.3
looking 19.2
one 18
manager 17.7
human 16.5
happy 16.3
boss 16.3
studio 16
smiling 15.9
work 14.9
hand 14.5
model 14
shirt 13.1
standing 13.1
glasses 13
elegant 12.9
worker 12.7
businesspeople 12.4
mature 12.1
occupation 11.9
attractive 11.9
lawyer 11.6
formal 11.5
fashion 11.3
modern 11.2
company 11.2
alone 11
businessperson 10.7
job 10.6
one person 10.4
head 10.1
friendly 10.1
businesswoman 10
hands 9.6
eyes 9.5
happiness 9.4
money 9.4
look 8.8
leader 8.7
gesture 8.6
career 8.5
casual 8.5
finance 8.5
finger 8.3
funny 8.3
posing 8
lifestyle 8
confidence 7.7
only 7.6
cheerful 7.3
color 7.2
employee 7

Google
created on 2024-04-05

Forehead 98.5
Nose 98.4
Cheek 97.9
Eye 93.6
Jaw 88.1
Art 83.7
Collar 80.5
No expression 79.5
Painting 78.6
Blazer 76.4
Facial hair 74.8
Suit 73.9
Moustache 72.1
Formal wear 71.4
Self-portrait 68.1
Drawing 66.8
Pleased 65.4
Illustration 65.3
Visual arts 59.7
Portrait 58.8

Microsoft
created on 2024-04-05

human face 98.9
portrait 98.8
clothing 96.3
man 95.6
painting 94.2
person 92.3
chin 91.5
forehead 90.4
cheek 86.5
gentleman 86.4
suit 70.2

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 86.5%
Angry 4.9%
Confused 2.3%
Sad 0.4%
Surprised 0.2%
Fear 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 44
Gender Male

Feature analysis

Amazon

Person 99.1%
Adult 99.1%
Male 99.1%
Man 99.1%
Coat 76.3%

Categories

Imagga

events parties 99.9%

Captions

Microsoft
created on 2024-04-05

a man with a tattoo on his face 36.2%

Azure OpenAI

Created on 2024-12-03

This is a painting of an individual wearing formal attire from an earlier century. The person is dressed in a black coat with a sharply pointed lapel, a white waistcoat, and a white shirt with a high, ruffled collar. There's a detail of elaborate, decorative embroidery on the waistcoat and a cameo-like oval object on what appears to be a chain or ribbon around the neck. The clothing style suggests a historical or classical influence. The individual is portrayed from a side profile, and the hair is styled in a fashion typical of previous eras, neatly swept back. In the lower segment of the painting, there is a small plaque with handwritten inscription, but the content of the text is unclear from this view. The background of the painting is a flat, muted green color, which provides a distinct contrast to the dark clothing and paler fabrics of the attire.

Anthropic Claude

Created on 2024-11-27

The image depicts a portrait of a man wearing a formal black coat and a white ruffled shirt. He has dark, curled hair and a serious expression on his face. The portrait appears to be a painting, with a textured background in a muted green color. The painting style seems to be realistic, capturing the man's facial features and details of his attire.

Meta Llama

Created on 2024-11-23

The image depicts a portrait of a man, likely from the 19th century, based on the style and clothing. The man is dressed in formal attire, with a black suit jacket, white shirt, and cravat. His dark hair is styled in a pompadour fashion, and he has a serious expression on his face. The background of the portrait is a muted green color, which adds to the overall sense of formality and elegance. In the bottom-left corner of the image, there is a small, illegible note or label that appears to be handwritten. This note may provide additional context or information about the subject of the portrait, but its contents are unclear. Overall, the image presents a dignified and refined portrait of a man from a bygone era, with attention to detail and a sense of historical significance.

Text analysis

Amazon

Born
Born Aug. 31,
DID
31,
DUI
ISAAC DUI DID
Aug.
ISAAC
9:00
9:00 and
17%1
and

Google

TOMAC DUPED Born Aug. 31 171
TOMAC
DUPED
Born
Aug.
31
171