Human Generated Data

Title

Colonel John Lee (1695-1761)

Date

1744

People

Artist: Allan Ramsay, British 1713 - 1784

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of David Rockefeller, 1965.542

Human Generated Data

Title

Colonel John Lee (1695-1761)

People

Artist: Allan Ramsay, British 1713 - 1784

Date

1744

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of David Rockefeller, 1965.542

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 95.6
Human 94.1
Person 94.1
Painting 93.6
Clothing 83
Apparel 83
Drawing 74.9
Face 67.7
Female 67.7
Portrait 61.7
Photography 61.7
Photo 61.7
Text 56.2

Clarifai
created on 2020-04-24

portrait 99.9
people 99.8
art 99.6
one 99.1
adult 98.4
engraving 95.6
woman 95.6
vintage 94.6
old 94.2
wear 93.5
veil 93.2
antique 90.6
royalty 90.1
man 89.6
queen 88.3
monochrome 87.7
monarch 87.1
retro 83.9
print 83.6
crown 83

Imagga
created on 2020-04-24

portrait 40.8
person 36
adult 33
blond 30.4
attractive 30.1
fashion 26.4
pretty 25.9
model 24.1
lady 23.5
sexy 23.3
people 22.9
smile 22.8
happy 20.7
hair 20.6
face 19.9
dress 19
black 18.5
elegant 16.3
groom 16.2
lifestyle 15.2
man 14.8
adolescent 14.6
make 14.5
bride 14.4
lips 13.9
cover girl 13.7
cute 13.6
sensuality 13.6
looking 13.6
human 13.5
elegance 13.4
love 13.4
clothing 13.2
look 13.1
brunette 13.1
smiling 13
juvenile 12.7
style 12.6
lovely 12.4
studio 12.2
wedding 12
expression 11.9
eyes 11.2
old 11.1
business 10.9
sensual 10.9
bridal 10.7
posing 10.7
gong 10.5
modern 10.5
suit 10.5
one 10.5
body 10.4
women 10.3
wig 10.3
male 10
gown 9.9
holding 9.9
percussion instrument 9.9
cheerful 9.8
luxury 9.4
hat 9.4
head 9.2
car 9.2
guy 9.2
makeup 9.2
gorgeous 9.1
interior 8.8
working 8.8
skin 8.6
sitting 8.6
hairstyle 8.6
casual 8.5
clothes 8.4
hand 8.4
dark 8.4
jacket 8.3
nice 8.2
veil 7.8
married 7.7
covering 7.5
hairpiece 7.4
long 7.3
costume 7.3
businesswoman 7.3
musical instrument 7.3
office 7.2
work 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 99.9
person 98.9
human face 97.7
wall 95.6
book 94.2
clothing 86.4
portrait 84.8
old 81.4
suit 76.5
painting 72.4
posing 71.9
woman 70.6
white 61.6

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 22-34
Gender Male, 92.3%
Angry 0.2%
Fear 0%
Disgusted 0.1%
Happy 0.1%
Calm 98.1%
Sad 0.7%
Surprised 0.1%
Confused 0.6%

Microsoft Cognitive Services

Age 30
Gender Male

Feature analysis

Amazon

Person 94.1%
Painting 93.6%

Categories

Captions

Azure OpenAI

Created on 2024-12-04

This image is a grayscale photo of a classical portrait painting. The figure in the painting is posed in a three-quarter view, looking off to the left side of the canvas but with the body facing slightly towards the viewer. This individual is wearing a dark jacket adorned with elaborate decorations, featuring metallic braid and large buttons with a detailed pattern that suggest a high social or military rank. The jacket has a rich texture, and a white ruffled garment peeks out from the neckline, indicating a style that is consistent with 18th-century fashion. The hair appears to be styled in a manner typical of that period, with voluminous curls that would have demonstrated wealth or status. The picture is framed with a simple yet elegant frame that includes some ornamental detail. The name "COLONEL JOHN R." can be seen inscribed along the bottom of the frame, suggesting the possible title and partial name of the person depicted in the painting. There is a painter's signature visible at the lower right corner, indicating the artist's mark on the work. This signature, because it's part of the painting itself, gives a clue about the original creator of the artwork. The condition of the painting and frame looks well-preserved, which might imply that it is kept with care, possibly in a museum or private collection.

Anthropic Claude

Created on 2024-11-27

The image appears to be a portrait of a man wearing a formal coat with ornate embroidery and a lace cravat. He has curly white hair and a serious expression on his face. The portrait is presented in a black and white format, indicating it is likely an older painting or photograph. The man appears to be of high social status based on his attire.

Meta Llama

Created on 2024-11-24

The image is a black and white portrait of a man with curly hair, wearing a dark jacket with a ruffled collar and a high-collared shirt. The man's face is blurred, but his expression appears serious. He is looking directly at the viewer. * The man has curly hair that is styled in a way that suggests it may have been powdered or pomaded. * He is wearing a dark jacket with a ruffled collar and a high-collared shirt. The jacket appears to be made of a luxurious fabric, such as silk or velvet. * The man's face is blurred, but his expression appears serious. He is looking directly at the viewer, which suggests that he may be trying to convey a sense of confidence or authority. * The background of the portrait is a plain, dark color. There are no other objects or people visible in the image. * The frame around the portrait is ornate and decorative. It appears to be made of wood or metal and has a intricate design. Overall, the image suggests that the man is a person of importance or status, possibly a member of the aristocracy or a high-ranking official. The serious expression on his face and the luxurious clothing he is wearing suggest that he may be trying to convey a sense of power or authority.

Text analysis

Amazon

COLONEl