Human Generated Data

Title

Portrait of John Jay

Date

19th century

People

Artist: Joseph Andrews, American 1806 - 1873

Artist after: Gilbert Stuart, American 1755 - 1828

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3782

Human Generated Data

Title

Portrait of John Jay

People

Artist: Joseph Andrews, American 1806 - 1873

Artist after: Gilbert Stuart, American 1755 - 1828

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3782

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Face 100
Head 100
Photography 100
Portrait 100
Person 99.5
Baby 99.5
Art 99.4
Painting 99.4
Hole 64.5
Accessories 60.1
Earring 60.1
Jewelry 60.1
People 56.8
Text 56

Clarifai
created on 2019-02-26

people 93.3
house 92.5
portrait 92.1
one 90.5
vintage 90.4
wear 90
wall 89.9
texture 89.9
door 89.8
adult 89.8
art 89.7
building 89.3
no person 88.9
retro 88.8
window 88.6
symbol 87.5
old 87.1
room 86.8
desktop 86.2
architecture 85.7

Imagga
created on 2019-02-26

wall clock 100
timepiece 100
clock 100
measuring instrument 78.5
instrument 40.6
old 33.4
antique 28.6
vintage 26.5
grunge 26.4
texture 25
dirty 23.5
retro 22.9
wall 22.2
aged 21.7
paper 18.8
ancient 16.4
pattern 15
empty 14.6
parchment 14.4
worn 14.3
design 14.1
page 13.9
time 13.7
rough 13.7
sign 13.5
material 13.4
art 13
wallpaper 12.2
detail 12.1
wooden 11.4
text 11.3
number 11.2
blank 11.1
closeup 10.8
symbol 10.8
textured 10.5
book 10.1
decorative 10
wood 10
surface 9.7
metal 9.7
decay 9.6
rust 9.6
damaged 9.5
rusty 9.5
card 9.3
document 9.3
close 9.1
business 9.1
brown 8.8
age 8.6
door 8.6
space 8.5
backdrop 8.2
technology 8.2
architecture 7.8
travel 7.7
cardboard 7.7
watch 7.7
old fashioned 7.6
weathered 7.6
grungy 7.6
canvas 7.6
frame 7.5
grain 7.4
water 7.3
digital 7.3
decoration 7.2
color 7.2

Google
created on 2019-02-26

Illustration 62.3
Drawing 60.7
Circle 56.3
Art 50.2

Microsoft
created on 2019-02-26

art 19.8
wall 9.9
black and white 8.1
monochrome 3.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Calm 98.6%
Surprised 6.4%
Fear 6%
Sad 2.2%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

Feature analysis

Amazon

Person
Baby
Person 99.5%

Categories

Captions

Microsoft
created on 2019-02-26

a close up of a white wall 65.8%
close up of a white wall 60.3%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-28

The image features a small, oval-shaped portrait centrally placed within a large, blank, beige background. The subject is depicted with elaborate clothing that appears to be from a historical or formal setting, adorned with intricate details and textures. The portrait itself is rendered in a classic, monochromatic tone, emphasizing the subject’s clothing and overall attire.

Created by gpt-4 on 2025-01-28

This is an image of an oval-shaped, black-and-white portrait that is centrally mounted on a larger piece of cardstock or paper. The portrait is inset within a bordered cutout, which gives the photograph a framed appearance. The overall look suggests this could be a vintage or historical photograph often used for personal keepsakes or professional display. The paper backing shows some signs of aging or wear, denoted by slight discoloration and markings, indicative of the photograph's age or handling over time. The style of clothing, though not discussed in detail, seems to be of an older fashion.

Anthropic Claude

Created by claude-3-opus-20240229 on 2025-01-28

The image shows an oval portrait engraving of a man wearing 18th century clothing, including a coat and ruffled shirt or cravat. The portrait is set within a simple, round frame on a plain background. The engraving style captures fine details of the man's facial features and clothing textures in black and white tones.

Created by claude-3-haiku-20240307 on 2025-01-28

The image appears to be a black and white portrait engraving of a man. The portrait is framed and centered within the image, surrounded by a plain background. The man depicted has a distinctive hairstyle and facial features characteristic of the time period when this engraving was likely created.

Created by claude-3-5-sonnet-20241022 on 2025-01-28

This is a historical oval portrait engraving, centered on a plain light-colored background. The small portrait shows someone wearing what appears to be 18th century formal attire, including what looks like a military or naval uniform coat. The engraving is done in a classical style with fine detail work typical of that era. The portrait is quite small relative to the overall paper size, with considerable empty space surrounding it.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-01-28

The image features a portrait of a man in the center, set against a beige background. The portrait is encircled by a thin black line and is positioned within a rectangular border that is also outlined in black. The man's attire consists of a dark jacket with a lighter-colored vest underneath, complemented by a white shirt and a cravat or tie. His hair is styled in a manner characteristic of the 18th century. The overall appearance of the image suggests that it may be an old photograph or print, possibly from the 18th or 19th century. The beige background and the style of the man's clothing and hairstyle are consistent with this time period.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-28

The image depicts a portrait of a man with a clean-shaven face. He is dressed in formal attire, including a coat and a white shirt with a collar. The portrait is framed in a circular shape, and the background is plain, with no additional details or objects present. The portrait is printed on a piece of paper, and the paper itself is slightly textured. The overall tone of the image is monochromatic, with shades of black and white.

Created by amazon.nova-lite-v1:0 on 2025-01-28

The image is an old portrait of a man. The portrait is in black and white, and the man is wearing a suit and tie. The portrait is in a circular shape, and it is on a white background. The portrait is in a small frame, and it is on a white paper. The portrait is in a vintage style, and it is probably an old portrait.