Human Generated Data

Title

Sketches of Heads and Coat of Arms

Date

1869

People

Artist: John Singer Sargent, American 1856 - 1925

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Francis Ormond, 1937.7.2.3

Human Generated Data

Title

Sketches of Heads and Coat of Arms

People

Artist: John Singer Sargent, American 1856 - 1925

Date

1869

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Francis Ormond, 1937.7.2.3

Machine Generated Data

Tags

Amazon
created on 2020-04-25

Drawing 95
Human 95
Art 95
Person 89.8
Sketch 84.5
Armor 79.8
Face 63.5

Clarifai
created on 2020-04-25

art 98.2
illustration 97.8
old 95.6
man 94.9
paper 94.6
retro 93.8
painting 93.1
vintage 92.8
artistic 92.4
wear 90.2
dirty 89.4
portrait 89.4
people 89.3
graffiti 88.1
symbol 87.8
antique 87.5
chalk out 85.4
design 85.2
print 82.8
creativity 82.7

Imagga
created on 2020-04-25

sketch 78.3
drawing 55.8
representation 48.9
decoration 31.3
graffito 29.8
art 22.4
negative 21.1
statue 20.1
architecture 19.6
face 19.2
ancient 19
mask 17.9
sculpture 17.7
film 16.6
cash 16.5
money 16.2
old 15.3
currency 15.3
stone 14.6
religion 13.4
photographic paper 12.9
culture 12.8
design 12.5
god 12.4
detail 12.1
dollar 12.1
disguise 12
vintage 11.6
antique 11.3
style 11.1
church 11.1
traditional 10.8
bank 10.8
bill 10.5
portrait 10.4
ornament 10.3
monument 10.3
banking 10.1
figure 10.1
historic 10.1
wealth 9.9
close 9.7
stucco 9.5
grunge 9.4
carving 9.3
finance 9.3
decorative 9.2
texture 9
fantasy 9
closeup 8.8
photographic equipment 8.6
wall 8.6
travel 8.5
religious 8.4
savings 8.4
rich 8.4
famous 8.4
economy 8.3
one 8.2
pattern 8.2
retro 8.2
man 8.1
history 8.1
financial 8
business 7.9
colorful 7.9
banknotes 7.8
artistic 7.8
color 7.8
carnival 7.8
golden 7.7
dollars 7.7
covering 7.7
old fashioned 7.6
human 7.5
element 7.4
tourism 7.4
cover 7.4
people 7.3
dirty 7.2
celebration 7.2
holiday 7.2
building 7.1
romantic 7.1
paper 7.1
costume 7.1

Google
created on 2020-04-25

Head 88.4
Illustration 86.9
Drawing 86.7
Sketch 84.6
Art 83.1
Facial hair 78.2
Font 68.6
Beard 63.6
Jaw 63
Visual arts 59.3
Artwork 58
Watercolor paint 56.9
Style 51
Graphics 50.4

Microsoft
created on 2020-04-25

drawing 99.7
sketch 99.3
art 96.3
painting 95.9
child art 95.1
illustration 86
human face 83.9
text 77.3
cartoon 66.2
old 60.1
ink 53.4
linedrawing 30.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-65
Gender Male, 75.8%
Fear 0.1%
Disgusted 0.5%
Surprised 0.2%
Happy 0.2%
Angry 0.3%
Sad 0.3%
Confused 0.1%
Calm 98.4%

AWS Rekognition

Age 8-18
Gender Male, 69.1%
Fear 3.8%
Confused 2.7%
Calm 24.4%
Angry 21.5%
Surprised 0.6%
Sad 38.6%
Disgusted 5.4%
Happy 3.1%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 89.8%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2020-04-25

a drawing of a person 45.7%
a drawing of a face 45.6%
a drawing of a person 45.5%

Azure OpenAI

Created by gpt-4 on 2024-12-14

This image displays a hand-painted coat of arms on the left side, featuring a blue shield with a diagonal white band containing decorative elements that resemble fleur-de-lis symbols. The background includes soft brushstrokes in muted brown and blue shades. Handwritten inscriptions below the coat of arms appear to provide context or describe the emblem, although the specifics of the text are not clearly visible. The right side of the image includes a section with overlaid gray rectangles, possibly to obscure underlying content. The artwork has an antique or historical quality, indicated by the style of painting and the paper's aged appearance.

Created by gpt-4o-2024-05-13 on 2024-12-14

The image features a hand-painted illustration of a shield or coat of arms on the left side. The shield has a blue background with a white diagonal band running from the top left to the bottom right. The white band is decorated with a vine-like pattern. Handwritten text around the shield reads, "Arms of Boubat de Los Mons ties of Sanda." The image also has a watercolor sketch on the right side.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-14

The image appears to be a hand-drawn sketch or watercolor painting. It consists of two main elements - a heraldic shield design on the left side, and a detailed portrait-like depiction of a bearded male figure on the right. The shield is colored in shades of blue and features some artistic calligraphic text or symbols. The male figure has a serious, pensive expression and appears to be wearing some kind of headgear or hat. The overall composition has a historical or antiquarian feel to it, with the shield and portrait-like rendering suggesting this could be an illustration from a manuscript or other historical document.

Created by claude-3-5-sonnet-20241022 on 2024-12-14

This image appears to be a historical artwork or sketch featuring two main elements. On the left is a heraldic shield or coat of arms, painted in blue and white with a diagonal band (bend) across it containing what appears to be text or decorative elements. The shield is rendered in watercolor with blue being the dominant color. On the right side is a watercolor or ink sketch depicting two figures rendered in gray tones. The sketch has a loose, gestural quality typical of preliminary studies or quick observational drawings. The figures appear in close proximity to each other, suggesting a familial or close relationship between them. The overall composition has a documentary or study-like quality, as if it might be part of a larger collection of historical records or personal sketches.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-14

The image is a watercolor painting of a coat of arms and two portraits, created by Pablo Picasso in 1901. The coat of arms features a blue shield with a white diagonal stripe, adorned with a blue bird and a blue scroll bearing illegible writing. The portrait on the right depicts a man with a beard and long hair, while the smaller portrait on the left shows a child with dark hair. The background of the painting is a light beige color, with some faint red and brown strokes visible behind the portraits. The overall style of the painting is reminiscent of Picasso's early work, characterized by bold lines and simple forms.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-14

The image depicts a watercolor painting of a shield with a blue and white design, accompanied by a sketch of two faces. The shield is positioned on the left side of the image, featuring a blue background with a white diagonal stripe that bears an illegible script. The shield is surrounded by a faint red border, which also contains handwritten text in black ink. Although the text is difficult to decipher, it appears to read "Arms of Boubac" followed by additional words that are unclear. On the right side of the image, there are two sketches of faces. The larger face is positioned at the top, while the smaller one is situated below it. Both faces are rendered in gray tones, with the larger face displaying a more detailed and realistic appearance. The background of the image is a light beige color, providing a subtle contrast to the vibrant colors of the shield and the sketches of the faces. Overall, the image presents a unique blend of artistic elements, combining the elegance of the shield with the expressive qualities of the face sketches.

Text analysis

Amazon

Mmsh
kuy
last Mmsh
last
th kuy il
il
Bmba
?a
th
avda
Ares
Ares s Bmba
s
7

Google

1Bakae
1Bakae