Human Generated Data

Title

The Brothers Pixis

Date

1800

People

Artist: Heinrich Sintzenich, German 1752 - 1812

Artist after: Johann Heinrich Schröder, German 1757-1812

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R15125

Human Generated Data

Title

The Brothers Pixis

People

Artist: Heinrich Sintzenich, German 1752 - 1812

Artist after: Johann Heinrich Schröder, German 1757-1812

Date

1800

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R15125

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.3
Human 99.3
Person 97.4
Art 78.8
Text 76.9
Leisure Activities 76.2
Painting 69
Portrait 63.4
Face 63.4
Photography 63.4
Photo 63.4
Drawing 59.4
Musical Instrument 57.4

Clarifai
created on 2023-10-29

people 100
adult 99.8
art 99.7
portrait 99.5
two 99.4
print 98.3
painting 98.2
man 98
one 97.8
wear 97.7
woman 96.9
group 96.8
illustration 96.8
music 95.6
retro 94.1
child 93.4
veil 92.6
instrument 91
three 90.7
vintage 90.6

Imagga
created on 2022-02-26

phonograph record 54.3
money 34
currency 33.2
dollar 28.7
cash 28.3
paper 23.5
finance 22.8
business 21.8
banking 21.1
bank 20.6
wealth 19.7
financial 19.6
bill 19
dollars 17.4
close 16.5
one 15.7
art 15.1
vintage 14.9
portrait 14.9
man 14.8
pay 14.4
savings 14
old 13.9
banknote 13.6
hundred 13.5
us 13.5
rich 13
franklin 12.8
finances 12.5
loan 12.4
economy 12
religion 11.6
exchange 11.4
closeup 11.4
stringed instrument 11.3
investment 11
symbol 10.8
payment 10.6
profit 10.5
success 10.4
person 10.4
male 10
bills 9.7
black 9.6
church 9.2
musical instrument 9
sign 9
president 8.8
funds 8.8
banknotes 8.8
face 8.5
adult 8.5
religious 8.4
radio telescope 8.3
note 8.3
style 8.1
people 7.8
antique 7.8
price 7.7
capital 7.6
commerce 7.5
gold 7.4
concepts 7.1
love 7.1
conceptual 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.9
book 99.3
person 98.1
human face 95.9
old 95.7
clothing 92.9
black 87.8
vintage 84.9
posing 80.8
woman 67.3
white 61.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 96.7%
Calm 80.5%
Happy 12.5%
Confused 2%
Sad 1.9%
Angry 1.3%
Surprised 0.8%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 12-20
Gender Male, 97.6%
Calm 79.4%
Sad 9.4%
Happy 3.4%
Confused 2.9%
Angry 2.3%
Fear 1%
Surprised 0.9%
Disgusted 0.8%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99.3%
Person 97.4%
Painting 69%

Categories

Imagga

paintings art 78.4%
people portraits 20.1%
food drinks 1.3%

Captions

OpenAI GPT

Created by gpt-4 on 2025-01-28

The image features a vintage look with an oval-shaped portrait containing two individuals. The person on the left appears to be holding a stringed instrument resembling a violin and a bow as if they are in the midst of playing music. The individual on the right is positioned slightly behind the violinist, suggesting a secondary role in the image. The attire of both individuals suggests a historical period with formal clothing, possibly from the 18th or 19th century. Below the portrait is text that appears to say "Les Soeurs..." which could be French for "The Sisters" or a similar phrase, but the remainder of the text is not clearly readable. The soft sepia tones and the formal presentation of the subjects imply this could be a representation of a musical performance or an artistic portrayal of musicians from a bygone era. The image as a whole has an aged look with some spots and discoloration consistent with old artwork or photographs.

Created by gpt-4o-2024-05-13 on 2025-01-28

The image is an old sepia-toned print depicting two children engaged in musical activities. One child is seated and appears to be playing or preparing to play a keyboard instrument, possibly a piano or harpsichord, as indicated by the sheet music and the keys in front of them. The other child is standing beside the seated child and is playing a violin, holding the instrument in proper form with the bow on the strings. Both children are dressed in period clothing, with high collars and long-sleeved attire typical of the time. The style of the print and their attire suggest a historical setting, possibly the 18th or early 19th century.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2025-01-28

This is a historical sepia-toned portrait titled "Les Frères Paris" (The Paris Brothers), showing two young musicians. One is seated at what appears to be a piano or keyboard instrument, while the other stands holding a violin and bow. Both are dressed in the formal style of late 18th or early 19th century fashion, wearing dark jackets with white ruffled collars. The composition is set within an oval frame against a dark background, creating a classical portrait style common in that era. The image appears to be a print or engraving rather than a painting, and demonstrates the importance of musical education and performance among the upper classes during this period.

Created by claude-3-opus-20240229 on 2025-01-28

The sepia-toned image depicts two young boys playing musical instruments together. The boy on the left appears to be playing a piano or harpsichord, while the boy on the right is playing a violin. Both boys have short, light-colored hair and are wearing dark, formal clothing typical of the late 18th or early 19th century period. The oval-shaped portrait is set against a plain background, focusing attention on the musical scene. Below the image is a handwritten caption that reads "Les (Freres?) Pixis".

Created by claude-3-haiku-20240307 on 2025-01-28

The image appears to be a sepia-toned portrait depicting two young boys. One boy is seated, holding a book, while the other is standing behind him and playing a violin. Both boys are dressed in formal attire, suggesting this is a portrait of two young musicians or prodigies. The image has an oval shape and appears to be an engraved or etched work, likely from a historical period. The caption at the bottom reads "Les Freres Paris", which seems to be the title or identification of the two subjects.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-28

The image is a black-and-white portrait of two young boys. The boy on the left is seated on a chair, while the boy on the right is standing. Both boys are wearing jackets, and the boy on the right is holding a violin. The boy on the left is looking at the boy on the right, and the boy on the right is looking at the boy on the left.

Created by amazon.nova-lite-v1:0 on 2025-01-28

The image is a black-and-white portrait of two young boys, one seated and the other standing. The boy seated is wearing a black coat and has his hands on the piano. The boy standing is holding a violin and bow. Both boys are looking at the camera, and the boy seated is looking at the boy standing. The portrait has a white border and is signed "Les Freres Pixis" at the bottom.

Text analysis

Amazon

1860
Ferères
Browldwing Hef Mahlor 1860 Ferères Picis
Picis
Schoider
gomahlt
yeard
Hef Mahlor
Browldwing
Koreaz
backstand
griboka

Google

foreres es
foreres
es