Human Generated Data

Title

Grand Duchess Marie

Date

17th century

People

Artist: Jacques Callot, French 1592 - 1635

Artist after: Matteo Rosselli, Italian 1578 - 1650

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, by exchange, S3.90.2

Human Generated Data

Title

Grand Duchess Marie

People

Artist: Jacques Callot, French 1592 - 1635

Artist after: Matteo Rosselli, Italian 1578 - 1650

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, by exchange, S3.90.2

Machine Generated Data

Tags

Amazon
created on 2019-04-02

Human 98.3
Person 98.3
Person 98.2
Person 98.2
Person 97.6
Person 96.3
Person 93.2
Art 91.8
Painting 87.9
Person 84.8
Person 81.4
Person 77.5
Person 77.2
Drawing 70.7
Person 66.3
Sketch 59.1

Clarifai
created on 2018-04-18

people 100
group 99.9
print 99.9
engraving 99.8
art 99.6
many 99.6
adult 99
man 98.9
illustration 98.8
leader 98.5
administration 97.4
several 94.2
royalty 92.1
gown (clothing) 90.6
woman 90.6
monarch 89.3
veil 88.6
lithograph 88.3
etching 87
wear 86.6

Imagga
created on 2018-04-18

sketch 100
drawing 81.4
representation 69.8
map 32.4
paper 28.2
old 24.4
money 23
texture 22.9
currency 22.5
finance 21.1
antique 20.9
design 20.8
vintage 20.7
pattern 20.5
grunge 18.7
dollar 18.6
bank 17
art 16.7
retro 16.4
wealth 16.2
atlas 16.1
business 15.8
cash 15.6
dollars 15.5
wallpaper 14.6
us 14.5
close 13.7
financial 13.4
backdrop 13.2
ancient 13
stucco 12.4
capital 12.3
number 12.1
banking 12
geography 11.6
bill 11.4
plan 11.4
frame 10.8
world 10.6
travel 10.6
backgrounds 10.6
grungy 10.4
decoration 10.2
dirty 10
road 9.9
history 9.8
sign 9.8
hundred 9.7
lace 9.7
navigation 9.6
black 9.6
loan 9.6
graphic 9.5
page 9.3
economy 9.3
house 9.2
decorative 9.2
style 8.9
wages 8.8
textured 8.8
sepia 8.7
banknote 8.7
pay 8.6
snow 8.6
savings 8.4
globe 8.3
investment 8.3
border 8.1
structure 7.9
architecture 7.8
discovery 7.8
continent 7.8
states 7.7
construction 7.7
wall 7.7
direction 7.6
planet 7.5
journey 7.5
city 7.5
element 7.4
brown 7.4
note 7.4
earth 7.3
success 7.2
detail 7.2
aged 7.2
color 7.2
painting 7.2
building 7.1

Google
created on 2018-04-18

history 79.1
black and white 78.1
sketch 71.8
drawing 70.8
art 70.7
artwork 68.1
figure drawing 63.2
middle ages 57.8
visual arts 55.1
monochrome 53.9

Microsoft
created on 2018-04-18

text 98.3
book 90.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 53.9%
Disgusted 45.4%
Happy 45.8%
Confused 45.5%
Angry 46.2%
Calm 46.2%
Surprised 45.8%
Sad 50%

AWS Rekognition

Age 12-22
Gender Female, 53.4%
Surprised 45.3%
Angry 45.3%
Sad 51.8%
Confused 45.4%
Happy 45.1%
Calm 46.9%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 45.4%
Angry 46.2%
Confused 46.2%
Sad 47.5%
Disgusted 46.5%
Surprised 45.5%
Calm 47.6%

AWS Rekognition

Age 20-38
Gender Female, 54.6%
Confused 45.2%
Surprised 45.1%
Calm 45.7%
Sad 53.3%
Angry 45.5%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Male, 50.9%
Disgusted 45.4%
Calm 51.8%
Happy 45.1%
Sad 46%
Angry 45.7%
Confused 45.5%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Male, 51.2%
Sad 46.3%
Disgusted 45.3%
Surprised 47%
Confused 45.8%
Calm 49%
Angry 46.5%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Happy 45.5%
Sad 49.7%
Disgusted 45.3%
Calm 47.9%
Angry 45.5%
Confused 45.5%
Surprised 45.6%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Disgusted 45.3%
Happy 45.2%
Angry 45.7%
Calm 46.8%
Surprised 48.9%
Sad 47.4%
Confused 45.7%

AWS Rekognition

Age 20-38
Gender Male, 53.4%
Sad 46.4%
Confused 45.5%
Disgusted 45.2%
Happy 45.1%
Angry 45.7%
Surprised 45.2%
Calm 51.9%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Disgusted 46.3%
Sad 45.3%
Calm 49.4%
Happy 46.9%
Angry 45.7%
Surprised 45.8%
Confused 45.5%

AWS Rekognition

Age 35-52
Gender Male, 78.2%
Confused 5.2%
Disgusted 3.8%
Happy 3.3%
Sad 70.1%
Angry 6.8%
Calm 6.7%
Surprised 4.2%

AWS Rekognition

Age 27-44
Gender Female, 53.2%
Surprised 45.2%
Angry 45.4%
Disgusted 45.1%
Confused 45.6%
Happy 45.2%
Calm 45.8%
Sad 52.6%

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Disgusted 45.7%
Surprised 45.7%
Sad 48.7%
Happy 45.2%
Calm 47.9%
Confused 45.9%
Angry 45.9%

AWS Rekognition

Age 35-52
Gender Female, 61.1%
Disgusted 1%
Calm 55%
Sad 29.4%
Angry 4.7%
Surprised 3.4%
Confused 4.3%
Happy 2.2%

AWS Rekognition

Age 10-15
Gender Male, 53.2%
Angry 45.8%
Disgusted 47.1%
Sad 48.4%
Confused 45.7%
Calm 47.1%
Happy 45.4%
Surprised 45.6%

AWS Rekognition

Age 30-47
Gender Male, 54.5%
Surprised 46%
Disgusted 45.3%
Sad 46.5%
Confused 46.4%
Angry 46.3%
Happy 45.7%
Calm 48.8%

AWS Rekognition

Age 29-45
Gender Female, 54.3%
Calm 53.2%
Angry 45.3%
Disgusted 45.2%
Surprised 45.6%
Confused 45.3%
Sad 45.4%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Female, 52.8%
Angry 45.8%
Surprised 45.9%
Disgusted 45.2%
Happy 47.4%
Calm 47.4%
Sad 47.8%
Confused 45.5%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 81
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Painting 87.9%

Categories

Captions

Microsoft
created on 2018-04-18

a close up of a book 29%
close up of a book 24.1%
a hand holding a book 24%

Azure OpenAI

Created by gpt-4 on 2024-12-11

This image depicts a scene set in a classical or historical setting. The environment suggests an outdoor space, likely a courtyard or public square, lined with classical architecture, complete with columns and statues. The individuals are dressed in attire that suggests a scene from a period often associated with historical Europe, perhaps the Renaissance or an earlier era. Some figures are wearing elaborate gowns and robes, indicating high social status or nobility, while others are dressed more simply. In the foreground, a figure on the left appears to be brandishing a spear or staff. The attire of several characters includes ruffs and garments adorned with intricate patterns, indicating a high level of detail in the costumes. This attention to the details of dress and the careful depiction of architectural elements suggest that the image could be a reproduction of an historical event, or perhaps an illustration for a literary or historical narrative. The presence of onlookers in varied poses—some attentive, some more casual—adds to the scene's dynamic and provides a sense of an unfolding event being witnessed by a crowd.

Created by gpt-4o-2024-05-13 on 2024-12-11

The image is a highly detailed, monochromatic historical drawing or etching. It depicts a group of individuals dressed in elaborate, period-specific attire. The scene likely takes place in an urban area with classical architecture, featuring columns and ornate buildings in the background. Many of the figures appear to be engaged in conversation or watching an event. Some individuals carry spears or are adorned in ceremonial garments, suggesting a formal occasion or procession. The artwork is rich in detail, reflecting the textures and fabrics of the clothing, as well as the architectural elements surrounding the figures.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-11

The image depicts an elaborate and ornate scene taking place within a grand, classical architectural setting. It appears to show a procession or ceremonial event, with numerous figures dressed in elaborate, period costumes. The central figure seems to be a woman wearing an elaborate gown and headdress, surrounded by a crowd of people. In the background, there are additional architectural elements and structures visible. The overall impression is one of a highly detailed and intricate historical scene.

Created by claude-3-5-sonnet-20241022 on 2024-12-11

This is a historical engraving or print that appears to depict a scene from the 16th or 17th century. The setting is inside what looks like a grand building with classical architecture, featuring columns and ornate details. The scene shows a gathering of people dressed in period clothing including robes, cloaks, and elaborate costumes of the era. Some figures are wearing fur-trimmed garments while others are in simpler attire. The composition includes both adults and children, and there appears to be a mix of social classes represented by their varying styles of dress. In the background, through what seems to be an opening or doorway, you can see architectural elements including spires or towers. The artwork is rendered in a detailed line drawing style typical of engravings from this period, with careful attention to the textures of fabrics and architectural details.

Text analysis

Amazon

Fha