Human Generated Data

Title

Portrait of Mrs. George Vesey and Her Daughter Elizabeth Vesey, later Lady Colthurst

Date

1816

People

Artist: Jean-Auguste-Dominique Ingres, French 1780 - 1867

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.854

Human Generated Data

Title

Portrait of Mrs. George Vesey and Her Daughter Elizabeth Vesey, later Lady Colthurst

People

Artist: Jean-Auguste-Dominique Ingres, French 1780 - 1867

Date

1816

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.854

Machine Generated Data

Tags

Amazon
created on 2023-10-18

Art 100
Painting 100
Drawing 98.2
Adult 98.2
Bride 98.2
Female 98.2
Person 98.2
Wedding 98.2
Woman 98.2
Adult 98
Bride 98
Female 98
Person 98
Woman 98
Face 95.1
Head 95.1

Clarifai
created on 2023-10-18

people 99.8
adult 99.4
art 99.1
print 98.6
woman 98.5
man 98.3
painting 97.3
two 97.2
veil 96.7
wear 96.5
illustration 95.7
one 95.2
portrait 92.7
sepia pigment 90.2
chalk out 89.8
retro 89.3
group 88.7
Renaissance 84
antique 83.9
gown (clothing) 82.5

Imagga
created on 2018-12-18

sketch 100
drawing 100
representation 100
cash 25.6
money 24.7
art 24
ancient 23.4
currency 23.3
sculpture 22.6
paper 20.5
banking 20.2
bank 19.7
old 19.5
finance 18.6
statue 18.4
financial 17.8
dollar 17.6
vintage 17.4
antique 16.7
wealth 16.2
architecture 15.6
bill 15.2
business 15.2
savings 14.9
religion 14.4
history 14.3
economy 13.9
pay 13.4
culture 12.8
dollars 12.6
investment 11.9
banknotes 11.7
banknote 11.7
figure 11.5
exchange 11.5
close 11.4
detail 11.3
rich 11.2
loan 10.6
style 10.4
monument 10.3
famous 10.2
grunge 10.2
decoration 10.2
church 10.2
note 10.1
symbol 10.1
face 10
retro 9.8
one 9.7
portrait 9.7
us 9.6
holy 9.6
payment 9.6
closeup 9.4
man 9.4
religious 9.4
head 9.2
historic 9.2
roman 9.2
design 9
catholic 8.8
marble 8.7
hundred 8.7
artistic 8.7
stone 8.4
person 8
bills 7.8
travel 7.7
profit 7.7
god 7.7
capital 7.6
historical 7.5
sign 7.5
decorative 7.5
artwork 7.3
success 7.2
market 7.1

Google
created on 2018-12-18

Microsoft
created on 2018-12-18

drawing 29.1
sketch 26.7
illustration 4.4
old 3.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Female, 99.7%
Calm 94.8%
Surprised 6.4%
Fear 5.9%
Happy 3.7%
Sad 2.2%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 25-35
Gender Female, 100%
Calm 81.5%
Disgusted 8.9%
Surprised 6.6%
Fear 6.3%
Happy 3.6%
Confused 2.6%
Sad 2.5%
Angry 0.7%

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.2%
Bride 98.2%
Female 98.2%
Person 98.2%
Woman 98.2%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2018-12-18

a drawing of a person 47.8%
a drawing of a face 38.6%
a drawing on paper 33.8%

Azure OpenAI

Created on 2024-01-26

The image shows two figures seated opposite each other with their hands lightly touching. The figure on the left is wearing a long-sleeved, full-length dress and shoes with pointed toes. The figure on the right is clad in a heavily ornamented full-length garment with what appears to be intricate lace and floral designs, and is also adorned with jewelry such as bracelets. Both are seated on an elaborately decorated chair with ornamental legs, likely a symbol of opulence or high status. Their attire suggests a setting from a past era, possibly reflecting a formal or significant occasion given the detailed nature of their garments. The backdrop seems to be a simple room with a visible doorframe, providing a stark contrast to the richness of the figures' clothing.

Anthropic Claude

Created on 2024-03-29

The image shows two young women in elaborate period clothing and headpieces, suggesting it is a portrayal of upper-class individuals from the early 19th century. One woman is seated in an ornate chair, with the other standing beside her. The scene has a formal, posed quality to it, indicating it may be a formal portrait or study of the individuals. The drawing style is detailed and realistic, using shading and line work to capture the intricate details of the clothing and facial features.

Text analysis

Amazon

1816
Dol
groups