Human Generated Data

Title

Portrait of Joseph Coolidge, Jr.
Date

1820
People

Artist: Jean Baptiste Joseph Duchesne, French 1770 - 1856
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Catherine Coolidge Lastavica in honor of John Coolidge, 2021.83

Human Generated Data

Title

Portrait of Joseph Coolidge, Jr.

People

Artist: Jean Baptiste Joseph Duchesne, French 1770 - 1856

Date

1820

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Catherine Coolidge Lastavica in honor of John Coolidge, 2021.83

Machine Generated Data

Tags

Amazon
created on 2022-05-19

Person 94.3
Human 94.3
Art 92.6
Pendant 88.4
Painting 88.3
Locket 56.9
Accessories 56.9
Jewelry 56.9
Accessory 56.9

Clarifai
created on 2023-10-14

portrait 99.5
one 99.4
people 99.4
adult 98.8
man 97
woman 96.9
art 96.2
veil 94
wear 92.6
painting 91.3
retro 88.5
facial hair 88.4
museum 84.5
exploration 83.8
lid 81.8
sculpture 80.2
jewelry 78.7
no person 77.8
girl 75.2
necklace 74.6

Imagga
created on 2022-05-19

person 21.9
black 21.4
symbol 19.5
sign 18
yellow 17.9
adult 16.1
icon 15.8
portrait 15.5
danger 15.4
warning 15.3
face 14.9
sorcerer 14.3
hat 13.6
people 12.8
computer 12
safety 11.9
attractive 11.9
toilet seat 11.5
style 11.1
caution 10.7
fashion 10.5
shield 10.1
model 10.1
happy 10
armor 9.8
looking 9.6
dangerous 9.5
youth 9.4
male 9.2
hand 9.2
pretty 9.1
old 9
seat 9
road 9
design 9
fun 9
one 8.9
clothing 8.9
button 8.8
object 8.8
man 8.7
business 8.5
studio 8.3
human 8.2
pose 8.1
square 8.1
shadow 8.1
attention 7.8
orange 7.7
web 7.6
ethnic 7.6
label 7.6
traffic 7.6
reflection 7.5
technology 7.4
japan 7.3
smile 7.1
women 7.1
posing 7.1
silver 7.1
hazard 7.1

Google
created on 2022-05-19

Hair 98.3
Eye 93.8
Oval 90.2
Picture frame 86.3
Art 80
Jewellery 76.4
Circle 75
Fashion accessory 65.9
Metal 58.5
Collar 57.6
Drawing 57.3
Painting 55.9
Illustration 52.7
History 52.4
Symbol 50.8
Vintage clothing 50.6

Microsoft
created on 2022-05-19

human face 98.1
person 94
clothing 77
oval 61.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Female, 99.5%
Calm 89.7%
Surprised 6.7%
Fear 6.1%
Sad 4.9%
Angry 1.1%
Disgusted 1.1%
Happy 0.3%
Confused 0.2%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.3%
Painting 88.3%
Locket 56.9%

Categories

Imagga

people portraits 61.8%
events parties 18.3%
food drinks 9.3%
cars vehicles 5.7%
paintings art 3%

Captions

Microsoft
created on 2022-05-19

a person looking at the camera 67.7%
a person making a face for the camera 60.5%
a close up of a mans face 60.4%

Azure OpenAI

Created on 2024-11-15

The image depicts an antique oval portrait encased in a gold-tone frame, likely from the 19th century based on the clothing style and the format of the portrait. The portrait shows an individual wearing a dark coat with a high collar and light-colored shirt. The image has notable aging signs, including discoloration and surface wear, which add to its vintage character. There is a loop at the top of the frame indicating it may have been used as a pendant or attached to something for display.

Anthropic Claude

Created on 2024-11-14

The image shows a portrait painting of a man wearing a white collar and dark jacket. He has dark hair and a serious expression on his face. The portrait is framed in a gold-colored oval frame.