Human Generated Data

Title

Self-Portrait

Date

1877

People

Artist: Ford Madox Brown, British 1821 - 1893

Framemaker: M. Grieve Co.,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.185

Human Generated Data

Title

Self-Portrait

People

Artist: Ford Madox Brown, British 1821 - 1893

Framemaker: M. Grieve Co.,

Date

1877

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.185

Machine Generated Data

Tags

Amazon
created on 2023-10-10

Art 100
Painting 100
Woman 99.5
Adult 99.5
Female 99.5
Person 99.5
Face 98.5
Head 98.5
Photography 98.5
Portrait 98.5

Clarifai
created on 2018-08-20

people 99.8
painting 99.7
art 99.3
portrait 98.8
adult 98.7
one 98.6
elderly 96.5
man 96.4
religion 93.8
mustache 93.4
facial hair 92.8
old 91.7
illustration 91.1
Renaissance 89.9
wear 88.5
poet 86
cape 85
book series 84.4
indoors 83.9
writer 82.8

Imagga
created on 2018-08-20

man 26.9
portrait 25.9
male 20.6
person 19.2
art 18.8
face 18.5
mosaic 18.2
money 17.9
currency 17
people 16.2
bill 14.3
beard 14
dollar 13.9
close 13.7
hat 13.5
one 13.4
vintage 13.2
black 13.2
cash 12.8
painter 12.7
old 12.5
banking 11.9
happy 11.9
religion 11.6
finance 11
dark 10.8
guy 10.8
bank 10.7
fashion 10.5
god 10.5
model 10.1
masterpiece 9.9
lady 9.7
adult 9.7
banknote 9.7
hair 9.5
paper 9.5
eyes 9.5
culture 9.4
senior 9.4
church 9.2
retro 9
human 9
interior 8.8
look 8.8
golden 8.6
serious 8.6
ruler 8.5
business 8.5
device 8.2
style 8.2
closeup 8.1
financial 8
icon 7.9
bible 7.8
mysterious 7.8
museum 7.8
dollars 7.7
artist 7.7
attractive 7.7
spirituality 7.7
covering 7.7
head 7.6
holding 7.4
mustache 7.4
smiling 7.2
office 7.2
sexy 7.2
looking 7.2
handsome 7.1
smile 7.1
posing 7.1

Google
created on 2018-08-20

facial hair 95.1
art 92.8
portrait 92.4
painting 90.8
beard 80.3
modern art 68.4
elder 67.5
gentleman 63.1
wood 59.7
picture frame 56.6
self portrait 53.2
visual arts 52.5
stock photography 51.7

Microsoft
created on 2018-08-20

person 98.9
man 94.5
old 42

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 99.5%
Calm 75.7%
Confused 10.3%
Angry 7.6%
Surprised 6.6%
Fear 6.4%
Disgusted 3.2%
Sad 2.4%
Happy 0.5%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Woman 99.5%
Adult 99.5%
Female 99.5%
Person 99.5%

Captions

Microsoft
created on 2018-08-20

a man holding a book 25%

Azure OpenAI

Created on 2024-01-25

This image depicts a person seated in front of a warmly hued, patterned backdrop. They're dressed in dark clothing. The person's right arm is gently resting on an armrest, with fingers slightly curled, giving an impression of tranquility or pensiveness. The scene is enveloped in a rich, textured orange-brown setting that suggests a domestic interior. Delicate floral patterns can be seen in the upper right part of the image, contrasting with the darker tones. To the left, there seems to be a stylized rendition of smoke or steam, adding a mysterious quality to the scene. A signature with the initials "AD" and the year "87" lies in the top left, indicating the artwork's creation date. The right side of the image shows part of a wooden structure with ornamental details that could be a piece of furniture or a part of the room's architecture. The color palette is warm with earthy tones, and the brushwork varied, adding texture and depth to the composition.

Anthropic Claude

Created on 2024-03-29

The image depicts a man with a long, thick beard wearing a dark cloak. He appears to be sitting in a chair, with a colorful, ornately decorated background behind him, featuring vines, flowers, and other ornamental elements. The man's expression is serious, and he has a contemplative, introspective gaze. The overall composition and style of the painting suggest it is a portrait of a significant or esteemed individual, likely from a historical or artistic context.