Human Generated Data

Title

Reuben Hull Booth (1771-1814)

Date

1790

People

Artist: Ralph Earl, American 1751 - 1801

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.131

Human Generated Data

Title

Reuben Hull Booth (1771-1814)

People

Artist: Ralph Earl, American 1751 - 1801

Date

1790

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.131

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Furniture 96.7
Person 96.1
Human 96.1
Art 87.9
Apparel 66.1
Clothing 66.1
Shelf 62.9
Painting 61.5

Clarifai
created on 2018-03-16

people 99.8
one 99.7
adult 99.3
portrait 98.6
wear 97.8
man 95.8
necklace 93.7
outfit 93.4
painting 93
leader 92.3
seat 91.9
royalty 91.6
facial expression 91.4
outerwear 91.2
music 90.6
jewelry 89.8
jacket 89.8
woman 88.1
veil 87.3
pants 85.3

Imagga
created on 2018-03-16

man 37
bow tie 31
adult 29.9
person 29.8
male 27.7
necktie 26.8
people 24.5
suit 24.5
couple 24.4
portrait 22.6
fashion 20.4
garment 19.5
attractive 18.9
home 17.5
old 17.4
sitting 17.2
waiter 17.2
lifestyle 16.6
love 16.6
happy 16.3
handsome 16
senior 15.9
businessman 15.9
room 15.7
face 15.6
couch 15.5
looking 14.4
interior 14.1
clothing 13.5
style 13.3
model 13.2
together 13.1
smiling 13
dining-room attendant 13
men 12.9
smile 12.8
dress 12.6
family 12.5
lady 12.2
elegant 12
vintage 11.6
elderly 11.5
retro 11.5
sexy 11.2
hair 11.1
expression 11.1
two 11
happiness 11
elegance 10.9
holding 10.7
sofa 10.6
human 10.5
loving 10.5
tie 10.4
luxury 10.3
indoor 10
cheerful 9.8
business 9.7
indoors 9.7
married 9.6
standing 9.6
armchair 9.4
employee 9.4
worker 9.4
speaker 9.4
pretty 9.1
guy 9
one 9
posing 8.9
husband 8.8
executive 8.7
women 8.7
wife 8.5
living 8.5
relationship 8.4
black 8.4
hand 8.4
chair 8.4
fun 8.2
professional 8.1
romance 8
retired 7.8
relax 7.6
passion 7.5
clothes 7.5
book 7.3
grandma 7.3
aged 7.2
stylish 7.2
body 7.2
costume 7.1
romantic 7.1
hat 7.1

Google
created on 2018-03-16

gentleman 85.5
modern art 81.8
painting 80.4
musician 79.2
portrait 78.1
string instrument 76.4
art 73.9
monarch 62.2
music 61.6
virtuoso 52.5

Microsoft
created on 2018-03-16

person 99.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-23
Gender Male, 83.2%
Sad 8.3%
Surprised 7%
Calm 16.9%
Happy 2.7%
Angry 45.9%
Disgusted 10.8%
Confused 8.3%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%
Painting 61.5%

Categories

Imagga

events parties 99.9%
people portraits 0.1%

Captions

Microsoft
created on 2018-03-16

a person wearing a costume 59.7%
a person wearing a costume 59.6%
a person wearing a costume 59.5%

Azure OpenAI

Created on 2024-12-03

The image depicts a classic portrait of a seated individual wearing attire indicative of a historic period. The individual is dressed in a dark navy coat with prominent gold buttons and has delicate lace cuffs at the wrists. A silver waistcoat can be seen underneath the coat. The subject is posed with one arm resting on a red upholstered armchair with a plush design, while the other hand is placed upon a large document or book. In the background, there's a bookshelf filled with leather-bound books featuring gold detailing on the spines, hinting at a scholarly or intellectual environment. The use of color, clothing, and composition suggests this painting could be from the 18th or 19th century.

Anthropic Claude

Created on 2024-11-27

The image depicts a portrait of a gentleman in 18th century attire. He is seated in an ornate, red chair, surrounded by shelves of books. The gentleman has gray, powdered hair and is dressed in a dark coat with gold buttons, a white ruffled collar, and lace cuffs. He appears to be an individual of distinction, possibly a nobleman or scholar, based on his formal dress and the setting of the portrait.

Meta Llama

Created on 2024-11-24

The image depicts a portrait of a man sitting in a chair, holding a book. The man is dressed in 18th-century attire, with a black coat adorned with gold buttons, a white shirt, and a cravat. He has gray hair and is seated in a red upholstered chair with gold trim, resting his left arm on the armrest and holding a book in his hand. In the background, a bookshelf is visible, filled with books bound in leather or cloth, some of which have red or gold covers. The overall atmosphere of the image suggests a formal and intellectual setting, possibly a study or library.