Human Generated Data

Title

Archibald Menzies

Date

1763

People

Artist: Anton von Maron, Austrian 1733 - 1808

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Robert Rantoul Endicott, BR57.147

Human Generated Data

Title

Archibald Menzies

People

Artist: Anton von Maron, Austrian 1733 - 1808

Date

1763

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Robert Rantoul Endicott, BR57.147

Machine Generated Data

Tags

Amazon
created on 2023-10-23

Art 100
Painting 100
Clothing 100
Coat 100
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Jacket 95.8
Face 95.4
Head 95.4
Photography 56.9
Portrait 56.9

Clarifai
created on 2018-08-20

people 99.8
wear 99.2
one 99.1
adult 97.4
portrait 95.8
facial expression 95.8
man 95.3
outerwear 94.1
painting 91.5
jacket 90.5
outfit 87.4
royalty 85.9
lid 85.3
veil 83.5
indoors 82.6
furniture 79.3
jewelry 78.4
art 76.5
leader 75.6
seat 75.3

Imagga
created on 2018-08-20

person 33.5
adult 33.5
people 32.9
happy 32.6
portrait 32.3
grandma 31
senior 29
man 28.2
old 25.8
male 24.1
clothing 23.7
elderly 23
mature 22.3
couple 21.8
lady 21.1
chain mail 20.9
smile 20.6
love 20.5
face 19.9
fashion 19.6
vestment 18.4
happiness 18
human 18
poncho 17.9
smiling 17.3
pretty 16.8
body armor 16.7
grandmother 16.6
armor 16.4
expression 16.2
look 15.7
attractive 15.4
retirement 15.4
cloak 15.3
casual 15.2
together 14.9
retired 14.5
gown 14.5
lifestyle 14.4
garment 14.2
hair 13.5
women 13.4
cute 12.9
fan 12.8
head 12.6
family 12.4
cheerful 12.2
aged 11.8
model 11.7
hand 11.4
mother 11.3
home 11.2
sitting 11.2
outerwear 11
traditional 10.8
holding 10.7
rustic 10.4
elegant 10.3
covering 10.2
glasses 10.2
two 10.2
scarf 10.1
coat 9.8
older 9.7
sexy 9.6
looking 9.6
grandfather 9.5
eyes 9.5
dress 9
fun 9
style 8.9
follower 8.8
protective covering 8.6
holiday 8.6
teacher 8.2
gold 8.2
alone 8.2
one 8.2
costume 8.1
handsome 8
posing 8
pensioner 8
husband 7.8
gift 7.7
men 7.7
culture 7.7
married 7.7
winter 7.7
age 7.6
joy 7.5
relationship 7.5
outdoors 7.5
makeup 7.3
friendly 7.3
present 7.3
sensuality 7.3
make 7.3
color 7.2
computer 7.2
gray 7.2

Google
created on 2018-08-20

painting 91.3
portrait 83.4
fur 78
gentleman 61.8
art 56

Microsoft
created on 2018-08-20

person 98.6
older 26.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 86.5%
Surprised 7.1%
Fear 6.2%
Confused 5.2%
Sad 2.4%
Happy 2.3%
Angry 1.6%
Disgusted 1.3%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.4%
Male 99.4%
Man 99.4%
Person 99.4%

Categories

Captions

Microsoft
created on 2018-08-20

a person wearing a costume 73.9%
a person wearing a costume 73.8%
a person holding a gun 45%

Azure OpenAI

Created on 2024-01-25

The image depicts a person dressed in elaborate 17th-century attire. The outfit features a vibrant burnt orange waistcoat richly adorned with gold floral motifs. The person is also wearing a red coat with soft, white fur trim on the edges. A crisp, white cravat with lace embellishments is visible at the neck. In one hand, the individual holds an open book with a brown cover, suggesting a possible engagement with literature or study. The hand holding the book is adorned with a lace cuff, highlighting the fashion of the period. The overall attire and pose give the impression of wealth and education, common among the portraits of the time to suggest the status of the person depicted.