Human Generated Data

Title

Three Male Heads, Study for "The Capitulation of Madrid, December 4, 1808"

Date

c. 1810

People

Artist: Antoine-Jean Gros, French 1771 - 1835

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Arthur K. and Mariot F. Solomon Collection, 2021.193

Human Generated Data

Title

Three Male Heads, Study for "The Capitulation of Madrid, December 4, 1808"

People

Artist: Antoine-Jean Gros, French 1771 - 1835

Date

c. 1810

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2021-10-01

Person 97.9
Human 97.9
Painting 97.9
Art 97.9
Person 97.1
Face 83.2
Photo 67.5
Photography 67.5
Portrait 67.5

Imagga
created on 2021-10-01

man 37.6
person 33
face 32.7
couple 30.5
male 29.8
portrait 29.1
people 29
love 26
hair 25.4
adult 25.3
attractive 21.7
beard 21.2
model 18.7
together 17.5
sexy 16.9
mustache 16.7
smile 16.4
happy 16.3
handsome 16
looking 16
black 15.6
romance 15.2
fashion 15.1
pretty 14.7
wig 14.7
eyes 14.6
two 14.4
happiness 14.1
double 13.9
husband 13.8
costume 13.7
expression 13.7
casual 13.6
human 13.5
head 13.4
married 13.4
senior 13.1
one 12.7
guy 12.6
wife 12.3
smiling 12.3
look 12.3
clothing 12
men 12
hat 12
emotion 12
style 11.9
old 11.8
attire 11.6
romantic 11.6
marriage 11.4
hairpiece 11
dark 10.9
studio 10.6
skin 10.6
boy 10.4
women 10.3
girls 10
grandma 10
covering 9.9
fun 9.7
depression 9.7
close 9.7
sensual 9.1
sensuality 9.1
outdoors 9
lady 8.9
family 8.9
posing 8.9
lifestyle 8.7
cute 8.6
mask 8.5
youth 8.5
relationship 8.4
mature 8.4
make 8.2
pose 8.2
grandfather 7.9
sadness 7.8
mysterious 7.8
world 7.7
elderly 7.7
erotic 7.6
glasses 7.4
crazy 7.3
gray 7.2
eye 7.1
mother 7.1

Google
created on 2021-10-01

Forehead 98.5
Nose 98.4
Hair 98.3
Cheek 97.9
Hairstyle 95.1
Eyebrow 94.3
Beard 89.5
Jaw 88.1
Art 85.8
Painting 85.8
Facial hair 85.3
Moustache 75.9
Visual arts 71.3
Illustration 70.9
Drawing 69.6
Event 66.2
Self-portrait 64.4
Vintage clothing 64.4
Eyelash 63.8
Room 62.3

Microsoft
created on 2021-10-01

man 99.6
painting 98.9
human face 98.6
drawing 98.4
sketch 96
person 95.2
art 89.9
text 80.6
portrait 75.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 99.6%
Calm 87.8%
Surprised 8.5%
Confused 1.3%
Angry 0.8%
Sad 0.6%
Disgusted 0.6%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 13-25
Gender Male, 94.7%
Fear 56.5%
Sad 14.1%
Confused 10.7%
Surprised 9.3%
Calm 5.9%
Angry 1.9%
Disgusted 1%
Happy 0.6%

AWS Rekognition

Age 22-34
Gender Male, 97.7%
Calm 83.6%
Sad 6.3%
Surprised 4.4%
Fear 1.7%
Confused 1.3%
Angry 1.1%
Disgusted 0.8%
Happy 0.8%

AWS Rekognition

Age 22-34
Gender Male, 99.5%
Calm 91.9%
Surprised 4.6%
Confused 1.1%
Angry 0.6%
Sad 0.6%
Disgusted 0.6%
Fear 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Painting 97.9%

Captions

Microsoft

a group of people posing for the camera 86.1%
a group of people looking at the camera 81.1%
a man looking at the camera 81%