Human Generated Data

Title

Portraits of Louis del Rio (?) and his sons

Date

19th-20th century

People

Artist: Eugène Gaujean, French 1850 - 1900

Artist after: Antonis Mor, Dutch c. 1518 - 1576

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Miss Ellen Bullard, M2129

Human Generated Data

Title

Portraits of Louis del Rio (?) and his sons

People

Artist: Eugène Gaujean, French 1850 - 1900

Artist after: Antonis Mor, Dutch c. 1518 - 1576

Date

19th-20th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Art 97.4
Painting 97.3
Human 97.3
Person 97.3
Accessories 96.9
Accessory 96.9
Tie 96.9
Person 87.7
Poster 67.2
Advertisement 67.2

Clarifai
created on 2019-11-07

people 99.9
print 99.2
portrait 98.9
adult 98.7
painting 98.3
art 97.9
two 97.6
man 97.4
wear 97.1
one 96.8
group 95.3
leader 94
illustration 93.2
engraving 92.3
woman 90.2
retro 89.3
antique 88.6
album 85.3
facial hair 82.9
elderly 82.1

Imagga
created on 2019-11-07

kin 28.4
black 24.5
man 22.8
portrait 22.6
people 21.2
adult 20.1
person 18.9
dress 17.2
male 16.7
face 15.6
old 15.3
attractive 14
bow tie 13.9
culture 12.8
happy 12.5
couple 12.2
expression 11.9
hair 11.9
art 11.8
brother 11.2
sexy 11.2
pretty 11.2
historic 11
happiness 11
world 10.6
fashion 10.5
clothing 10.5
vintage 9.9
history 9.8
garment 9.8
human 9.7
style 9.6
covering 9.6
ancient 9.5
love 9.5
necktie 9.4
historical 9.4
wall 9.4
room 9.4
makeup 9.1
romantic 8.9
posing 8.9
decoration 8.9
building 8.7
statue 8.6
smile 8.5
famous 8.4
emotion 8.3
one 8.2
jacket 8
architecture 7.9
business 7.9
depression 7.8
bride 7.8
two 7.6
head 7.6
dark 7.5
monument 7.5
tourism 7.4
mask 7.3
groom 7.3
sensual 7.3
sensuality 7.3
smiling 7.2
color 7.2
mother 7.2
body 7.2
home 7.2
religion 7.2
family 7.1

Google
created on 2019-11-07

Painting 83.3
Art 80.3
Portrait 77.7
Picture frame 74.9
Visual arts 64.9

Microsoft
created on 2019-11-07

drawing 99.1
sketch 97.6
text 94.4
person 92.3
clothing 91.2
human face 86.7
old 77.5
man 75.9
gallery 74.4
cartoon 58.1
posing 55.6
room 40.6
picture frame 35.3
painting 19.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 98.2%
Calm 53.3%
Fear 4.4%
Confused 4.7%
Disgusted 0.3%
Happy 0.2%
Sad 23.2%
Surprised 0.3%
Angry 13.6%

AWS Rekognition

Age 48-66
Gender Male, 89.9%
Sad 0.2%
Disgusted 0.1%
Fear 0%
Angry 0.3%
Surprised 0.1%
Calm 99.2%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 22-34
Gender Female, 65.1%
Disgusted 1.4%
Happy 1.1%
Angry 0.9%
Confused 0.3%
Calm 95%
Sad 0.9%
Surprised 0.3%
Fear 0.1%

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Tie 96.9%
Poster 67.2%

Captions

Microsoft

a vintage photo of a person 89.2%
a vintage photo of a person 87.5%
a vintage photo of a group of people posing for the camera 75.1%