Human Generated Data

Title

Felix Mendelssohn Bartholdi
Date

19th century
People

Artist: Joseph Caspar, German 1799 - 1880

Artist after: Wilhelm Hensel, German 1794-1861
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G694

Human Generated Data

Title

Felix Mendelssohn Bartholdi

People

Artist: Joseph Caspar, German 1799 - 1880

Artist after: Wilhelm Hensel, German 1794-1861

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 98.6
Person 98.6
Art 98.1
Tie 91.7
Accessory 91.7
Accessories 91.7
Drawing 91.4
Painting 85.9
Text 76.5
Sketch 73.1
Photography 62.2
Photo 62.2

Imagga
created on 2022-02-26

bow tie 48.3
necktie 43.8
man 43.7
person 40.5
businessman 37.1
male 36.2
suit 35.2
business 33.4
portrait 31.1
adult 26
professional 26
tie 24.7
people 24.5
expression 23.9
executive 23.6
office 22.6
corporate 22.3
handsome 22.3
success 21.7
garment 20.1
manager 17.7
clothing 17.4
speaker 17.1
black 15.8
confident 15.5
face 14.9
one 14.2
work 14.1
articulator 13.9
money 13.6
standing 13
occupation 12.8
looking 12.8
jacket 12.8
guy 12.2
scholar 12
happy 11.9
successful 11.9
holding 11.6
human 11.2
men 11.2
old 11.1
phone 11.1
alone 11
lifestyle 10.8
communicator 10.7
boss 10.5
attractive 10.5
mature 10.2
dollar 10.2
finance 10.1
currency 9.9
bank 9.9
worker 9.8
modern 9.8
fashion 9.8
job 9.7
confidence 9.6
intellectual 9.6
serious 9.5
shirt 9.4
senior 9.4
casual 9.3
glasses 9.3
studio 9.1
vintage 9.1
style 8.9
director 8.8
judge 8.6
elegant 8.6
close 8.6
model 8.6
dark 8.4
cash 8.2
stylish 8.1
hair 7.9
look 7.9
paper 7.8
expertise 7.8
bill 7.6
hand 7.6
economy 7.4
smiling 7.2
smile 7.1
love 7.1

Google
created on 2022-02-26

Coat 92
Sleeve 86.9
Art 84
Collar 83.5
Blazer 78.2
Tints and shades 77.3
Suit 75.4
Painting 75.4
Vintage clothing 71.5
Formal wear 70.2
Facial hair 69.5
Self-portrait 68.6
Visual arts 67
Moustache 66.1
Sitting 64.5
Illustration 62.5
Paper product 61.3
Paper 61.1
Monochrome 58.5
Portrait 58.4

Microsoft
created on 2022-02-26

drawing 99.6
gallery 99
room 98.9
scene 98.5
sketch 98.4
wall 98.4
clothing 93.5
person 93.2
man 90.5
human face 87.4
art 80.6
text 73.4
portrait 57.3
old 51.6
painting 28.7
picture frame 21

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 98.6%
Surprised 0.5%
Happy 0.4%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Tie 91.7%

Captions

Microsoft

a painting of a person 89%
a painting of a person in front of a mirror posing for the camera 73.1%
a person standing in front of a mirror posing for the camera 73%

Text analysis

Amazon

Vested
and
und
Rocra
Vested und Tifesthum and Rocra mingad
mingad
Tifesthum
KING

Google

ienhun
oa
Velel nd ienhun l oa
nd
l
Velel