Human Generated Data

Title

William Hayes Fogg (1817-1884)
Date

1887
People

Artist: Eastman Johnson, American 1824 - 1906
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, William M. Prichard Memorial Fund and through the generosity of an anonymous donor, 1982.49

Human Generated Data

Title

William Hayes Fogg (1817-1884)

People

Artist: Eastman Johnson, American 1824 - 1906

Date

1887

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 98.3
Human 97.6
Person 97.6
Painting 95
Apparel 56.9
Clothing 56.9
Coat 56.9

Clarifai
created on 2020-04-23

people 99.9
portrait 99.7
one 99.5
painting 99.2
art 98.9
man 98.9
adult 98.2
leader 94.5
print 93.6
wear 93.6
lid 92.7
mustache 90.7
retro 90.7
facial hair 90.5
vintage 89.9
music 89.5
elderly 85.8
veil 83.3
poet 82.6
illustration 81.8

Imagga
created on 2020-04-23

suit 100
garment 100
clothing 78.7
businessman 58.3
man 54.5
covering 53.4
consumer goods 53.2
male 48.3
business 45
executive 42.4
handsome 41
tie 38.9
person 35.5
portrait 34.3
confident 31
corporate 29.2
professional 28.1
adult 27.2
success 26.6
successful 26.6
office 26.5
commodity 25.3
expression 23.1
people 21.8
men 21.5
manager 21.4
guy 20.8
face 19.9
work 19.6
shirt 18.7
black 18.1
modern 17.5
looking 16
fashion 15.8
happy 15.1
human 15
model 14.8
standing 14.8
attractive 14.7
smiling 14.5
hand 14.4
serious 14.3
one 14.2
elegant 13.7
smile 13.6
boss 13.4
elevator 13.4
worker 13.3
phone 12.9
friendly 12.8
communication 11.8
cellphone 11.7
job 11.5
confidence 11.5
formal 11.5
alone 11
lifestyle 10.9
style 10.4
mobile 10.4
smart 10.4
company 10.2
mature 10.2
occupation 10.1
stylish 10
lifting device 9.9
cell 9.8
necktie 9.8
fashionable 9.5
senior 9.4
jacket 9.2
positive 9.2
outdoors 9
posing 8.9
hair 8.7
businesspeople 8.5
money 8.5
casual 8.5
dark 8.4
happiness 7.8
outside 7.7
old 7.7
studio 7.6
career 7.6
elegance 7.6
contemporary 7.5
city 7.5
holding 7.4
glasses 7.4
cheerful 7.3
device 7.2
working 7.1
look 7

Google
created on 2020-04-23

Portrait 96.8
Painting 92.4
Self-portrait 89.8
Art 69.5
Picture frame 64.8
Facial hair 60.7
Beard 52.9

Microsoft
created on 2020-04-23

painting 99.7
person 99.2
text 98
suit 96.2
man 94
drawing 92
art 86.9
portrait 85.5
standing 78.3
clothing 67.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Male, 97.4%
Fear 0%
Calm 95%
Happy 0.1%
Sad 1.1%
Angry 2%
Disgusted 0%
Surprised 0.2%
Confused 1.6%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Painting 95%

Captions

Microsoft

a man in a suit standing in front of a mirror 92.2%
a man wearing a suit and tie 92.1%
a man wearing a suit and tie standing in front of a mirror 91.4%