Human Generated Data

Title

Edward W. Forbes (1873-1969)

Date

1949

People

Artist: Arthur Pope, American 1880 - 1974

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Arthur Pope, 1973.31

Human Generated Data

Title

Edward W. Forbes (1873-1969)

People

Artist: Arthur Pope, American 1880 - 1974

Date

1949

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 95
Person 95
Text 93.1
Art 92
Drawing 91.9
Face 77.7
Sketch 70.8
Photography 67.1
Portrait 67.1
Photo 67.1
Painting 59
Head 56

Clarifai
created on 2020-04-24

portrait 100
people 99.9
one 99.7
leader 99
man 97.9
adult 97.9
art 96.4
scientist 96
old 96
poet 95.1
engraving 94.5
writer 93.6
politician 90.8
administration 90.5
philosopher 87.2
facial hair 86.5
mustache 85.7
print 84.6
wear 83.4
elderly 82.5

Imagga
created on 2020-04-24

man 43.7
portrait 38.2
grandma 38.1
male 36.8
person 34.8
adult 33.7
people 31.3
bow tie 27.1
face 27
smile 26.4
necktie 25.9
handsome 25
senior 24.4
looking 24
mature 23.3
spectacles 21.7
hair 20.6
casual 20.4
elderly 19.2
serious 19.1
happy 18.8
businessman 18.6
old 17.4
expression 17.1
professional 16.9
attractive 16.8
lifestyle 16.6
grandfather 16.4
confident 16.4
gray 16.2
optical instrument 14.9
glasses 14.8
men 14.6
business 14.6
garment 14.3
shirt 14
smiling 13.8
one 13.4
clothing 13.4
guy 13.4
retirement 12.5
lady 12.2
office 12.1
youth 11.9
alone 11.9
love 11.8
family 11.6
age 11.4
black 11.4
tie 11.4
health 11.1
suit 11
work 11
beard 10.8
job 10.6
look 10.5
human 10.5
couple 10.5
instrument 10.2
successful 10.1
executive 10
active 9.9
blond 9.9
fashion 9.8
jacket 9.8
mother 9.8
retired 9.7
success 9.7
sexy 9.6
home 9.6
model 9.3
adolescent 9.3
aged 9.1
coat 9
grandmother 8.8
masculine 8.8
confidence 8.6
eyes 8.6
color 8.4
closeup 8.1
working 8
medical 8
medicine 7.9
maturity 7.9
happiness 7.8
boy 7.8
older 7.8
expertise 7.8
juvenile 7.7
modern 7.7
healthy 7.6
doctor 7.5
manager 7.5
worker 7.4
friendly 7.3
cool 7.1
pretty 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 99.8
man 99.5
person 98.3
sketch 98
drawing 97.2
human face 96.7
portrait 90.7
clothing 87.8
painting 84.7
old 75.5
older 45.3
picture frame 10.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-69
Gender Male, 97%
Disgusted 0.1%
Confused 1.1%
Happy 0.2%
Surprised 0.1%
Angry 1.9%
Fear 0%
Sad 13.4%
Calm 83.2%

Microsoft Cognitive Services

Age 66
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95%

Captions

Microsoft

an old photo of a man 93.9%
old photo of a man 92.6%
an old photo of a man in a suit and tie 92.5%