Human Generated Data

Title

Dr. Martin Luther King just before he speaks at Birmingham

Date

1963, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.29

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Dr. Martin Luther King just before he speaks at Birmingham

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.4
Face 99.4
Coat 99.1
Apparel 99.1
Clothing 99.1
Suit 99.1
Overcoat 99.1
Accessories 99
Tie 99
Accessory 99
Indoors 98.1
Interior Design 98.1
Person 95.3
Room 90.9
Sleeve 79
Court 75.9
Photo 71.8
Portrait 71.8
Photography 71.8
Man 69.9
Crowd 60.9
Head 60.4
Tuxedo 57.6
People 57.6

Clarifai
created on 2018-02-10

people 99.7
portrait 98.3
one 97.5
adult 97.4
man 97.2
leader 94.6
administration 92.5
wear 92.2
outfit 92
music 88
athlete 77.5
musician 73.3
facial expression 70.7
jazz 69.9
side view 69.3
two 68.5
indoors 67.1
chair 65.2
politician 64
neckwear 60.4

Imagga
created on 2018-02-10

suit 84.1
businessman 64.6
baron 56.4
man 55.9
handsome 51.8
male 49.8
executive 49.2
business 44.4
tie 43.7
person 41.4
portrait 40.2
corporate 37.9
professional 37.3
adult 33.8
office 32.2
confident 31.9
men 31.9
people 30.8
successful 29.4
success 27.4
looking 24.9
happy 24.5
shirt 24.3
garment 24.3
smiling 23.9
smile 22.9
face 22.8
one 22.4
manager 22.4
expression 22.2
work 22
black 21.2
clothing 20.7
mature 20.5
guy 19.2
necktie 16.7
occupation 16.5
serious 16.2
job 16
jacket 15.7
worker 15.5
businesspeople 15.2
standing 14.8
modern 14.8
studio 14.5
hand 14.5
boss 14.4
formal 14.4
model 14
entrepreneur 13.8
confidence 13.4
smart 13.2
lifestyle 13
glasses 13
friendly 12.8
lawyer 12.8
happiness 12.6
working 12.4
senior 12.2
old 11.9
corporation 11.6
cheerful 11.4
employee 11.1
stylish 10.9
businessmen 10.7
older 10.7
fashionable 10.5
career 10.4
good 10.4
sitting 10.3
covering 10.3
company 10.3
casual 10.2
alone 10.1
attractive 9.8
40s 9.8
look 9.7
computer 9.6
collar 9.6
laugh 9.6
thinking 9.5
head 9.3
inside 9.2
close 9.2
hair 8.7
fashion 8.3
judge 8.3
human 8.3
laptop 8.2
fresh 7.9
education 7.8
elegant 7.7
elderly 7.7
communication 7.6
positive 7.4

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

person 99.1
man 97.5
suit 87
dark 39.6
necktie 19.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 93.2%
Confused 4.5%
Disgusted 8%
Angry 3.3%
Surprised 1.7%
Happy 1.3%
Sad 61%
Calm 20.2%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Suit 99.1%
Tie 99%
Person 95.3%

Captions

Microsoft

a man wearing a suit and tie 98.8%
a man wearing a suit and tie sitting in a dark room 96.7%
a man in a suit and tie 96.6%