Human Generated Data

Title

James Baldwin addresses a packed mass meeting on Freedom Day
Date

1963, printed 2010
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.31
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

James Baldwin addresses a packed mass meeting on Freedom Day

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.7
Face 99.7
Person 98.9
Person 97.2
Apparel 94.3
Coat 94.3
Suit 94.3
Overcoat 94.3
Clothing 94.3
Suit 89.7
Beard 83.6
Photography 71.4
Photo 71.4
Portrait 71.4
Head 70.2
Finger 57.2
Tuxedo 56.9

Clarifai
created on 2018-02-10

people 99.1
one 99
adult 98.2
man 97.1
portrait 97
wear 95
indoors 90.4
facial expression 89.1
woman 88.7
business 85.7
no person 85.2
side view 82
music 81.1
administration 79.8
outfit 78.9
profile 77.9
recreation 76.4
musician 73.6
furniture 73.1
two 73

Imagga
created on 2018-02-10

device 28.6
keyboard 25.5
black 24
computer 19.6
technology 19.3
business 18.8
close 17.1
laptop 17.1
key 16.5
equipment 15.9
music 14.4
office 12.8
instrument 12.7
keys 12.6
work 12.5
notebook 11.8
button 11.4
sound 11.2
interior 10.6
digital 10.5
piano 10.1
pen 10
object 9.5
play 9.5
data 9.1
modern 9.1
home 8.8
support 8.7
musical 8.6
audio 8.6
communication 8.4
number 8.4
note 8.3
closeup 8.1
adult 7.8
old 7.7
type 7.7
finance 7.6
pipe 7.5
machine 7.4
document 7.4
man 7.4
entertainment 7.4
light 7.3
wealth 7.2
male 7.1
information 7.1

Google
created on 2018-02-10

photograph 95.6
black 95.2
black and white 92.8
monochrome photography 85.7
gentleman 84.8
photography 83.4
standing 80.7
monochrome 74
portrait 60.3

Microsoft
created on 2018-02-10

person 99.8
man 99.7
indoor 90
suit 85.3
looking 82.6
staring 36.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Happy 4.6%
Calm 25.3%
Confused 11.4%
Angry 17.2%
Sad 16.5%
Disgusted 13.1%
Surprised 11.9%

AWS Rekognition

Age 27-44
Gender Male, 99.4%
Surprised 20.1%
Angry 34%
Disgusted 16.6%
Confused 12.9%
Happy 4.2%
Calm 9.4%
Sad 2.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Suit 94.3%

Captions

Microsoft

a man wearing a suit and tie 96.2%
a man looking at the camera 90.5%
a man wearing a suit and tie looking at the camera 90.4%