Human Generated Data

Title

Ruby Doris Smith, James Forman, Marion Barry, and Sam Shirah at the SNCC Washington conference shortly after Kennedy’s death
Date

1963, printed 2010
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.33
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Ruby Doris Smith, James Forman, Marion Barry, and Sam Shirah at the SNCC Washington conference shortly after Kennedy’s death

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.33

Copyright

© Danny Lyon/Magnum Photos

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.6
Person 99.6
Person 99.4
Interior Design 99.4
Indoors 99.4
Person 96.5
Person 94.2
Leisure Activities 79.4
Performer 78.9
People 78.6
Sitting 74.1
Room 73.8
Court 71.3
Crowd 70
Musical Instrument 64.1
Musician 64.1
Face 62.3
Military 60.2
Officer 60.2
Military Uniform 60.2
Studio 59.1
Coat 58
Overcoat 58
Apparel 58
Clothing 58
Suit 58
Attorney 57.6
Guitar 57
Guitarist 57
Press Conference 55.2

Clarifai
created on 2018-02-10

people 99.9
group 99.6
adult 98.6
music 97.9
group together 96.9
musician 96.5
woman 96.3
man 94.9
many 93
sit 92.5
leader 92.3
several 92.2
instrument 91.8
room 91.2
chair 90.8
singer 89.7
administration 89.6
guitarist 87
actor 86.2
wear 85.8

Imagga
created on 2018-02-10

brass 57.3
man 33.6
people 22.9
male 22
person 18.7
adult 18.3
couple 17.4
love 15
business 14
sitting 13.7
accordion 13.4
photographer 13
black 12.3
office 12
men 12
looking 12
suit 11.7
businessman 11.5
dark 10.9
sax 10.8
silhouette 10.8
fashion 10.5
cornet 10.4
holding 9.9
happiness 9.4
window 9.2
attractive 9.1
dress 9
romance 8.9
professional 8.9
married 8.6
corporate 8.6
portrait 8.4
human 8.2
alone 8.2
oboe 8
night 8
hair 7.9
husband 7.6
fun 7.5
one 7.5
room 7.4
executive 7.4
indoor 7.3
lifestyle 7.2
work 7.1
day 7.1
together 7

Google
created on 2018-02-10

photograph 94.8
black and white 89.5
snapshot 81.8
photography 78.6
monochrome photography 76
gentleman 69.7
monochrome 59.7
fun 53
conversation 51.2

Microsoft
created on 2018-02-10

person 99.7
outdoor 89.3
people 66.8
group 57.8
crowd 0.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 58.4%
Surprised 0.6%
Confused 1.7%
Calm 13.6%
Happy 0.2%
Disgusted 0.8%
Angry 1.4%
Sad 81.7%

AWS Rekognition

Age 29-45
Gender Male, 99.8%
Angry 1%
Calm 3.2%
Sad 0.7%
Happy 0.6%
Confused 1.5%
Surprised 0.8%
Disgusted 92.2%

AWS Rekognition

Age 29-45
Gender Male, 90.9%
Happy 0.6%
Calm 30.3%
Confused 10.8%
Sad 37.4%
Surprised 3.1%
Angry 15.8%
Disgusted 2.1%

AWS Rekognition

Age 20-38
Gender Female, 98.8%
Sad 3.2%
Happy 68.6%
Angry 7.4%
Calm 5%
Surprised 9.9%
Confused 3.3%
Disgusted 2.6%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%