Human Generated Data

Title

James Forman, like many of the SNCC field staff, was a powerful stump speaker. Here he works the crowd at the Danville mass meeting. An hour later he will be searched by police holding shotguns and automatic weapons
Date

1963, printed 2010
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2014.439
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

James Forman, like many of the SNCC field staff, was a powerful stump speaker. Here he works the crowd at the Danville mass meeting. An hour later he will be searched by police holding shotguns and automatic weapons

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.7
Human 99.7
Person 99.7
Person 99.5
Person 98.8
Face 98
Hair 92
Person 90.2
Collage 89.8
Poster 89.8
Advertisement 89.8
Person 87.7
Person 85.6
Finger 84.4
Head 79.5
People 68
Person 67.9
Smile 66.5
Female 61.8

Clarifai
created on 2018-02-10

people 99.9
adult 98.7
two 97.9
man 97.8
group 96.7
portrait 96.4
music 95.6
facial expression 95.5
musician 95
wear 94
woman 93.3
administration 92.6
one 90.6
singer 90.3
outfit 89.4
three 89.4
group together 89.3
actor 87.7
leader 87.6
actress 83.1

Imagga
created on 2018-02-10

man 37.6
adult 36.9
child 33.9
male 32
person 28.7
portrait 27.8
people 26.2
couple 22.6
love 22.1
juvenile 21.8
world 16.9
attractive 16.1
handsome 16
torch 15.7
outdoors 15.7
happy 15.7
sexy 15.3
model 14.8
face 14.2
smiling 13.7
lifestyle 13.7
human 13.5
happiness 13.3
together 13.1
men 12.9
looking 12.8
body 12.8
pretty 12.6
relationship 12.2
sport 12.1
black 12
light 11.9
two 11.9
married 11.5
outdoor 11.5
smile 11.4
fashion 11.3
fitness 10.8
holding 10.7
passion 10.3
expression 10.2
joy 10
romance 9.8
bride 9.6
hair 9.5
casual 9.3
dark 9.2
exercise 9.1
guy 9
one 9
life 8.9
romantic 8.9
healthy 8.8
sad 8.7
day 8.6
husband 8.6
outside 8.6
wife 8.5
togetherness 8.5
fit 8.3
wedding 8.3
groom 8.2
fun 8.2
suit 8.1
posing 8
women 7.9
brunette 7.8
boyfriend 7.7
girlfriend 7.7
pole 7.7
athlete 7.6
monk 7.5
strong 7.5
emotion 7.4
alone 7.3
sensual 7.3
sensuality 7.3
family 7.1

Google
created on 2018-02-10

photograph 95.5
facial expression 93.7
social group 93.2
black and white 91.9
crowd 91.8
monochrome photography 82
photography 79.3
event 69.4
human 69.3
fun 67.5
audience 65.6
girl 65.4
ceremony 62.7
monochrome 62.7
religion 60
smile 51.8
laughter 50.4

Microsoft
created on 2018-02-10

person 99.9
man 93.4
outdoor 92.6
crowd 19

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 98.9%
Confused 17.5%
Surprised 4.8%
Disgusted 5.7%
Sad 17.5%
Happy 2.4%
Angry 7%
Calm 45.2%

AWS Rekognition

Age 35-52
Gender Male, 99.9%
Happy 1%
Sad 3.5%
Surprised 5.4%
Confused 9.7%
Calm 73.2%
Angry 5.3%
Disgusted 1.9%

AWS Rekognition

Age 35-52
Gender Male, 99.1%
Disgusted 3%
Sad 5.8%
Calm 56.4%
Surprised 7.6%
Happy 11%
Confused 10%
Angry 6.2%

AWS Rekognition

Age 6-13
Gender Female, 52.7%
Disgusted 10.1%
Confused 1.9%
Surprised 6.9%
Calm 67.7%
Angry 10.5%
Happy 1.3%
Sad 1.7%

AWS Rekognition

Age 26-43
Gender Female, 98.1%
Happy 1.2%
Disgusted 1.6%
Angry 5.4%
Confused 3.9%
Calm 82.2%
Surprised 2%
Sad 3.7%

AWS Rekognition

Age 19-36
Gender Female, 81.6%
Calm 10.7%
Sad 82.7%
Surprised 1.4%
Disgusted 0.8%
Happy 0.6%
Angry 1.8%
Confused 1.9%

AWS Rekognition

Age 35-52
Gender Male, 97.1%
Happy 12.4%
Sad 15.9%
Calm 4.9%
Confused 6.5%
Disgusted 8.8%
Surprised 2.5%
Angry 49%

AWS Rekognition

Age 23-38
Gender Male, 98.2%
Confused 4.5%
Calm 77.5%
Happy 4.6%
Disgusted 2.1%
Angry 2.1%
Sad 7.4%
Surprised 1.9%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Confused 45.1%
Surprised 45.3%
Angry 49.9%
Happy 45.1%
Calm 45.3%
Disgusted 48.9%
Sad 45.4%

AWS Rekognition

Age 35-53
Gender Female, 50.4%
Confused 45.2%
Angry 48.1%
Sad 46.6%
Calm 47.1%
Happy 45.2%
Disgusted 47.3%
Surprised 45.6%

AWS Rekognition

Age 16-27
Gender Male, 53.7%
Happy 45.6%
Calm 48%
Confused 45.9%
Sad 47.6%
Surprised 45.7%
Angry 46.1%
Disgusted 46.1%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man standing in front of a crowd 92.4%
a man standing in front of a crowd of people 85.9%
a young man standing in front of a crowd 81.2%