Human Generated Data

Title

Fannie Lou Hamer, sharecropper from a family of twenty children, evicted from her home for applying to register to vote, severely beaten in the Winona police station, SNCC field secretary from Ruleville, and future Mississippi Freedom Democratic party candidate for Congress, marches in the cold Hattiesburg rain

Date

1963, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.35

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Fannie Lou Hamer, sharecropper from a family of twenty children, evicted from her home for applying to register to vote, severely beaten in the Winona police station, SNCC field secretary from Ruleville, and future Mississippi Freedom Democratic party candidate for Congress, marches in the cold Hattiesburg rain

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 99.3
Person 99.3
Person 98.9
Person 98.8
Person 98.5
Person 98.4
Clothing 98.4
Footwear 98.4
Apparel 98.4
Shoe 98.4
Person 97.9
Person 97.8
Accessory 94.1
Accessories 94.1
Sunglasses 94.1
Urban 93.8
Street 93.8
Town 93.8
Road 93.8
Building 93.8
City 93.8
Person 87.3
Umbrella 86.2
Canopy 86.2
Face 85.3
Person 85.2
Countryside 84.8
Nature 84.8
Rural 84.8
Shelter 84.8
Outdoors 84.8
Shoe 84.3
Brick 80.8
Person 76.5
Person 74.4
People 68.5
Path 64.8
Pedestrian 61.9
Alley 59.2
Alleyway 59.2
Glasses 56.5

Clarifai
created on 2018-02-10

people 99.9
group 99.4
adult 98.4
many 98
group together 96.5
street 95.8
man 95
vehicle 94.4
wear 94.1
woman 93.7
child 92.9
umbrella 92.7
war 91.5
two 89.7
administration 89
road 88.3
home 86.7
several 86.4
veil 85.9
military 85.1

Imagga
created on 2018-02-10

umbrella 100
canopy 52.9
shelter 44.5
seller 38
people 24.5
person 21.3
rain 19.8
man 19.5
adult 16.2
portrait 14.9
holding 14.9
protection 14.5
parasol 14.4
male 14.2
happy 13.8
covering 13.7
outdoors 13.4
standing 13
smile 12.1
pedestrian 12
attractive 11.9
weather 11.8
city 11.6
hat 11.4
architecture 10.9
statue 10.5
men 10.3
smiling 10.1
history 9.8
businessman 9.7
under 9.6
lifestyle 9.4
hold 9.2
street 9.2
travel 9.1
religion 9
looking 8.8
couple 8.7
women 8.7
career 8.5
business 8.5
two 8.5
senior 8.4
traditional 8.3
love 7.9
pretty 7.7
culture 7.7
expression 7.7
old 7.7
employee 7.6
outdoor 7.6
sculpture 7.6
human 7.5
fun 7.5
tourism 7.4
safety 7.4
security 7.3
children 7.3
color 7.2
black 7.2
colorful 7.2
day 7.1

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

umbrella 100
outdoor 100
person 100
rain 98.8
holding 94.9
street 92.3
nature 77.3
people 75.7
group 59.5
rainy 52.7
accessory 41.7
day 28.6
crowd 1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-13
Gender Female, 97.3%
Confused 6.2%
Calm 20.3%
Disgusted 3.8%
Angry 10.5%
Surprised 1%
Sad 56.9%
Happy 1.3%

AWS Rekognition

Age 45-66
Gender Male, 96.1%
Angry 1.2%
Disgusted 1.3%
Surprised 0.8%
Calm 11%
Happy 0.9%
Confused 1.7%
Sad 83.1%

AWS Rekognition

Age 26-44
Gender Male, 92%
Calm 88.8%
Angry 3.5%
Confused 2.1%
Disgusted 2%
Surprised 2%
Happy 0.5%
Sad 1.1%

AWS Rekognition

Age 35-52
Gender Female, 67.8%
Surprised 1.4%
Angry 2.7%
Happy 2.5%
Disgusted 2%
Calm 51%
Sad 37.4%
Confused 3%

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 98.4%
Sunglasses 94.1%

Captions

Microsoft

a group of people walking in the rain holding an umbrella 96.7%
a group of people walking in the rain while holding an umbrella 96%
a group of people walking down a street holding an umbrella in the rain 94.9%

Text analysis

Amazon

ANK
TURE
rusts

Google

ANK
ANK