Human Generated Data

Title

March on Washington, 1963 [SNCC members and friends defiantly gather to sing freedom songs]

Date

1963, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2013.112

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

March on Washington, 1963 [SNCC members and friends defiantly gather to sing freedom songs]

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Audience 99.7
Human 99.7
Crowd 99.7
Person 98.9
Person 98.8
Person 98.5
Person 98.3
Person 97.4
Person 96.9
Person 96.9
Person 95.7
Person 89.5
Person 86
Person 85.2
Person 82
Face 68.5
People 67.1
Parade 64.2
Text 63.3
Photo 62.3
Photography 62.3
Portrait 62.3
Clothing 60.6
Apparel 60.6
Speech 56.8

Clarifai
created on 2018-02-09

people 99.9
many 98.7
administration 98.7
group 98.6
group together 98.3
crowd 96.2
leader 95.7
man 95.5
adult 91.9
victory 89.9
war 88.5
street 84.3
soldier 81.9
military 78.8
vehicle 75.9
revolution 74.5
capitol 73.8
police 71.7
audience 71.5
politician 71

Imagga
created on 2018-02-09

architecture 52.6
building 44.9
statue 40.4
city 37.4
landmark 35.2
travel 28.9
monument 24.3
tourism 23.9
sky 23.1
skyscraper 21.1
structure 20.6
famous 20.5
tourist 19
history 18.8
pier 18.2
old 17.4
tower 17.2
column 15.4
support 15.2
park 14.6
cityscape 14.2
buildings 14.2
stone 13.8
historic 13.7
urban 13.1
sculpture 12.4
device 12.3
symbol 12.1
center 11.9
skyline 11.4
house 11.4
fountain 11.1
gate 10.7
temple 10.4
bridge 10.3
culture 10.3
exterior 10.1
street 10.1
outdoor 9.9
vacation 9.8
architectural 9.6
capital 9.5
day 9.4
construction 9.4
church 9.2
outdoors 9
dome 8.9
color 8.9
light 8.7
palace 8.7
ancient 8.6
chime 8.6
place 8.4
facade 8.3
arch 8.1
night 8
government 7.8
sightseeing 7.8
chandelier 7.7
attraction 7.6
historical 7.5
window 7.5
landscape 7.4
town 7.4
water 7.3
new 7.3
religion 7.2
river 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 91
people 79.5
group 65.5
old 43.4
crowd 37
colonnade 12.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 95.4%
Disgusted 5.6%
Sad 32.9%
Calm 9%
Surprised 7.6%
Happy 5.3%
Confused 12.8%
Angry 26.9%

AWS Rekognition

Age 26-43
Gender Male, 95.5%
Calm 90.9%
Sad 5.4%
Happy 0.2%
Surprised 0.5%
Angry 1.4%
Disgusted 0.3%
Confused 1.3%

AWS Rekognition

Age 20-38
Gender Male, 93.6%
Disgusted 0.4%
Confused 3.3%
Angry 4.3%
Surprised 0.7%
Happy 0.7%
Sad 4.3%
Calm 86.4%

AWS Rekognition

Age 26-43
Gender Female, 79.9%
Surprised 12.1%
Disgusted 2.9%
Calm 34.4%
Confused 22.9%
Angry 16.7%
Happy 0.4%
Sad 10.6%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Disgusted 45.5%
Happy 45.2%
Calm 47%
Sad 45.4%
Angry 48.7%
Surprised 46.2%
Confused 47.2%

AWS Rekognition

Age 29-45
Gender Female, 98.8%
Happy 1.3%
Sad 12.3%
Confused 2.5%
Angry 3.1%
Surprised 2.2%
Calm 52.1%
Disgusted 26.6%

AWS Rekognition

Age 26-43
Gender Male, 94.3%
Disgusted 0.6%
Surprised 0.7%
Happy 2.6%
Confused 2.6%
Calm 90.1%
Sad 2.2%
Angry 1.2%

AWS Rekognition

Age 26-43
Gender Male, 97.8%
Calm 5.7%
Sad 3.7%
Happy 42.5%
Angry 14.1%
Surprised 12.4%
Disgusted 13.4%
Confused 8.3%

AWS Rekognition

Age 29-45
Gender Female, 71.4%
Disgusted 2.5%
Happy 2%
Angry 4.2%
Surprised 3%
Sad 14.1%
Calm 70.5%
Confused 3.7%

AWS Rekognition

Age 26-44
Gender Male, 83.6%
Happy 7.1%
Confused 2.4%
Disgusted 17.9%
Sad 6.3%
Angry 4.3%
Calm 59.1%
Surprised 3%

AWS Rekognition

Age 29-45
Gender Female, 50.8%
Disgusted 46.6%
Surprised 45.8%
Angry 47%
Calm 47.4%
Happy 45.5%
Sad 46.9%
Confused 45.8%

AWS Rekognition

Age 26-43
Gender Male, 98.4%
Calm 60.9%
Disgusted 6.9%
Sad 4.3%
Angry 7.7%
Confused 10.6%
Surprised 7.9%
Happy 1.7%

AWS Rekognition

Age 26-43
Gender Male, 97.8%
Happy 0.7%
Angry 17.1%
Surprised 2.7%
Sad 36.3%
Disgusted 5.5%
Calm 17.1%
Confused 20.6%

AWS Rekognition

Age 26-44
Gender Male, 54.9%
Disgusted 45.1%
Calm 53.6%
Confused 45.3%
Surprised 45.3%
Sad 45.3%
Happy 45.2%
Angry 45.4%

AWS Rekognition

Age 35-52
Gender Female, 63.2%
Surprised 2.7%
Confused 11.2%
Calm 29.1%
Happy 1%
Disgusted 3.7%
Angry 5.6%
Sad 46.8%

AWS Rekognition

Age 20-38
Gender Male, 52.5%
Confused 45.4%
Surprised 45.6%
Disgusted 45.1%
Happy 45.8%
Sad 45.6%
Calm 51.7%
Angry 45.7%

AWS Rekognition

Age 26-43
Gender Male, 99.4%
Happy 5.9%
Disgusted 1.1%
Calm 88.1%
Surprised 0.6%
Sad 1.4%
Confused 1.4%
Angry 1.6%

AWS Rekognition

Age 26-43
Gender Male, 97.7%
Sad 2.9%
Calm 91.6%
Angry 2.2%
Surprised 0.8%
Confused 1.4%
Happy 0.7%
Disgusted 0.4%

AWS Rekognition

Age 26-43
Gender Female, 67%
Happy 2.4%
Confused 1.5%
Angry 7.1%
Surprised 2.3%
Disgusted 0.8%
Calm 52.2%
Sad 33.7%

AWS Rekognition

Age 20-38
Gender Female, 51.6%
Sad 53.3%
Happy 45.3%
Angry 45.3%
Calm 45.6%
Surprised 45.2%
Confused 45.1%
Disgusted 45.1%

AWS Rekognition

Age 48-68
Gender Male, 50.2%
Angry 45.3%
Disgusted 45.3%
Calm 51.9%
Happy 45.7%
Sad 46.3%
Surprised 45.2%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Disgusted 45.5%
Sad 49.7%
Angry 46%
Calm 47.3%
Surprised 45.3%
Happy 45.5%
Confused 45.6%

AWS Rekognition

Age 48-68
Gender Male, 50.4%
Happy 49.5%
Sad 50%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Calm 49.8%
Disgusted 49.5%

AWS Rekognition

Age 60-90
Gender Male, 50.3%
Happy 49.5%
Calm 49.8%
Confused 49.5%
Angry 49.6%
Sad 49.8%
Disgusted 49.8%
Surprised 49.5%

AWS Rekognition

Age 48-68
Gender Female, 50.3%
Calm 46.6%
Angry 46%
Disgusted 45.6%
Sad 50.6%
Surprised 45.4%
Confused 45.5%
Happy 45.5%

AWS Rekognition

Age 57-77
Gender Female, 50.1%
Disgusted 49.5%
Sad 50.1%
Calm 49.7%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 35-52
Gender Female, 53.8%
Confused 45.1%
Sad 45.3%
Calm 52.3%
Happy 45.4%
Surprised 45.7%
Angry 45.3%
Disgusted 45.9%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Disgusted 49.6%
Surprised 49.6%
Angry 49.7%
Sad 49.8%
Confused 49.6%
Happy 49.5%
Calm 49.7%

AWS Rekognition

Age 23-38
Gender Female, 51.3%
Happy 45.2%
Calm 50.8%
Confused 45.3%
Sad 47.6%
Surprised 45.4%
Angry 45.5%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Calm 49.6%
Confused 49.5%
Surprised 49.5%
Disgusted 50.2%
Happy 49.5%
Angry 49.5%
Sad 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Confused 49.5%
Disgusted 49.6%
Angry 49.6%
Surprised 49.6%
Happy 49.8%
Sad 49.6%
Calm 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 49.5%
Surprised 49.5%
Angry 49.8%
Confused 49.5%
Disgusted 49.8%
Calm 49.5%
Sad 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.5%
Calm 49.5%
Sad 50.2%
Happy 49.7%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 14-23
Gender Female, 50.2%
Disgusted 49.6%
Confused 49.6%
Angry 49.6%
Surprised 49.5%
Happy 49.8%
Sad 49.8%
Calm 49.6%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people standing in front of a crowd 91.9%
a group of people in front of a crowd 91.8%
a group of people standing in front of a building 91.7%