Human Generated Data

Title

As demonstrators block traffic to protest segregation and unfair hiring practices in downtown Atlanta, a mob begins to abuse them with kicks, blows, and burning cigarettes. An anonymous woman walking by with a box of typing paper confronts the mob and for a while holds them at bay. When someone yells, “If you feel that way, why don’t you marry one of them?” she sits down and joins the demonstrators
Date

1963, printed 2010
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2014.444
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

As demonstrators block traffic to protest segregation and unfair hiring practices in downtown Atlanta, a mob begins to abuse them with kicks, blows, and burning cigarettes. An anonymous woman walking by with a box of typing paper confronts the mob and for a while holds them at bay. When someone yells, “If you feel that way, why don’t you marry one of them?” she sits down and joins the demonstrators

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2014.444

Copyright

© Danny Lyon/Magnum Photos

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.8
Human 99.8
Person 99.8
Person 99.7
Person 99.5
Person 99.4
Person 99.1
Person 98.9
Clothing 97.5
Apparel 97.5
Person 96.4
Person 94.7
Crowd 93.5
Person 92.6
Person 88.4
Overcoat 68.2
Coat 68.2
Suit 68.2
People 68
Glasses 64.3
Accessory 64.3
Accessories 64.3
Shirt 60.2
Text 60
Parade 59.4
Pants 57.2
Face 55.7
Audience 55.6

Clarifai
created on 2018-03-22

people 99.7
group 99
many 98.1
adult 97.9
man 96
administration 95.7
group together 95.3
leader 95.1
several 92.8
woman 91.5
wear 89.6
war 87.7
offense 86.3
police 80.5
military 78.1
portrait 76.1
outfit 73
vehicle 72.8
music 72.6
recreation 72.6

Imagga
created on 2018-03-22

man 45
male 39.1
people 31.2
person 28.3
couple 26.1
men 20.6
smiling 18.1
happy 16.9
senior 15.9
business 15.8
adult 15.5
together 14.9
group 13.7
team 13.4
portrait 12.9
home 12.7
indoors 12.3
women 11.8
love 11.8
work 11.8
family 11.6
job 11.5
black 11.4
standing 11.3
two 11
businessman 10.6
cheerful 10.6
student 10.5
planner 10.3
occupation 10.1
20s 10.1
fun 9.7
world 9.7
married 9.6
loving 9.5
enjoying 9.5
happiness 9.4
room 9.2
hand 9.1
industrial 9.1
human 9
sixties 8.8
60s 8.8
husband 8.7
lifestyle 8.7
30s 8.6
education 8.6
wife 8.5
old 8.4
school 8.2
spectator 8.2
office 8.1
looking 8
equipment 7.9
smile 7.8
half length 7.8
40s 7.8
middle aged 7.8
dancing 7.7
nurse 7.6
meeting 7.5
leisure 7.5
camera 7.4
safety 7.4
indoor 7.3
new 7.3
success 7.2

Google
created on 2018-03-22

crowd 91.3
black and white 88.7
infrastructure 87.7
street 82.9
snapshot 81.8
photography 80.8
monochrome photography 77.9
monochrome 68.3
vehicle 53.9
road 53.6

Microsoft
created on 2018-03-22

person 100
group 85.7
standing 82.6
people 78.7
crowd 2.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-25
Gender Male, 95.4%
Happy 0.9%
Calm 84.7%
Angry 4.7%
Disgusted 0.3%
Sad 4.8%
Surprised 1.2%
Confused 3.4%

AWS Rekognition

Age 20-38
Gender Female, 98%
Calm 94.7%
Surprised 1%
Sad 1.3%
Angry 0.8%
Disgusted 0.2%
Confused 1.7%
Happy 0.2%

AWS Rekognition

Age 23-38
Gender Male, 100%
Confused 31.1%
Sad 7.3%
Surprised 8.5%
Angry 18.7%
Calm 29%
Happy 1.5%
Disgusted 3.8%

AWS Rekognition

Age 57-77
Gender Male, 99.4%
Disgusted 0.4%
Sad 19.5%
Calm 53.7%
Surprised 2%
Happy 1.7%
Confused 6%
Angry 16.7%

AWS Rekognition

Age 26-43
Gender Male, 98%
Confused 19.4%
Sad 22.3%
Surprised 2.1%
Angry 3.5%
Calm 49.7%
Happy 1.7%
Disgusted 1.4%

AWS Rekognition

Age 20-38
Gender Male, 95.4%
Angry 0.3%
Happy 0.2%
Confused 0.4%
Sad 3%
Surprised 0.7%
Calm 95.1%
Disgusted 0.3%

AWS Rekognition

Age 26-43
Gender Male, 98%
Angry 12.4%
Happy 0.6%
Disgusted 3.1%
Calm 63%
Sad 12%
Surprised 2.4%
Confused 6.5%

AWS Rekognition

Age 35-52
Gender Male, 95.5%
Happy 7.6%
Disgusted 9.7%
Surprised 9.7%
Confused 12.3%
Calm 25.9%
Sad 20.6%
Angry 14.3%

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Disgusted 1.8%
Happy 2.2%
Surprised 4.9%
Angry 12.5%
Calm 63%
Sad 7.2%
Confused 8.4%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Angry 46%
Confused 45.8%
Disgusted 45.2%
Happy 45.1%
Surprised 45.2%
Sad 45.8%
Calm 51.9%

AWS Rekognition

Age 26-43
Gender Male, 99.2%
Happy 2.2%
Angry 11.6%
Disgusted 22.4%
Sad 3.2%
Surprised 4.6%
Calm 52.6%
Confused 3.5%

AWS Rekognition

Age 60-90
Gender Male, 95.5%
Disgusted 0.8%
Confused 5.4%
Angry 3.2%
Surprised 3%
Happy 1.1%
Sad 2.3%
Calm 84.1%

AWS Rekognition

Age 26-43
Gender Male, 96.8%
Calm 0.3%
Happy 96.9%
Disgusted 0.3%
Surprised 0.9%
Angry 0.5%
Sad 0.4%
Confused 0.7%

AWS Rekognition

Age 38-57
Gender Male, 93.9%
Sad 0.8%
Disgusted 3.1%
Angry 0.8%
Calm 92.7%
Surprised 1%
Happy 1.1%
Confused 0.6%

AWS Rekognition

Age 35-52
Gender Male, 96.8%
Sad 4.5%
Disgusted 1.1%
Angry 4.5%
Calm 85.4%
Surprised 1.8%
Happy 0.4%
Confused 2.4%

AWS Rekognition

Age 26-43
Gender Male, 98.9%
Surprised 3.7%
Angry 12%
Happy 15.7%
Sad 16.1%
Disgusted 2.4%
Confused 5.3%
Calm 44.8%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Confused 45.5%
Surprised 45.3%
Disgusted 45.2%
Happy 45.1%
Sad 47.6%
Calm 49.8%
Angry 46.5%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 74
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 16
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 18
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Glasses 64.3%

Categories

Imagga

people portraits 98.9%
events parties 0.5%
paintings art 0.2%
streetview architecture 0.2%

Text analysis

Amazon

fork
Kodak
Coca- ola
NILTON-CATES
CE STAY 00D Kodak fork
CE STAY
00D

Google

ILTON-CATES Kodak fork
ILTON-CATES
Kodak
fork