Human Generated Data

Title

A crowd watches the demonstrators returning to the city hall steps
Date

1963, printed 2010
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.27
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

A crowd watches the demonstrators returning to the city hall steps

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.27

Copyright

© Danny Lyon/Magnum Photos

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Apparel 99.7
Clothing 99.7
Person 99.5
Human 99.5
Person 99.5
Person 99.4
Person 99.3
Person 99
Person 99
Person 98.7
Footwear 98.3
Shoe 98.3
Person 97.9
Person 95.9
Person 95.6
Person 95.2
Person 94.5
Shoe 93.2
Shoe 93.1
People 92.7
Shoe 92.6
Shoe 91.1
Sitting 89.6
Person 86
Shorts 84.1
Person 83.7
Shoe 82.8
Pants 77
Shoe 77
Person 76
Person 74.4
Person 74.3
Crowd 72.9
Outdoors 67
Person 64.5
Face 64.2
Shoe 61.9
Furniture 61.7
Audience 60.2
Kid 59
Child 59
Shoe 58.6
Person 57.6
Chair 55.1
Hat 54.6
Person 43.7

Clarifai
created on 2018-02-10

people 99.9
many 99.2
group 98.7
group together 98.4
adult 97.2
woman 95.5
wear 94.2
administration 92.6
child 92.6
man 92.4
several 86.6
leader 86.6
military 85.5
spectator 85.3
outfit 85
recreation 84.7
sit 82.6
war 81.5
crowd 81.5
music 81.5

Imagga
created on 2018-02-10

kin 45.9
man 20.8
people 19.5
person 18.5
sculpture 17.4
love 16.6
male 16.3
statue 16.2
child 15.5
adult 15.5
attractive 15.4
father 14.8
art 13.2
couple 13.1
mother 12.6
dancer 12.5
ancient 12.1
fashion 12.1
sitting 12
old 11.8
family 11.6
together 11.4
lady 11.4
happy 11.3
culture 11.1
dad 11.1
portrait 11
parent 10.9
lifestyle 10.8
religion 10.7
history 10.7
travel 10.6
happiness 10.2
two 10.2
smile 10
performer 9.9
sexy 9.6
monument 9.3
dance 9.1
pretty 9.1
fun 9
smiling 8.7
togetherness 8.5
outdoor 8.4
world 8.3
tourism 8.2
outdoors 8.2
girls 8.2
bench 8.1
home 8
women 7.9
cute 7.9
soldier 7.8
army 7.8
model 7.8
heritage 7.7
casual 7.6
relax 7.6
joy 7.5
city 7.5
one 7.5
historic 7.3
black 7.2
hair 7.1
day 7.1

Google
created on 2018-02-10

photograph 95.2
black and white 88
snapshot 81.8
monochrome photography 76.2
standing 74.5
street 69
monochrome 68.8
human behavior 66.4
troop 63.3
crowd 55.3

Microsoft
created on 2018-02-10

person 100
outdoor 96.1
ground 95.9
people 84
group 83.9
crowd 2.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 76.2%
Happy 41.8%
Calm 5.2%
Angry 3.8%
Disgusted 17.7%
Sad 26%
Surprised 3%
Confused 2.5%

AWS Rekognition

Age 35-52
Gender Male, 98.9%
Happy 17.5%
Sad 24.3%
Calm 29%
Confused 11.2%
Disgusted 7%
Angry 7.9%
Surprised 3%

AWS Rekognition

Age 57-77
Gender Male, 99.6%
Calm 12.4%
Angry 26.1%
Surprised 1.5%
Sad 36.8%
Disgusted 6.8%
Happy 3.7%
Confused 12.7%

AWS Rekognition

Age 20-38
Gender Male, 96.9%
Confused 0.9%
Disgusted 0.2%
Angry 0.8%
Surprised 0.2%
Happy 0.1%
Sad 95.4%
Calm 2.4%

AWS Rekognition

Age 26-43
Gender Male, 91.1%
Disgusted 3.4%
Happy 8.2%
Surprised 3.7%
Angry 2.5%
Calm 76.5%
Sad 4.4%
Confused 1.4%

AWS Rekognition

Age 38-57
Gender Male, 83.1%
Surprised 1.5%
Happy 2.3%
Sad 5%
Calm 87.3%
Disgusted 0.7%
Angry 2%
Confused 1.2%

AWS Rekognition

Age 26-43
Gender Male, 99.4%
Angry 7.4%
Confused 5.9%
Surprised 1.8%
Calm 65.4%
Disgusted 11%
Sad 7.7%
Happy 0.7%

AWS Rekognition

Age 26-43
Gender Male, 98.8%
Disgusted 9%
Confused 7.2%
Happy 10%
Angry 7.3%
Calm 49.5%
Surprised 9.9%
Sad 7.1%

AWS Rekognition

Age 26-43
Gender Male, 94.8%
Angry 11.4%
Confused 9.9%
Disgusted 7.9%
Happy 2%
Surprised 3%
Sad 31.8%
Calm 33.9%

AWS Rekognition

Age 35-52
Gender Male, 98.6%
Confused 2%
Sad 4.4%
Calm 42.6%
Disgusted 40.2%
Angry 8%
Happy 1.4%
Surprised 1.3%

AWS Rekognition

Age 35-52
Gender Male, 87.6%
Disgusted 11.4%
Angry 5.7%
Calm 23.8%
Happy 0.9%
Sad 50.5%
Surprised 1.5%
Confused 6.3%

AWS Rekognition

Age 20-38
Gender Female, 54.1%
Happy 46.1%
Disgusted 46.1%
Confused 45.2%
Angry 45.7%
Surprised 45.5%
Sad 47.3%
Calm 49.1%

AWS Rekognition

Age 26-43
Gender Male, 98.4%
Happy 2.2%
Sad 9.9%
Calm 31.2%
Confused 18.7%
Disgusted 3.9%
Angry 12.7%
Surprised 21.4%

AWS Rekognition

Age 26-43
Gender Female, 53.8%
Surprised 45.3%
Happy 45.8%
Confused 45.3%
Angry 45.5%
Disgusted 46.5%
Calm 47.8%
Sad 48.7%

AWS Rekognition

Age 35-52
Gender Male, 99.3%
Happy 76.5%
Calm 1.5%
Angry 5%
Disgusted 5.3%
Sad 5.9%
Surprised 3.8%
Confused 1.9%

AWS Rekognition

Age 38-59
Gender Male, 83.9%
Happy 1.1%
Disgusted 0.5%
Confused 4.6%
Angry 4.5%
Surprised 1.7%
Sad 19.6%
Calm 68%

AWS Rekognition

Age 45-65
Gender Female, 52.8%
Calm 46.9%
Happy 45.3%
Disgusted 46.3%
Surprised 45.4%
Angry 46%
Sad 49.8%
Confused 45.4%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 98.3%
Hat 54.6%