Human Generated Data

Title

Riders' meeting, Elkhorn, Wisconsin

Date

1963, printed 2006

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Doug and Joan Hansen, 2009.243

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Riders' meeting, Elkhorn, Wisconsin

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2006

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 99.7
Human 99.7
Person 99.6
Person 99
Person 98.9
Person 97.7
Person 97.5
Person 97.2
Person 96.6
Crowd 92.9
Person 91.6
Audience 90.1
Person 89.7
Person 88.6
People 85.6
Person 84.6
Person 84.6
Person 83.7
Person 83.2
Person 76.7
Person 73.6
Person 66.2
Sunglasses 66.1
Accessory 66.1
Accessories 66.1
Footwear 64.8
Shoe 64.8
Clothing 64.8
Apparel 64.8
Person 64.4
Person 62.6
Military 61.7
Military Uniform 61.7
Outdoors 61
Shoe 58
Armored 56.3
Army 56.3
Person 48.9

Clarifai
created on 2018-03-23

people 100
many 99.7
group 99.5
adult 98.4
woman 96.2
man 96.2
group together 96.1
child 94.6
military 92.7
crowd 92.6
war 92
administration 90.9
recreation 90.5
soldier 88.7
boy 86.4
sit 82.2
skirmish 81.8
wear 80.4
leader 77.1
uniform 75.7

Imagga
created on 2018-03-23

man 20.3
grunge 17.9
dance 17.8
person 16.1
male 14.9
black 14.7
people 14.5
adult 14.4
art 13.1
couple 12.2
dress 11.7
love 11
dark 10
kin 9.8
dancer 9.8
fashion 9.8
water 9.3
fountain 9.3
silhouette 9.1
party 8.6
passion 8.5
portrait 8.4
child 8.3
retro 8.2
happy 8.1
musical instrument 8
romance 8
sexy 8
happiness 7.8
creation 7.8
boy 7.8
play 7.7
youth 7.7
old 7.7
structure 7.6
poster 7.5
pattern 7.5
outdoors 7.5
aged 7.2
dirty 7.2
face 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 100
text 89.2
group 84.4
people 77.7
posing 63.2
team 29.5
crowd 22

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 96.4%
Angry 33.6%
Calm 37.4%
Sad 6.3%
Disgusted 6.3%
Surprised 2.1%
Confused 12.1%
Happy 2.3%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Disgusted 45.9%
Happy 45.2%
Confused 46.2%
Calm 46%
Angry 48.1%
Surprised 45.5%
Sad 48.2%

AWS Rekognition

Age 57-77
Gender Male, 54.9%
Angry 45.5%
Sad 50%
Disgusted 46.8%
Surprised 45.2%
Calm 46.3%
Happy 45.3%
Confused 45.9%

AWS Rekognition

Age 26-44
Gender Female, 51.4%
Surprised 45.1%
Confused 45.1%
Sad 45.2%
Angry 45.2%
Calm 54.2%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Confused 46.1%
Disgusted 46%
Angry 47%
Calm 45.6%
Sad 50%
Happy 45.2%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Sad 45.9%
Happy 45.1%
Calm 51.7%
Surprised 45.2%
Disgusted 45.9%
Confused 45.4%
Angry 45.8%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Calm 45.7%
Disgusted 45.3%
Surprised 45.2%
Happy 45.1%
Sad 48.1%
Angry 50.6%
Confused 45.1%

AWS Rekognition

Age 29-45
Gender Female, 50.7%
Happy 45.1%
Surprised 45.1%
Sad 52.9%
Angry 45.7%
Calm 45.2%
Disgusted 45.7%
Confused 45.2%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Happy 45.1%
Surprised 45.1%
Sad 50.1%
Disgusted 45.1%
Angry 48.6%
Calm 45.8%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 55%
Disgusted 45.2%
Angry 45.9%
Sad 45.2%
Confused 45.4%
Calm 51.5%
Surprised 45.6%
Happy 46.2%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Sad 46.2%
Confused 45.2%
Disgusted 45.2%
Calm 52.2%
Surprised 45.2%
Happy 45.5%
Angry 45.4%

AWS Rekognition

Age 12-22
Gender Female, 53.2%
Disgusted 45.8%
Surprised 46.3%
Angry 46.5%
Confused 45.4%
Calm 48.6%
Sad 46.6%
Happy 45.8%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Disgusted 45.5%
Confused 45.5%
Calm 52.5%
Happy 45.1%
Sad 45.5%
Surprised 45.3%
Angry 45.6%

AWS Rekognition

Age 38-59
Gender Male, 54.6%
Sad 46.2%
Happy 52.1%
Calm 45.6%
Surprised 45.2%
Disgusted 45.6%
Confused 45.2%
Angry 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Surprised 45.2%
Confused 45.2%
Sad 46%
Angry 46%
Calm 52.6%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-44
Gender Male, 54.8%
Disgusted 45.1%
Confused 45.3%
Sad 45.2%
Surprised 45.2%
Calm 47.5%
Angry 45.2%
Happy 51.6%

AWS Rekognition

Age 26-43
Gender Male, 55%
Disgusted 45.2%
Calm 49.8%
Happy 45.7%
Surprised 45.4%
Sad 47.6%
Angry 45.9%
Confused 45.4%

AWS Rekognition

Age 30-47
Gender Male, 55%
Calm 49.7%
Surprised 45.4%
Confused 45.4%
Angry 46.8%
Sad 46.2%
Happy 46.2%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Sad 45.2%
Confused 45%
Surprised 45%
Angry 45.1%
Disgusted 45%
Happy 54.6%
Calm 45%

AWS Rekognition

Age 35-55
Gender Female, 50.2%
Angry 49.8%
Confused 49.5%
Calm 49.5%
Sad 50.1%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 30-47
Gender Female, 51.9%
Angry 45.2%
Disgusted 45.1%
Sad 45.2%
Surprised 45.3%
Confused 45.1%
Happy 45.2%
Calm 53.9%

AWS Rekognition

Age 35-52
Gender Male, 50.1%
Happy 49.5%
Calm 49.7%
Angry 49.7%
Sad 50%
Confused 49.5%
Disgusted 49.5%
Surprised 49.6%

AWS Rekognition

Age 45-63
Gender Male, 50.4%
Angry 49.7%
Surprised 49.5%
Calm 50.1%
Sad 49.6%
Happy 49.5%
Disgusted 49.5%
Confused 49.6%

AWS Rekognition

Age 27-44
Gender Male, 51.9%
Surprised 45.4%
Happy 45.4%
Sad 45.3%
Confused 45.1%
Angry 45.3%
Disgusted 45.1%
Calm 53.3%

AWS Rekognition

Age 38-59
Gender Female, 50.1%
Surprised 49.5%
Calm 49.6%
Happy 49.5%
Confused 49.5%
Disgusted 50.3%
Sad 49.5%
Angry 49.5%

AWS Rekognition

Age 45-63
Gender Female, 51.7%
Calm 50.5%
Surprised 45.4%
Happy 46.1%
Confused 45.3%
Disgusted 45.3%
Angry 45.7%
Sad 46.6%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Sunglasses 66.1%
Shoe 64.8%

Captions

Microsoft

a group of people sitting posing for the camera 93%
a group of people posing for a photo 91.4%
a group of people posing for the camera 91.3%