Human Generated Data

Title

Andy, meeting at the Stoplight, Cicero, Illinois

Date

1965, printed 2006

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Doug and Joan Hansen, 2010.22

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Andy, meeting at the Stoplight, Cicero, Illinois

People

Artist: Danny Lyon, American born 1942

Date

1965, printed 2006

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 99.5
Person 99.5
Person 99.4
Person 99.4
Person 99
Person 99
Person 98.8
Person 98.4
Person 98.2
Person 96.7
Person 83.7
Sunglasses 76.5
Accessories 76.5
Accessory 76.5
Military Uniform 70
Military 70
Weapon 67.4
Weaponry 67.4
People 65.6
Crowd 60.1
Gun 59.8
Clothing 58.8
Apparel 58.8
Person 48.9

Clarifai
created on 2018-03-22

people 99.9
group 99
many 98.6
adult 98.1
group together 97.8
military 96.7
war 95.9
administration 95.1
several 93.7
vehicle 93.2
outfit 93
recreation 92.8
man 92.2
wear 92.2
woman 90.8
soldier 90.7
uniform 90.1
leader 89.2
portrait 87.4
military uniform 84.7

Imagga
created on 2018-03-22

man 30.2
person 25.6
male 24.9
people 22.9
men 22.3
black 19.3
clothing 17.1
adult 16.5
model 16.3
portrait 16.2
fashion 15.1
face 14.2
performer 13.8
urban 12.2
sexy 12
helmet 12
uniform 11.9
washboard 11.7
city 11.6
device 11.4
style 11.1
women 11.1
girls 10.9
dark 10.8
shop 10.8
attractive 10.5
smoke 10.2
street 10.1
weapon 9.8
hat 9.8
human 9.7
fun 9.7
equipment 9.6
photographer 9.3
occupation 9.2
music 9
retro 9
one 9
comedian 8.9
musician 8.8
war 8.7
play 8.6
world 8.4
studio 8.4
entertainment 8.3
mask 8.1
covering 8.1
worker 8
entertainer 8
job 8
love 7.9
work 7.8
smile 7.8
army 7.8
party 7.7
singer 7.7
construction 7.7
two 7.6
hand 7.6
leisure 7.5
gun 7.3
sensuality 7.3
industrial 7.3
group 7.2
smiling 7.2
dress 7.2
lifestyle 7.2
looking 7.2
handsome 7.1
family 7.1

Google
created on 2018-03-22

Microsoft
created on 2018-03-22

person 100
group 88.2
people 72.8
crowd 2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 55%
Happy 45.4%
Calm 49%
Angry 46.6%
Sad 47.6%
Confused 45.4%
Disgusted 45.5%
Surprised 45.4%

AWS Rekognition

Age 45-63
Gender Male, 69.2%
Confused 0.3%
Angry 0.7%
Disgusted 0.2%
Sad 2.2%
Happy 0.3%
Calm 95.8%
Surprised 0.5%

AWS Rekognition

Age 26-43
Gender Male, 94.4%
Disgusted 1%
Confused 1.2%
Sad 32.3%
Calm 4.8%
Happy 0.3%
Angry 59.8%
Surprised 0.5%

AWS Rekognition

Age 26-43
Gender Male, 99.1%
Surprised 1%
Sad 14.1%
Happy 1%
Disgusted 1.1%
Calm 70.7%
Angry 10%
Confused 2.1%

AWS Rekognition

Age 11-18
Gender Female, 54.9%
Happy 53.6%
Surprised 45.1%
Sad 46.1%
Disgusted 45%
Angry 45.1%
Calm 45.1%
Confused 45.1%

AWS Rekognition

Age 38-59
Gender Male, 99.4%
Surprised 2.5%
Happy 0.9%
Sad 3.1%
Confused 2%
Disgusted 0.2%
Angry 1.7%
Calm 89.5%

AWS Rekognition

Age 35-52
Gender Female, 50.8%
Surprised 45.3%
Confused 45.5%
Disgusted 45.2%
Angry 45.8%
Sad 46%
Calm 52.1%
Happy 45.1%

AWS Rekognition

Age 20-38
Gender Male, 64.6%
Confused 2.4%
Happy 0.9%
Surprised 1.7%
Calm 21.8%
Disgusted 0.4%
Sad 70.5%
Angry 2.4%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 16
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Sunglasses 76.5%

Captions

Microsoft

a group of people sitting on a bench 92.1%
a group of people sitting at a bench 91.5%
a group of people that are sitting on a bench 85.9%