Human Generated Data

Title

Racers, McHenry, Illinois
Date

1965, printed 2006
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Doug and Joan Hansen, 2010.9
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Racers, McHenry, Illinois

People

Artist: Danny Lyon, American born 1942

Date

1965, printed 2006

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 99.6
Person 99.6
Person 99.6
Transportation 99.6
Motorcycle 99.6
Vehicle 99.6
Person 98.9
Person 98.6
Apparel 98.3
Clothing 98.3
Helmet 98.3
Machine 89.6
Motorcycle 87.9
Motor 81.5
Motorcycle 79.4
Spoke 72.1
Sunglasses 69.3
Accessory 69.3
Accessories 69.3
People 66.8
Tire 63.6
Hardhat 62.7
Sunglasses 62.2
Helmet 61.9
Bike 60.8
Bicycle 60.8
Wheel 60.1
Crash Helmet 55.8

Clarifai
created on 2018-03-22

people 99.8
vehicle 99.8
adult 99.4
transportation system 98.7
group together 98.4
man 98
biker 97.9
group 97.3
seated 96.5
motorcyclist 96.3
woman 95.9
two 95.3
bike 95.1
recreation 93
one 91.2
wear 90.5
four 90.4
driver 90.1
three 88.5
wheel 87.8

Imagga
created on 2018-03-22

musical instrument 68
guitar 53.5
music 49.7
wind instrument 45.5
accordion 43.2
musician 41
instrument 38.1
musical 37.3
keyboard instrument 33.8
playing 32.8
bass 30.6
guitarist 30.5
rock 30.4
man 28.9
play 28.4
sax 27.4
person 26.9
male 26.2
electric 23.4
player 21.8
performer 21.6
adult 20.8
people 20.6
band 20.4
concert 20.4
performance 20.1
entertainment 19.3
singer 18.4
device 17.9
sound 17.8
artist 17.3
washboard 16.4
black 16.2
studio 15.9
style 15.6
portrait 15.5
jeans 14.3
song 13.6
stage 13.5
sexy 12.8
youth 12.8
acoustic 12.8
art 12.4
fun 12
attractive 11.9
hair 11.9
melody 11.7
lifestyle 11.6
fashion 11.3
men 11.2
brass 10.8
stringed instrument 10.8
equipment 10.7
string 10.6
microphone 10.5
free-reed instrument 10.1
occupation 10.1
power 10.1
holding 9.9
rocker 9.9
solo 9.9
performing 9.8
sing 9.8
jazz 9.8
pop 9.7
metal 9.6
roll 9.5
guy 9.5
star 9.4
hand 9.1
blues 8.8
job 8.8
standing 8.7
model 8.6
culture 8.5
hat 8.5
city 8.3
happy 8.1
concertina 8
chord 7.9
strings 7.9
singing 7.9
perform 7.9
professional 7.8
pretty 7.7
two 7.6
electric guitar 7.5
action 7.4
protection 7.3
handsome 7.1
women 7.1
cool 7.1

Google
created on 2018-03-22

land vehicle 98.2
motor vehicle 97.9
vehicle 95.7
car 94.5
motorcycle 88
black and white 86.2
snapshot 81.8
monochrome photography 68.7
monochrome 60.5
wheel 55.3
vintage clothing 50.7

Microsoft
created on 2018-03-22

person 99.5
outdoor 99.1
people 91.7
posing 81.3
group 74.2
motorcycle 41.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 99.1%
Disgusted 1.6%
Happy 0.7%
Confused 4.2%
Calm 3.9%
Angry 3.7%
Surprised 1%
Sad 84.9%

AWS Rekognition

Age 27-44
Gender Male, 98.4%
Calm 10%
Confused 9.3%
Disgusted 5.5%
Sad 60.6%
Happy 1%
Surprised 4.9%
Angry 8.7%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Calm 52.4%
Disgusted 45.1%
Surprised 45.2%
Happy 45.1%
Sad 46.5%
Angry 45.3%
Confused 45.3%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Motorcycle 99.6%
Helmet 98.3%
Sunglasses 69.3%

Captions

Microsoft

a group of people sitting on a motorcycle 92.7%
a vintage photo of a group of people sitting on a motorcycle 91.2%
a group of people sitting on a motorcycle posing for a photo 90.2%

Text analysis

Amazon

(