Human Generated Data

Title

Young Mechanic
Date

1967
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Susan and Neal Yanofsky, 2014.499
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Young Mechanic

People

Artist: Danny Lyon, American born 1942

Date

1967

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.7
Person 99.7
Person 99.6
Skin 97.6
Finger 88
Tower 76.4
Building 76.4
Clock Tower 76.4
Architecture 76.4
Back 63.5
Indoors 59
Interior Design 59
Shelf 56.7
Electronics 56.4
Screen 56.4
Clothing 56
Apparel 56

Clarifai
created on 2018-02-10

people 99.5
monochrome 99.4
portrait 98.5
man 98.2
adult 97.4
one 95.9
music 90.3
tattoo 88.6
nude 86.6
black and white 83.5
self 82.8
wear 82.3
street 82.2
son 82
model 81.5
woman 79.6
analogue 78.6
facial expression 76.5
art 75.3
shirtless 73.7

Imagga
created on 2018-02-10

call 96
telephone 38.1
man 28.9
people 28.4
person 27.5
male 26.3
adult 22
equipment 21.8
pay-phone 20.1
portrait 18.8
smiling 15.2
women 15
smile 15
black 14.4
couple 13.9
happy 13.8
human 13.5
men 12.9
camera 12.2
sexy 12
attractive 11.9
face 11.4
sitting 11.2
phone 11.1
model 10.9
lifestyle 10.8
pretty 10.5
home 10.4
hair 10.3
work 10.2
two 10.2
communication 10.1
teenager 10
girls 10
holding 9.9
one 9.7
indoors 9.7
technology 9.6
love 9.5
occupation 9.2
fashion 9
color 8.9
device 8.7
brunette 8.7
talk 8.6
drinking 8.6
professional 8.4
mature 8.4
studio 8.4
city 8.3
cheerful 8.1
handsome 8
worker 8
working 8
together 7.9
happiness 7.8
serious 7.6
casual 7.6
hand 7.6
guy 7.5
street 7.4
dress 7.2
looking 7.2
blond 7.2
cute 7.2

Google
created on 2018-02-10

photograph 95.1
black and white 90.5
barechestedness 85.5
snapshot 81.8
monochrome photography 79.7
photography 78.9
muscle 75.1
human 70.3
chest 70.2
trunk 66
monochrome 64.2
joint 55.1
human behavior 54.3
girl 54.1
back 53.8

Microsoft
created on 2018-02-10

person 99.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Male, 99.8%
Disgusted 2.2%
Sad 5.5%
Angry 3%
Calm 2.6%
Surprised 4.4%
Happy 79.2%
Confused 3.2%

AWS Rekognition

Age 26-43
Gender Female, 99.2%
Confused 6.1%
Sad 8.7%
Calm 50.4%
Surprised 2.9%
Disgusted 7.2%
Angry 23.6%
Happy 1%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Clock Tower 76.4%

Captions

Microsoft

a person posing for the camera 88.3%
a person posing for a photo 72.9%
a black and white photo of a person 65.3%