Human Generated Data

Title

Young Boy Outside his Apartment
Date

1965
People

Artist: Danny Lyon, American born 1942
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Susan and Neal Yanofsky, 2014.495
Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Young Boy Outside his Apartment

People

Artist: Danny Lyon, American born 1942

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 98.4
Person 98.4
Clothing 98.2
Apparel 98.2
Shorts 96.6
Face 77.6
Wall 77.2
Flagstone 76.8
Walkway 74.6
Path 74.6
Boy 66.8
Child 64.5
Kid 64.5
Sitting 63.8
Finger 60.3
Brick 59.4
Banister 58
Handrail 58
Footwear 57.5

Clarifai
created on 2018-02-09

people 99.8
child 99.4
one 99.1
portrait 98.6
street 97.9
monochrome 97.6
adult 95.4
window 90.9
woman 90.8
boy 90.4
wear 90.1
girl 89.9
sadness 86.8
son 86.3
sit 83.8
music 81.4
dress 81.2
abandoned 79.5
doorway 79.2
door 79

Imagga
created on 2018-02-09

wall 29.9
door 22.5
old 18.8
building 18.7
person 17.8
architecture 15.6
mother 15
man 14.1
people 13.4
ancient 13
adult 12.9
parent 12.9
house 12.5
brick 12.4
attractive 11.9
style 11.9
portrait 11.6
posing 11.5
device 11.2
street 11
stone 11
cell 10.2
wood 10
call 10
city 10
fashion 9.8
entrance 9.7
black 9.6
lifestyle 9.4
tricycle 9.2
pretty 9.1
sensuality 9.1
human 9
lady 8.9
sexy 8.8
male 8.8
room 8.6
grunge 8.5
elegance 8.4
alone 8.2
aged 8.1
dirty 8.1
dress 8.1
structure 7.9
support 7.9
sax 7.8
model 7.8
construction 7.7
outdoor 7.6
window 7.6
emotion 7.4
blackboard 7.3
cute 7.2
hair 7.1
stairs 7

Google
created on 2018-02-09

photograph 95.8
black 95.2
person 93.4
black and white 92.6
sitting 89.1
standing 88.4
monochrome photography 85
photography 83
wall 82.9
snapshot 81.8
child 81.3
girl 78.7
human behavior 74.3
monochrome 72.5
portrait 69.8
human 69.5
window 63.8
portrait photography 57.6
smile 55.5

Microsoft
created on 2018-02-09

building 100
outdoor 99.8
person 96.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Male, 96.6%
Disgusted 8.7%
Sad 8.6%
Calm 6.6%
Surprised 6.7%
Happy 6.9%
Confused 16.5%
Angry 46.1%

Microsoft Cognitive Services

Age 11
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a young boy standing in front of a building talking on a cell phone 21.8%
a person standing in front of a building talking on a cell phone 21.7%
a person standing in front of a brick building 21.6%