Human Generated Data

Title

Cockroach and his family, Chicago

Date

1965, printed 2006

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Doug and Joan Hansen, 2010.19

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Cockroach and his family, Chicago

People

Artist: Danny Lyon, American born 1942

Date

1965, printed 2006

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 99.8
Human 99.8
Shorts 99.6
Clothing 99.6
Apparel 99.6
Gate 86.3
Person 82.2
Person 81.3
Person 77.8
Footwear 70.6
Shoe 70.6
Pants 66.5
Fence 65.5
Outdoors 61.4
Shoe 54.6

Clarifai
created on 2018-03-22

people 100
adult 99.2
two 98.8
one 98.5
home 98
street 97.9
woman 97.6
man 97.2
group 97
monochrome 96.2
group together 96.2
administration 95
wear 90.3
facial expression 88.5
three 88.1
four 87
leader 86.7
vehicle 86.4
canine 85
child 83.5

Imagga
created on 2018-03-22

handcart 100
shopping cart 100
wheeled vehicle 79.1
container 50.8
conveyance 26.5
fence 24.9
barrier 16.7
outdoors 15.7
park 15.6
old 15.3
trees 14.2
turnstile 14.1
sky 14
gate 14
winter 13.6
picket fence 13.4
tree 13.1
structure 12.8
landscape 12.6
forest 12.2
snow 11.6
black 11.4
building 11.4
cold 11.2
grunge 11.1
grass 10.3
obstruction 10.2
architecture 10.2
house 10
wood 10
city 10
outdoor 9.9
wall 9.7
pattern 9.6
scene 9.5
people 9.5
season 9.4
vintage 9.1
dirty 9
summer 9
man 8.7
light 8.7
movable barrier 8.6
sport 8.4
garden 8.4
exterior 8.3
street 8.3
road 8.1
rural 7.9
design 7.9
urban 7.9
day 7.8
antique 7.8
travel 7.7
empty 7.7
outside 7.7
person 7.7
texture 7.6
frame 7.5
fun 7.5
style 7.4
water 7.3
paint 7.2
sun 7.2
metal 7.2

Google
created on 2018-03-22

Microsoft
created on 2018-03-22

outdoor 99.5
tree 97.8
building 87.7
house 74.4
porch 40.4
window 15.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.5%
Angry 4.4%
Disgusted 1.8%
Sad 7.3%
Surprised 2.1%
Confused 2.3%
Happy 10.2%
Calm 71.9%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Happy 45.1%
Calm 46%
Angry 46.4%
Sad 51.7%
Confused 45.4%
Disgusted 45.3%
Surprised 45.3%

AWS Rekognition

Age 1-5
Gender Female, 54.6%
Happy 46%
Sad 47.4%
Angry 45.8%
Disgusted 45.2%
Confused 46.3%
Surprised 45.9%
Calm 48.4%

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 70.6%

Captions

Microsoft

a person standing in front of a house 97.3%
a person standing in front of a house 95.3%
a man and a woman standing in front of a house 90.3%