Human Generated Data

Title

Jimmy Hicks, Julian Bond, John Lewis, and Jeremiah X stand across the street from the bombed church

Date

1963, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.28

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Jimmy Hicks, Julian Bond, John Lewis, and Jeremiah X stand across the street from the bombed church

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Clothing 99.9
Apparel 99.9
Coat 99.8
Overcoat 99.8
Person 99.2
Human 99.2
Person 99.1
Person 98.5
Person 96.1
Shoe 95.9
Footwear 95.9
Shoe 95.8
Person 95.6
Tuxedo 95.4
Shoe 95.3
Shoe 85.9
Shoe 79.9
Shoe 78.2
Jacket 70.8
Man 70.1
Blazer 67.1
Suit 66.9
People 61.8
Face 61.5
Path 58.8
Pedestrian 57.5
Pants 55.7
Plant 55.3
Suit 53.8
Shoe 50.2

Clarifai
created on 2018-02-10

people 99.5
adult 97.6
administration 97
group 96.9
group together 96.7
street 96.2
man 94.8
leader 92.2
offense 90.9
police 90.8
many 90.7
woman 90.6
war 90.3
several 89.6
wear 86.6
two 84.6
three 83.5
military 83.2
road 82.2
four 81.9

Imagga
created on 2018-02-10

man 28.9
male 22.4
city 21.6
street 20.2
people 19.5
person 18.5
call 17.8
building 15.5
guillotine 15.3
urban 14
adult 13.6
outdoors 13.5
tourist 13.4
outdoor 13
standing 12.2
architecture 11.9
instrument 11.7
device 11.6
business 11.5
couple 11.3
boy 11.3
happy 11.3
portrait 11
prison 10.7
attractive 9.8
men 9.4
travel 9.2
telephone 9.1
statue 8.9
looking 8.8
together 8.8
black 8.7
smiling 8.7
day 8.6
corporate 8.6
two 8.5
house 8.4
fashion 8.3
traveler 8.3
suit 8.3
family 8
lifestyle 7.9
casual 7.6
england 7.6
walking 7.6
one 7.5
town 7.4
world 7.3

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

outdoor 100
person 97.2
street 79.1
way 46.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 58.3%
Happy 1.6%
Sad 19.8%
Calm 63.1%
Confused 2.2%
Disgusted 5.8%
Angry 5.9%
Surprised 1.6%

AWS Rekognition

Age 26-43
Gender Male, 98.1%
Disgusted 1.1%
Confused 16.7%
Happy 0.2%
Angry 17.7%
Calm 17.5%
Surprised 0.9%
Sad 46%

AWS Rekognition

Age 35-52
Gender Male, 87.4%
Calm 80.5%
Angry 4.1%
Disgusted 4.8%
Sad 3.7%
Surprised 2.2%
Confused 3.4%
Happy 1.3%

AWS Rekognition

Age 48-68
Gender Male, 90.9%
Disgusted 0.4%
Happy 0.8%
Surprised 1.9%
Angry 1.8%
Calm 90.2%
Sad 4%
Confused 0.9%

Feature analysis

Amazon

Person 99.2%
Shoe 95.9%
Suit 66.9%

Captions

Microsoft

a group of people standing in front of a building 94.9%
a group of people standing on a sidewalk 94.2%
a group of people standing in front of a store 91.3%

Text analysis

Amazon

DRINK
IOCKEY
DESTAURAND
IOCKEY B
B
ocll
oc lola (oca a ocll
oc lola
(oca a

Google

JOCHEY
RESTA
JOCHEY RESTA