Human Generated Data

Title

Charles Sherrod (standing at right) and Randy Battle (seated) visit a supporter in the Georgia countryside. Sherrod married there and thirty years later is still in southwest Georgia, a member of the Albany City Council

Date

1963, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2014.443

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Charles Sherrod (standing at right) and Randy Battle (seated) visit a supporter in the Georgia countryside. Sherrod married there and thirty years later is still in southwest Georgia, a member of the Albany City Council

People

Artist: Danny Lyon, American born 1942

Date

1963, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 99.5
Person 99.5
Person 98.7
Person 98.3
Person 97.8
Sitting 92.9
Clothing 88.7
Apparel 88.7
Face 78.9
Chair 67.1
Furniture 67.1
Bench 63
Outdoors 61.9
Photography 61
Portrait 61
Photo 61
Jacket 60
Coat 60
Sleeve 57.7
Banister 57.4
Handrail 57.4
Finger 57.4

Clarifai
created on 2018-02-10

people 99.9
adult 98.9
two 98.5
group 98.5
man 97.6
one 96.2
group together 95.3
three 94.9
street 92.6
wear 92.5
administration 91.5
four 91
home 90.1
several 90.1
child 89.7
woman 89.1
war 88.6
many 86
boy 85.7
military 84.8

Imagga
created on 2018-02-10

building 29.5
city 27.4
architecture 26.9
sky 18.5
street 17.5
fence 17.4
structure 17.2
urban 14.9
travel 14.8
guillotine 14.3
buildings 14.2
house 13.4
old 13.2
park 12.6
barrier 12.2
trees 11.6
device 11.3
outdoors 11.2
tree 10.8
skyline 10.4
ancient 10.4
vehicle 10.1
snow 10.1
cinema 10.1
vacation 9.8
landscape 9.7
roof 9.5
industry 9.4
winter 9.4
instrument 9.1
tourism 9.1
forklift 8.8
black 8.4
theater 8.2
holiday 7.9
gate 7.9
forest 7.8
stone 7.8
season 7.8
scene 7.8
aerial 7.8
outside 7.7
architectural 7.7
outdoor 7.6
lamp 7.6
cityscape 7.6
window 7.5
town 7.4
exterior 7.4
door 7.3
business 7.3
new 7.3
tourist 7.2
metal 7.2
dirty 7.2
steel 7.2
car 7.1

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

person 100
man 99
outdoor 98.4
older 32.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 96.3%
Happy 4.1%
Angry 7.5%
Disgusted 4.5%
Sad 6.9%
Surprised 18.8%
Confused 10.6%
Calm 47.7%

AWS Rekognition

Age 26-43
Gender Male, 95.2%
Confused 9.6%
Surprised 5.1%
Calm 14.5%
Happy 2.8%
Disgusted 5%
Angry 22.1%
Sad 41%

AWS Rekognition

Age 26-43
Gender Male, 93.4%
Happy 1.9%
Sad 20.4%
Angry 13.3%
Calm 38.8%
Confused 13.8%
Disgusted 5.7%
Surprised 6.2%

AWS Rekognition

Age 45-66
Gender Female, 85.7%
Disgusted 0.3%
Angry 1.3%
Calm 90.2%
Happy 0.8%
Sad 5.7%
Confused 0.7%
Surprised 1%

AWS Rekognition

Age 16-27
Gender Female, 87.1%
Disgusted 5.1%
Surprised 7.6%
Angry 5.4%
Happy 1.5%
Sad 47.6%
Confused 3%
Calm 29.7%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Jacket 60%

Captions

Microsoft

a man sitting on a bench 92.4%
a man and a woman sitting on a bench 82.4%
a man sitting on a bench talking on a cell phone 72.1%