Human Generated Data

Title

Outside, Lester MacKinney, Bernice Reagon, and John O’Neal wait to get in [a Nashville Tic Toc restaurant]

Date

1962, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.24

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Outside, Lester MacKinney, Bernice Reagon, and John O’Neal wait to get in [a Nashville Tic Toc restaurant]

People

Artist: Danny Lyon, American born 1942

Date

1962, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Clothing 99.6
Apparel 99.6
Person 99.4
Human 99.4
Person 98.9
Person 98.8
Person 98.8
Helmet 96.8
Person 96
Person 94.8
Person 94.1
Coat 88.9
Overcoat 88.9
Hat 86.9
Suit 80.8
Suit 80.4
Vehicle 69.1
Transportation 69.1
Train 69.1
Accessory 65.4
Tie 65.4
Accessories 65.4
Train Station 63.8
Terminal 63.8
Pedestrian 61.7
Hardhat 61.4

Clarifai
created on 2018-02-10

people 99.7
group 98.4
adult 97.4
administration 94.9
group together 94.8
man 93.8
leader 93.7
wear 93.4
several 91.2
vehicle 90.6
offense 90.4
woman 89.5
many 89.4
police 88.5
airport 88.4
street 87
portrait 86.3
outfit 85.8
two 82
commerce 81.7

Imagga
created on 2018-02-10

barbershop 100
shop 100
establishment 28.5
city 28.2
urban 20.1
people 19.5
street 19.3
man 18.8
building 18.8
old 16.7
architecture 14.8
business 13.4
transport 12.8
travel 12.7
transportation 12.5
train 12.2
men 12
history 11.6
door 11.5
male 11.3
office 11.3
window 11.1
historic 11
road 9.9
tourism 9.9
person 9.1
passenger 9
public 8.7
women 8.7
work 8.6
life 7.8
ancient 7.8
adult 7.8
entrance 7.7
wall 7.7
industry 7.7
town 7.4
safety 7.4
inside 7.4
occupation 7.3
room 7.3
black 7.2
vehicle 7.2

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

person 99.8
standing 94
people 84.4
group 68.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 92.7%
Angry 2%
Happy 1%
Calm 63.3%
Disgusted 0.9%
Surprised 1.2%
Sad 28.1%
Confused 3.5%

AWS Rekognition

Age 26-43
Gender Male, 92%
Disgusted 3.4%
Sad 41.3%
Surprised 1.3%
Angry 5%
Happy 1%
Calm 45.7%
Confused 2.3%

AWS Rekognition

Age 26-43
Gender Female, 81.5%
Disgusted 1.3%
Angry 2.5%
Sad 26.2%
Happy 0.7%
Calm 66.5%
Surprised 1.3%
Confused 1.4%

AWS Rekognition

Age 26-43
Gender Female, 99.5%
Calm 53.1%
Happy 2.6%
Disgusted 3.9%
Confused 3.6%
Angry 1.8%
Sad 33.8%
Surprised 1.2%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.4%
Helmet 96.8%
Hat 86.9%
Suit 80.8%
Tie 65.4%

Captions

Microsoft

a group of people standing in front of a store 96.2%
a group of people standing in front of a building 96.1%
a group of people that are standing in front of a building 95.3%

Text analysis

Amazon

HAMBURGERS
10

Google

HAMBURGEO
HAMBURGEO