Human Generated Data

Title

Subway, NYC

Date

1950

People

Artist: Larry Silver, American born 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bruce Silverstein, 2018.389

Human Generated Data

Title

Subway, NYC

People

Artist: Larry Silver, American born 1934

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bruce Silverstein, 2018.389

Machine Generated Data

Tags

Amazon
created on 2020-03-11

Apparel 99.8
Clothing 99.8
Person 96.9
Human 96.9
Face 96.9
Sitting 95.3
Sleeve 72.1
Beard 68.9
Finger 67.8
Furniture 67.6
Overcoat 66.3
Coat 66.3
Shelf 64.6
Portrait 61
Photo 61
Photography 61
Hat 59.1
Door 55.3
Fashion 55.2

Clarifai
created on 2020-03-11

people 99.8
one 98.9
street 98.8
adult 98.1
portrait 97.9
woman 97.7
administration 93.7
wear 93.6
war 91.8
elderly 91.1
monochrome 89.8
sadness 88.5
wait 88.2
man 85.3
coat 85
train 84
vehicle 83.1
offense 81.2
outerwear 80.7
two 80.3

Imagga
created on 2020-03-11

locker 49.6
device 41.4
fastener 40
restraint 30.7
call 29.1
elevator 27.6
man 23.5
lifting device 22.1
male 22.1
person 20.4
people 20.1
old 18.8
adult 18.8
door 17.5
portrait 17.5
black 16.9
telephone 16.1
pay-phone 14.1
wall 12.8
urban 12.2
fashion 12.1
human 12
home 12
one 11.9
house 11.7
smile 11.4
face 11.4
building 11.3
vintage 10.7
happy 10.6
room 10.4
electronic equipment 10.4
model 10.1
cute 10
city 10
pretty 9.8
attractive 9.8
couple 9.6
hair 9.5
expression 9.4
architecture 9.4
guy 9.3
alone 9.1
lady 8.9
sexy 8.8
sitting 8.6
serious 8.6
child 8.6
elegance 8.4
equipment 8.3
outdoors 8.2
girls 8.2
dirty 8.1
looking 8
interior 8
job 8
business 7.9
love 7.9
industry 7.7
grunge 7.7
casual 7.6
refrigerator 7.6
wood 7.5
detail 7.2
machine 7.1

Google
created on 2020-03-11

Black 96.3
White 96.3
Photograph 95.8
Black-and-white 94.1
Monochrome 93.5
People 93.1
Sitting 86.2
Transport 85.1
Snapshot 84.9
Monochrome photography 84.4
Human 76.9
Photography 74.8
Street 72.9
Infrastructure 71.7
Style 57.4
Window 56.8

Microsoft
created on 2020-03-11

person 99.7
human face 98
clothing 97
text 96.5
sitting 96.3
black and white 95.8
man 90.5
monochrome 60.5
old 52.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-49
Gender Female, 93.5%
Angry 1%
Calm 2.6%
Fear 0.9%
Surprised 0.2%
Sad 43.9%
Confused 1.7%
Happy 0.2%
Disgusted 49.4%

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%

Text analysis

Amazon

Much
MILDER
FROM
THROAT
EFFECTS
SINUSES
ADVERSE
OF
THROAT AND SINUSES OF NOSE
SMOKING
AND
ON
NOSE
NO ADVERSE EFFECTS ON
REPORTS
FROM SMOKING GROUP
REPORTS CHESTERFIEL
CHESTERFIEL
NO
GROUP
trom
requior
trom varicus ci
varicus
ci

Google

NO ADVERSE EFFECTS ON NOSE, THROAT AND SINUSES OF GROUP FROM SMOKING CHESTERFIELD REPORTS A MEDICAL SPECIALIST making reguiar exominctions ot a group i smokers from various wolks of life Much MILDER REGULAR&KING-SIZE
NO
ADVERSE
EFFECTS
ON
NOSE,
THROAT
AND
SINUSES
OF
GROUP
FROM
SMOKING
CHESTERFIELD
REPORTS
A
MEDICAL
SPECIALIST
making
reguiar
exominctions
ot
a
group
i
smokers
from
various
wolks
of
life
Much
MILDER
REGULAR&KING-SIZE