Human Generated Data

Title

Pianist, Cologne
Date

1928, printed 1976
People

Artist: August Sander, German 1876 - 1964

Printer: Gunther Sander, German 1907 - 1987
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Richard Norton Memorial Fund, 2016.293
Copyright

© August Sander Family Collection / Artists Rights Society (ARS), New York

Human Generated Data

Title

Pianist, Cologne

People

Artist: August Sander, German 1876 - 1964

Printer: Gunther Sander, German 1907 - 1987

Date

1928, printed 1976

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Clothing 99.6
Apparel 99.6
Coat 99.5
Hat 97.8
Overcoat 92.9
Person 90.3
Human 90.3
Stick 84
Cane 75.7
Shoe 63.2
Footwear 63.2
Floor 60.9

Clarifai
created on 2018-04-18

people 99.8
wear 99.4
adult 99
one 98.7
veil 98.4
lid 98.1
man 97.8
portrait 97.1
outfit 96.8
leader 96
administration 94.9
facial expression 91.1
retro 89.7
indoors 88.9
two 88.5
outerwear 87.6
menswear 86
woman 85.7
group 83.9
walking stick 83.1

Imagga
created on 2018-04-18

suit 77.5
business 43.1
man 43
male 41.2
clothing 41.1
businessman 33.6
garment 31.9
person 31.5
handsome 30.3
trench coat 27.8
adult 27.4
success 27.4
people 26.2
professional 24.1
job 23.9
smile 23.5
portrait 23.3
corporate 23.2
happy 23.2
executive 22.9
military uniform 22.6
attractive 22.4
raincoat 22.2
jacket 22
office 21.7
hat 21.5
coat 21
tie 20.9
worker 20.6
work 20.4
smiling 19.5
uniform 19.3
covering 19.3
model 18.7
briefcase 18.3
successful 18.3
engineer 18.3
manager 17.7
consumer goods 17.5
standing 17.4
confident 17.3
black 16.9
fashion 16.6
modern 16.1
studio 16
holding 15.7
businesswoman 15.5
architect 15.5
businesspeople 15.2
building 15.1
helmet 15
one 14.9
face 14.9
men 14.6
employee 14.6
construction 14.5
lifestyle 14.5
casual 14.4
looking 14.4
boss 13.4
working 13.3
guy 13.2
shirt 13.1
elegant 12.9
occupation 12.8
happiness 12.5
career 12.3
company 12.1
architecture 11.7
wearing 11.4
engineering 11.4
20s 11
designer 10.6
hand 10.6
formal 10.5
look 10.5
smart 10.4
site 10.3
cap 9.9
pretty 9.8
necktie 9.8
corporation 9.7
style 9.6
confidence 9.6
profession 9.6
indoor 9.1
cheerful 8.9
builder 8.9
student 8.9
employment 8.7
1 8.7
bag 8.6
serious 8.6
industry 8.5
expression 8.5
elegance 8.4
alone 8.2
indoors 7.9
mortarboard 7.9
hardhat 7.8
staff 7.8
hard 7.6
development 7.6
headdress 7.6

Google
created on 2018-04-18

standing 87.8
gentleman 86.6
headgear 78.2
formal wear 73.2
suit 72.5
black and white 65.9
fedora 62.4
vintage clothing 59.8
health & beauty 56.4
tuxedo 52.2

Microsoft
created on 2018-04-18

person 97.8
ground 96.4
floor 94.9
standing 93.5
black 89.2
suit 88.6
old 76.7
wearing 75.6
posing 59.7
dressed 33.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 99.5%
Confused 5%
Surprised 2.8%
Calm 85.4%
Happy 1%
Disgusted 1.4%
Angry 2.1%
Sad 2.3%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.5%
Hat 97.8%
Overcoat 92.9%
Person 90.3%
Shoe 63.2%

Captions

Microsoft

a person wearing a suit and tie standing in front of a building 96.5%
a person wearing a suit standing in front of a building 96.4%
a person wearing a suit and hat standing in front of a building 96.3%