Human Generated Data

Title

Painter, Cologne
Date

1927, printed 1977
People

Artist: August Sander, German 1876 - 1964

Printer: Gunther Sander, German 1907 - 1987
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Richard Norton Memorial Fund, 2016.257
Copyright

© August Sander Family Collection / Artists Rights Society (ARS), New York

Human Generated Data

Title

Painter, Cologne

People

Artist: August Sander, German 1876 - 1964

Printer: Gunther Sander, German 1907 - 1987

Date

1927, printed 1977

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Apparel 100
Clothing 100
Coat 99.7
Overcoat 97.4
Human 91
Person 91
Trench Coat 82.2
Hat 78.2

Clarifai
created on 2018-08-22

people 99.9
adult 98.6
street 97.6
one 97.4
wear 97.1
coat 96.5
portrait 96.4
man 95.5
administration 95.4
outerwear 94.8
overcoat 94.5
leader 94.3
outfit 91.5
two 90.5
group 90.2
woman 89.8
veil 88.5
lid 87.2
group together 85.1
road 83.9

Imagga
created on 2018-08-22

raincoat 100
trench coat 100
coat 86.9
hat 37
bearskin 31.4
garment 28.9
man 26.9
clothing 26.4
people 26.2
headdress 25.5
adult 23.3
street 22.1
person 21.7
male 21.3
attractive 20.3
suit 19.9
portrait 18.8
city 18.3
business 17.6
walking 17
outside 16.3
pretty 16.1
cap 16.1
urban 15.7
men 15.5
walk 15.2
happy 15
fashion 14.3
mortarboard 14.1
work 14.1
model 14
smiling 13.7
lifestyle 13.7
holding 13.2
outdoors 12.7
one 12.7
women 12.6
job 12.4
businessman 12.4
autumn 12.3
outdoor 12.2
education 12.1
casual 11.9
boy 11.3
standing 11.3
corporate 11.2
cloak 11.1
student 10.9
black 10.8
smile 10.7
gown 10.6
success 10.5
brunette 10.5
architecture 10.1
20s 10.1
cute 10
graduation 9.8
handsome 9.8
building 9.5
happiness 9.4
lady 8.9
family 8.9
university 8.6
bag 8.5
jacket 8.5
professional 8.4
executive 8.3
confident 8.2
businesswoman 8.2
snow 8.1
school 8.1
group 8.1
worker 8
graduate 7.9
face 7.8
stand 7.6
camera 7.4
alone 7.3
weather 7.3
looking 7.2
posing 7.1
day 7.1

Google
created on 2018-08-22

coat 95.3
photograph 95
standing 94.5
infrastructure 88.3
gentleman 86.7
black and white 84
snapshot 81.8
vintage clothing 79
suit 78.8
street 77.6
outerwear 75.3
fashion 72.4
road 69.8
monochrome photography 67.1
headgear 63.4
formal wear 60.5
monochrome 59.4
overcoat 58.9
jacket 55.3
fedora 53.8

Microsoft
created on 2018-08-22

building 99.8
outdoor 99.8
ground 99.7
person 95.6
way 90.8
sidewalk 80.5
scene 80.2
coat 61.3
old 55.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 99.9%
Disgusted 0.1%
Surprised 0.2%
Calm 96.4%
Happy 0.1%
Confused 1.3%
Sad 1.6%
Angry 0.5%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.7%
Overcoat 97.4%
Person 91%
Hat 78.2%

Captions

Microsoft

a person standing on a sidewalk 95.3%
a person standing in front of a building 94.5%
a person standing on a sidewalk 92.9%