Human Generated Data

Title

City Children, Cologne
Date

1932, printed 1976
People

Artist: August Sander, German 1876 - 1964

Printer: Gunther Sander, German 1907 - 1987
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Richard Norton Memorial Fund, 2016.275
Copyright

© August Sander Family Collection / Artists Rights Society (ARS), New York

Human Generated Data

Title

City Children, Cologne

People

Artist: August Sander, German 1876 - 1964

Printer: Gunther Sander, German 1907 - 1987

Date

1932, printed 1976

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 99.9
Person 99.9
Person 99.8
Person 99.8
Footwear 99.7
Shoe 99.7
Clothing 99.7
Apparel 99.7
Shoe 99.7
Shoe 98.7
Path 98.3
Shoe 97.7
Shorts 96.5
Walkway 96.3
Shoe 95.9
Shoe 87.4
Pavement 83.6
Sidewalk 83.6
Female 83.2
People 81.7
Overcoat 66.5
Coat 66.5
Woman 63.7
Skirt 63.4
Hand 63
Girl 60.9
Long Sleeve 58.8
Sleeve 58.8
Holding Hands 57.3
Person 50.1

Clarifai
created on 2018-08-22

child 99.9
people 99.8
son 98.8
two 98.4
wear 98.4
boy 98
group 97.2
offspring 97.2
sibling 97
portrait 96.9
adult 95.8
facial expression 95.4
three 94.9
street 94.9
family 94.1
five 91.4
group together 91.1
girl 90.8
monochrome 89
four 89

Imagga
created on 2018-08-22

kin 68.4
people 31.2
child 29.1
man 27.5
park 26.3
person 24.8
male 21.4
adult 21.4
mother 21.2
outdoors 20.9
happy 20.7
outdoor 20.6
portrait 20
couple 20
walking 19.9
together 17.5
parent 17.5
family 16.9
autumn 15.8
love 15.8
walk 15.2
smiling 13.7
lifestyle 13.7
daughter 13.7
two 13.5
smile 13.5
human 13.5
day 13.3
happiness 13.3
world 13.1
boy 13
outside 12.8
old 12.5
holding 11.5
sibling 11.3
friendship 11.2
women 11.1
girls 10.9
season 10.9
fall 10.9
cute 10.8
face 10.6
fun 10.5
senior 10.3
summer 10.3
grass 10.3
culture 10.2
casual 10.2
tree 10
city 10
father 9.9
cheerful 9.7
juvenile 9.7
group 9.7
forest 9.6
friends 9.4
model 9.3
street 9.2
life 8.9
scarf 8.9
statue 8.7
cold 8.6
sculpture 8.6
females 8.5
fashion 8.3
countryside 8.2
exercise 8.2
active 8.1
history 8
holiday 7.9
hands 7.8
men 7.7
youth 7.7
winter 7.7
dad 7.7
husband 7.6
relationship 7.5
one 7.5
mature 7.4
clothing 7.4
children 7.3
brother 7.2
childhood 7.2
hair 7.1
son 7.1

Google
created on 2018-08-22

people 96.2
photograph 96.1
clothing 96
standing 93.2
child 86.9
infrastructure 86.4
vintage clothing 85.6
black and white 84.6
snapshot 81.8
girl 80
dress 79.8
monochrome photography 72.2
family 71.2
outerwear 70.9
house 67
pattern 65.2
fun 63.7
winter 61.8
street 61.4
monochrome 61.3

Microsoft
created on 2018-08-22

outdoor 99.7
ground 99.6
person 99
sky 98.5
standing 80.9
old 60
posing 59.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Female, 68.7%
Confused 1.2%
Sad 42.4%
Happy 42.9%
Calm 2.8%
Disgusted 4.9%
Angry 3.8%
Surprised 1.9%

AWS Rekognition

Age 14-23
Gender Female, 98.4%
Confused 2.6%
Calm 5.5%
Disgusted 1.4%
Angry 43.6%
Surprised 0.7%
Sad 45.6%
Happy 0.6%

AWS Rekognition

Age 10-15
Gender Female, 76.5%
Happy 0.6%
Calm 2.2%
Disgusted 0.4%
Confused 0.6%
Surprised 0.3%
Sad 84.8%
Angry 11.1%

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 13
Gender Male

Microsoft Cognitive Services

Age 10
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 99.7%
Skirt 63.4%

Captions

Microsoft

a group of people posing for a photo 95.9%
a group of people posing for the camera 95.8%
a group of people posing for a picture 95.7%

Text analysis

Amazon

M