Human Generated Data

Title

[Hägg-Feininger Family in Stockholm, 1936]

Date

1940s-1950s

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.1003.142

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Hägg-Feininger Family in Stockholm, 1936]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1940s-1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.8
Human 99.8
Clothing 99.6
Apparel 99.6
Person 99.3
Hat 97.6
Helmet 97.1
Person 91.3
Outdoors 82.4
Hat 80.7
Nature 79.5
Face 69.8
Countryside 68.8
Cap 68
People 65.1
Coat 62.1
Overcoat 62.1
Sitting 59.6
Pants 58.2
Rural 57.8

Clarifai
created on 2019-11-16

people 99.9
wear 98.2
adult 97.8
man 96.8
group together 95.6
child 95.5
woman 95
group 94.6
two 93
uniform 91.6
outfit 91.4
sitting 90.6
administration 88
veil 87.2
lid 86.7
military 85.4
many 84.8
facial expression 84.8
one 84.6
boy 83.6

Imagga
created on 2019-11-16

kin 25.8
man 25.5
world 24.9
people 24
beach 21.1
person 19.4
love 18.9
male 18.1
sunset 17.1
black 16.8
parent 16.7
couple 16.5
adult 16.2
outdoor 16
child 16
silhouette 15.7
father 15.5
family 15.1
water 14.7
happy 13.8
portrait 13.6
dad 13.3
sea 13.3
summer 12.9
outdoors 12.7
ocean 12.4
athlete 12.2
player 12.1
sky 12.1
happiness 11.7
mother 11.7
attractive 11.2
women 11.1
relax 10.9
married 10.5
husband 10.5
enjoy 10.3
men 10.3
sport 10.3
lifestyle 10.1
vacation 9.8
ballplayer 9.7
together 9.6
casual 9.3
dark 9.2
one 9
sitting 8.6
dusk 8.6
wife 8.5
clothing 8.5
joy 8.3
leisure 8.3
holding 8.2
fun 8.2
active 8.1
sand 8.1
romantic 8
looking 8
contestant 7.8
travel 7.7
guy 7.7
two 7.6
fashion 7.5
relaxation 7.5
free 7.5
human 7.5
action 7.4
peaceful 7.3
lady 7.3
group 7.2
uniform 7.2
romance 7.1
smile 7.1
face 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

clothing 97.6
text 92.7
black and white 90.7
person 87.8
man 78.5
human face 72.5
old 49.6
crowd 0.7

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 22-34
Gender Female, 97.6%
Angry 4.3%
Happy 20.9%
Disgusted 1.6%
Calm 19.6%
Fear 22%
Surprised 3.8%
Sad 18.7%
Confused 9.1%

AWS Rekognition

Age 22-34
Gender Male, 94.1%
Disgusted 1.9%
Happy 8.7%
Fear 0.5%
Confused 1%
Surprised 2.9%
Calm 82.5%
Angry 1%
Sad 1.4%

AWS Rekognition

Age 9-19
Gender Male, 52.2%
Fear 45.1%
Angry 48.2%
Calm 48.1%
Happy 45.6%
Sad 47.9%
Disgusted 45%
Confused 45.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 19
Gender Female

Feature analysis

Amazon

Person 99.8%
Hat 97.6%
Helmet 97.1%

Captions

Microsoft

an old photo of a person 86.9%
a group of people sitting around a baseball field 50.7%
a group of people sitting on a bus 32%