Human Generated Data

Title

Feininger slide [personal photograph, 1892]

Date

1940s-1950s

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.1017.191

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

Feininger slide [personal photograph, 1892]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1940s-1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Person 99.6
Human 99.6
Clothing 98.9
Apparel 98.9
Person 98.7
Face 92.4
Hat 90.1
Crowd 76
Performer 74.2
People 73.5
Sun Hat 68
Outdoors 61.7
Musical Instrument 57.1
Musician 57.1
Jaw 56.1

Clarifai
created on 2019-05-29

people 99.9
portrait 98.7
adult 98.4
man 97.1
two 95
wear 94.5
group 91.2
woman 91.1
administration 91
child 88.8
leader 88.4
facial expression 87.7
music 86.4
musician 85.5
one 84.9
three 83.6
son 82.9
street 81.4
lid 80.7
veil 80

Imagga
created on 2019-05-29

man 34.9
groom 31.1
couple 30.5
love 29.2
adult 27.8
portrait 27.8
people 27.3
person 26.4
male 23.9
happy 20.7
face 20.6
hair 18.2
attractive 18.2
mother 18
pretty 17.5
husband 17
looking 16
smile 15.7
eyes 15.5
black 14.8
married 14.4
together 14
two 13.5
wife 13.3
lifestyle 13
expression 12.8
human 12.7
happiness 12.5
handsome 12.5
girls 11.8
parent 11.8
spectator 11.7
family 11.6
lady 11.4
senior 11.2
men 11.2
old 11.1
women 11.1
smiling 10.9
grandma 10.7
romance 10.7
child 10.6
loving 10.5
marriage 10.4
guy 10.1
head 10.1
holding 9.9
world 9.8
bride 9.7
sexy 9.6
look 9.6
body 9.6
elderly 9.6
wedding 9.2
one 9
romantic 8.9
sibling 8.6
serious 8.6
casual 8.5
relationship 8.4
hand 8.4
dark 8.3
hold 8.3
fun 8.2
cute 7.9
day 7.8
brunette 7.8
hands 7.8
model 7.8
sitting 7.7
youth 7.7
emotion 7.4
joyful 7.3
cheerful 7.3
suit 7.2
beard 7.2
wet 7.2

Google
created on 2019-05-29

Microsoft
created on 2019-05-29

clothing 99.2
human face 99.1
person 96.8
old 95.6
hat 95.3
fashion accessory 92.8
smile 87.6
man 87
black 71.5
fedora 69.9
posing 66.9
cowboy hat 54.5
vintage 44

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-55
Gender Male, 84%
Sad 4.8%
Happy 4.2%
Angry 12.5%
Confused 3.1%
Surprised 2.1%
Disgusted 45.2%
Calm 28.2%

AWS Rekognition

Age 26-43
Gender Male, 85.1%
Happy 1.5%
Surprised 2.6%
Sad 4.7%
Calm 75.1%
Angry 4.1%
Disgusted 10.2%
Confused 1.8%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 90.1%

Captions

Microsoft

a vintage photo of a boy 88.5%
a vintage photo of a person 88.4%
an old black and white photo of a boy 83.2%