Human Generated Data

Title

Feininger slide [personal photograph, Feininger's father in 1912]

Date

1940s-1950s

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.1017.224

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

Feininger slide [personal photograph, Feininger's father in 1912]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1940s-1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Human 99.3
Person 99.3
Face 90.6
Performer 81.3
Head 73
Leisure Activities 69.7
Man 65.3
Portrait 64.8
Photography 64.8
Photo 64.8
Poster 57.1
Advertisement 57.1
Outdoors 56.9
Musical Instrument 55.2
Musician 55.2

Clarifai
created on 2019-05-29

people 99.9
portrait 99.5
adult 98.9
one 98.4
man 97.8
administration 93.3
leader 90.9
facial expression 90.3
wear 89.1
retro 82.5
art 81.9
outfit 79.9
music 78.2
scientist 76.5
musician 76
street 74.9
writer 74.1
movie 73.5
actor 72
child 71.6

Imagga
created on 2019-05-29

negative 41.9
film 36.6
black 35.7
portrait 35.6
person 29.4
face 27.7
photographic paper 26.8
man 26.2
male 24.8
book jacket 24.4
adult 22
jacket 21.8
dark 21.7
attractive 21
eyes 19.8
people 19
photographic equipment 17.9
hair 17.4
expression 16.2
fashion 15.8
sexy 15.3
human 15
wrapping 14.4
pretty 14
studio 13.7
eye 13.4
model 13.2
guy 13
covering 12.9
one 12.7
close 12
smile 11.4
lips 11.1
make 10.9
evil 10.7
nose 10.6
style 10.4
emotion 10.1
head 10.1
makeup 10.1
handsome 9.8
look 9.6
youth 9.4
cute 9.3
lady 8.9
looking 8.8
body 8.8
laptop 8.7
skin 8.6
sensual 8.2
spooky 7.8
horror 7.8
art 7.7
elegance 7.6
happy 7.5
screen 7.4
sensuality 7.3
boy 7.1

Google
created on 2019-05-29

Microsoft
created on 2019-05-29

human face 99
person 93.8
clothing 85
man 84.2
portrait 82.9
old 72.4
glasses 68.2
black and white 65.3
smile 63.1
white 63.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 97.8%
Confused 15.5%
Sad 11%
Calm 34.7%
Surprised 3.4%
Disgusted 5.4%
Angry 15.8%
Happy 14.3%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a black and white photo of a man 76.8%
an old photo of a man 76.7%
old photo of a man 76.6%