Human Generated Data

Title

[Unidentified visitor in studio]

Date

1935-1937

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.309.4

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Unidentified visitor in studio]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1935-1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Human 97.9
Person 97.9
Apparel 90.8
Clothing 90.8
Face 80.8
Door 62.5
Photography 62.2
Photo 62.2
Portrait 62.2
Overcoat 61.6
Coat 61.6
Text 61.4
Female 60.2
People 59.4
Suit 58.7
Man 57.7

Clarifai
created on 2019-05-29

people 99.7
one 98.3
adult 98.1
man 92.8
sit 91.6
woman 91.2
two 89.3
furniture 89.2
wear 88.4
portrait 88.4
child 87.9
room 86.6
indoors 84
music 81.9
administration 79.1
actor 77.7
facial expression 77.1
seat 77.1
monochrome 75.4
actress 74.9

Imagga
created on 2019-05-29

home 39.9
person 37.2
indoors 32.5
adult 32.1
people 31.3
man 30.9
sitting 27.5
male 27
lifestyle 24.6
happy 23.2
smiling 22.4
room 22
house 20.9
casual 19.5
interior 19.5
couch 18.4
portrait 18.1
computer 18
laptop 16.9
looking 16.8
indoor 16.4
smile 16.4
working 15.9
holding 14.9
work 14.2
job 14.2
happiness 14.1
senior 14.1
attractive 14
child 13.8
business 13.4
mature 13
cheerful 13
sofa 12.9
women 12.7
domestic 12.6
couple 12.2
men 12
scholar 12
pretty 11.9
alone 11.9
reading 11.4
face 11.4
book 11.1
relaxing 10.9
leisure 10.8
intellectual 10.6
elderly 10.5
worker 10.5
one 10.5
professional 10
living room 9.8
family 9.8
office 9.8
seated 9.7
living 9.5
sit 9.5
clothing 9.4
relaxation 9.2
inside 9.2
life 9.1
human 9
handsome 8.9
technology 8.9
color 8.9
retired 8.7
retirement 8.6
comfortable 8.6
one person 8.5
modern 8.4
horizontal 8.4
stringed instrument 8.3
blond 8.2
confident 8.2
notebook 8.1
black 8
guy 7.9
love 7.9
furniture 7.9
grandfather 7.8
desk 7.8
corporate 7.7
apartment 7.7
old 7.7
only 7.6
serious 7.6
relaxed 7.5
fun 7.5
suit 7.5
camera 7.4
occupation 7.3
sexy 7.2
table 7.2
bright 7.2
chair 7.1
hair 7.1
toilet 7.1
day 7.1
businessman 7.1
together 7

Google
created on 2019-05-29

Microsoft
created on 2019-05-29

person 98.9
sitting 98.1
human face 95.8
clothing 95.1
black and white 83.5
smile 78.5
black 70.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 94.9%
Sad 18.4%
Surprised 3.1%
Confused 2.1%
Calm 6.5%
Happy 50.6%
Angry 12.1%
Disgusted 7.3%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%

Captions

Microsoft

a person sitting in front of a window 74.9%
a person sitting in front of a laptop 73.4%
a person sitting posing for the camera 73.3%

Text analysis

Amazon

PPIIP
MTLnintt