Human Generated Data

Title

[Julia and Lyonel Feininger in roof garden, 16th Floor, 235 E. 22nd Street apartment, New York, New York]
Date

1939
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.502.31

Human Generated Data

Title

[Julia and Lyonel Feininger in roof garden, 16th Floor, 235 E. 22nd Street apartment, New York, New York]

People

Artist: Unidentified Artist,

Date

1939

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.502.31

Machine Generated Data

Tags

Amazon
created on 2019-11-19

Person 99.1
Human 99.1
Person 99.1
Person 98.8
Person 89.5
Apparel 88
Clothing 88
Sitting 87.2
Hat 79.5
Chair 72.4
Furniture 72.4
Female 66.8
People 66.5
Meal 65.4
Food 65.4
Face 64.4
Overcoat 58.1
Suit 58.1
Coat 58.1
Couch 57.1
Restaurant 55.5
Finger 55.2
Photography 55.1
Photo 55.1

Clarifai
created on 2019-11-19

people 99.9
adult 99.4
woman 98.4
seat 98.2
vehicle 97.8
wear 97.5
group 97.1
two 96.2
furniture 95.8
group together 95.6
transportation system 95.5
chair 94.6
veil 94.2
lid 93.2
man 93.1
three 93
facial expression 91
outfit 90.8
one 89.8
sit 89.3

Imagga
created on 2019-11-19

person 40.4
man 39
male 27.7
people 26.8
adult 21.5
sitting 18.9
scholar 18.9
smile 18.5
happy 17.5
wind instrument 17.5
smiling 16.6
lifestyle 16.6
men 16.3
business 15.8
intellectual 15.1
musical instrument 14.5
computer 14.4
oboe 14.4
handsome 14.3
family 14.2
work 14.1
mature 13.9
job 13.3
senior 13.1
life 12.8
laptop 12.8
portrait 12.3
bassoon 12.3
room 12.2
looking 12
home 12
woodwind 11.9
happiness 11.8
worker 11.7
office 11.4
face 11.4
singer 11.2
old 11.1
grandfather 11.1
casual 11
working 10.6
indoors 10.5
uniform 10.5
attractive 10.5
couple 10.5
love 10.3
youth 10.2
musician 10
businessman 9.7
professional 9.6
corporate 9.4
passenger 9.4
model 9.3
hat 9.3
two 9.3
phone 9.2
city 9.1
alone 9.1
holding 9.1
technology 8.9
together 8.8
building 8.7
guy 8.6
reading 8.6
father 8.6
hand 8.4
fashion 8.3
mother 8.2
style 8.2
suit 8.1
women 7.9
clothing 7.8
black 7.8
helmet 7.7
elderly 7.7
daughter 7.6
flute 7.6
businesspeople 7.6
communication 7.6
one 7.5
outdoors 7.5
glasses 7.4
occupation 7.3
cheerful 7.3
stringed instrument 7.2
aged 7.2
hair 7.1
child 7.1

Google
created on 2019-11-19

Photograph 96.1
Snapshot 85.8
Black-and-white 68.3
Photography 62.4
Stock photography 62.1
Monochrome 60.1
Sitting 57.5

Microsoft
created on 2019-11-19

person 96.9
clothing 95
human face 93.4
text 89.6
man 84.4
smile 77.1
black and white 77
hat 67.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 40-58
Gender Female, 51.8%
Sad 54.1%
Surprised 45%
Happy 45.2%
Angry 45.1%
Confused 45.1%
Disgusted 45.1%
Calm 45.2%
Fear 45.3%

Feature analysis

Amazon

Person 99.1%
Hat 79.5%

Captions

Microsoft
created on 2019-11-19

a man sitting on a table 72.9%
a man sitting at a table 72.8%
a man sitting in a chair 72.7%