Human Generated Data

Title

[Lyonel Feininger smoking cigarette]

Date

1931?

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.289.8

Human Generated Data

Title

[Lyonel Feininger smoking cigarette]

People

Artist: Unidentified Artist,

Date

1931?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-19

Apparel 99.7
Clothing 99.7
Hat 99.5
Person 98.1
Human 98.1
Accessories 81.8
Accessory 81.8
Tie 81.8
Sun Hat 74.2
Coat 69.8
Suit 69.8
Overcoat 69.8
Face 66.3
Finger 57.8

Clarifai
created on 2019-11-19

people 100
one 99.7
adult 99.1
man 98.4
two 96.3
wear 95.6
administration 94.1
three 92.5
group together 92.2
leader 91
group 90.9
portrait 90.7
outfit 89.9
military 88.7
war 88.1
vehicle 87.5
veil 86.2
five 84
music 82.9
woman 82.7

Imagga
created on 2019-11-19

musical instrument 50
stringed instrument 43.1
banjo 40.1
man 37
male 27.7
people 24.5
person 24.4
hand 24.3
wind instrument 21.6
music 20.8
brass 18.5
adult 18.1
musician 17.3
men 16.3
hat 16.3
guitar 15.8
cornet 14.9
play 14.7
bass 14.6
device 13.8
musical 13.4
sound 13.2
violin 12.7
concert 12.6
black 12.6
instrument 12.6
work 12.6
string 12.5
lifestyle 12.3
rock 12.2
playing 11.9
repair 11.5
player 11.3
close 10.8
guitarist 10.8
cowboy hat 10.8
job 10.6
power 10.1
harmonica 9.8
portrait 9.7
performance 9.6
head 9.2
dark 9.2
human 9
style 8.9
metal 8.9
bowed stringed instrument 8.8
life 8.8
equipment 8.8
classical 8.6
sitting 8.6
fingers 8.6
electric 8.4
guy 8.4
entertainment 8.3
headdress 8.3
holding 8.3
occupation 8.3
free-reed instrument 8.1
stage 8
working 8
melody 7.8
hands 7.8
worker 7.7
modern 7.7
skill 7.7
youth 7.7
workplace 7.6
clothing 7.6
one 7.5
horn 7.4
glasses 7.4
safety 7.4
looking 7.2
indoors 7
look 7

Google
created on 2019-11-19

Microsoft
created on 2019-11-19

person 98.1
street 97.4
black and white 96.1
clothing 95.6
human face 94.8
hat 93.3
fashion accessory 91.8
monochrome 90.8
fedora 83.1
man 78.9
text 70.3
cowboy hat 55.4
store 32.5

Face analysis

Amazon

AWS Rekognition

Age 31-47
Gender Male, 94.9%
Calm 0.6%
Happy 0%
Fear 1.1%
Sad 93.7%
Surprised 0.1%
Angry 0.6%
Confused 3.5%
Disgusted 0.3%

AWS Rekognition

Age 1-5
Gender Male, 61.8%
Confused 0.3%
Happy 0.2%
Fear 81.8%
Angry 7.1%
Sad 9.9%
Disgusted 0.1%
Surprised 0.4%
Calm 0.2%

Feature analysis

Amazon

Hat 99.5%
Person 98.1%
Tie 81.8%
Suit 69.8%

Captions

Microsoft

a person sitting in front of a store 68.5%
a person standing in front of a store 68.4%
a person sitting on a bench in front of a store 43.4%

Text analysis

Amazon

EF
r