Human Generated Data

Title

Man and Woman Conversing
Date

c. 1673
People

Artist: Adriaen van Ostade, Dutch 1610 - 1685
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Melvin R. Seiden, S5.21.4

Human Generated Data

Title

Man and Woman Conversing

People

Artist: Adriaen van Ostade, Dutch 1610 - 1685

Date

c. 1673

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Melvin R. Seiden, S5.21.4

Machine Generated Data

Tags

Amazon
created on 2019-04-03

Human 96.5
Person 96.5
Clothing 95.5
Apparel 95.5
Hat 95.5
Art 95.2
Person 87.3
Painting 86.8
Drawing 80.7

Clarifai
created on 2018-03-24

people 100
art 99.9
engraving 99.7
print 99.7
leader 99
adult 98.7
man 98.3
illustration 98
veil 97.4
portrait 97.2
one 96.5
old 93.3
etching 92.8
facial hair 92
gown (clothing) 91.5
royalty 90.6
religion 90
cape 89.6
wear 89.4
two 87.9

Imagga
created on 2018-03-24

sketch 70.6
drawing 54.9
representation 43.6
currency 32.3
money 30.6
art 29.2
mosaic 28.6
cash 27.5
paper 25.9
finance 23.7
dollar 23.2
vintage 23.2
bank 22.4
banking 21.2
book jacket 20.9
retro 19.7
old 18.8
grunge 17.9
financial 17.8
economy 17.6
bill 17.1
pattern 16.4
jacket 16.3
business 15.8
close 15.4
texture 15.3
ancient 14.7
note 14.7
dollars 14.5
wealth 14.4
religion 14.3
exchange 14.3
antique 14.1
savings 14
banknotes 13.7
banknote 13.6
design 13.2
rich 13
bills 12.6
pay 12.5
wrapping 12.4
history 11.6
us 11.6
letter 11
payment 10.6
investment 10.1
decorative 10
frame 10
stamp 9.7
artistic 9.6
grungy 9.5
closeup 9.4
transducer 9.3
church 9.3
aged 9.1
tile 8.9
covering 8.8
graphic 8.8
hundred 8.7
finances 8.7
loan 8.6
face 8.5
color 8.3
dirty 8.1
postmark 7.9
portrait 7.8
economic 7.8
spirituality 7.7
notes 7.7
mail 7.7
god 7.7
capital 7.6
one 7.5
style 7.4
symbol 7.4
man 7.4
market 7.1
decoration 7.1
travel 7
envelope 7

Google
created on 2018-03-24

art 87.7
male 80.3
history 73.5
human behavior 69.7
drawing 65.4
artwork 64.2
portrait 60.7
figure drawing 60.5
black and white 57.7
illustration 55.1

Microsoft
created on 2018-03-24

text 98.8
book 93.7
old 49.8
stone 4.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Female, 76.1%
Happy 13.3%
Confused 3%
Disgusted 1.5%
Sad 51.6%
Calm 24.7%
Angry 3.7%
Surprised 2.2%

Microsoft Cognitive Services

Age 79
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.5%
Hat 95.5%
Painting 86.8%

Captions

Microsoft
created on 2018-03-24

an old photograph of a book 54.6%
an old picture of a person 54.5%
a close up of a book 38.7%