Human Generated Data

Title

Loving Couple at a Balcony
Date

c. 1750-1810
People

Artist: Unknown Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of the Estate of Margaret F. Schroeder, 1999.313

Human Generated Data

Title

Loving Couple at a Balcony

People

Artist: Unknown Artist,

Date

c. 1750-1810

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of the Estate of Margaret F. Schroeder, 1999.313

Machine Generated Data

Tags

Amazon
created on 2019-05-22

Person 96.6
Human 96.6
Art 90.9
Home Decor 82.6
Painting 66.7
Girl 64
Female 64
Poster 62.8
Advertisement 62.8
Furniture 62.6
Collage 59.4

Clarifai
created on 2019-05-22

people 99.3
illustration 97.1
painting 96.9
adult 95.2
art 94.8
woman 92.4
print 91.3
retro 89.7
wear 89
one 88.6
man 88.3
vintage 88
veil 85.2
portrait 85.2
old 84.1
famous 82.8
lid 82.3
child 81.2
family 78
text 77.3

Imagga
created on 2019-05-22

jigsaw puzzle 100
puzzle 100
game 74.5
mosaic 33
art 30.9
money 27.2
currency 26.9
religion 25.1
cash 22.9
church 20.4
paper 19.6
banking 19.3
finance 18.6
old 17.4
god 17.2
bank 17
vintage 16.5
financial 16
icon 15.8
dollar 15.8
bill 15.2
painter 14.9
banknote 14.6
culture 14.5
wealth 14.4
economy 13.9
transducer 13.8
bible 13.7
business 13.4
close 13.1
note 12.9
holy 12.5
faith 12.4
religious 12.2
ancient 12.1
man 12.1
masterpiece 11.9
retro 11.5
antique 11.4
savings 11.2
golden 11.2
orthodox 10.8
symbol 10.8
museum 10.7
face 10.7
stamp 10.6
pay 10.5
mail 10.5
electrical device 10.3
colorful 10
paint 10
postmark 9.9
postage 9.8
banknotes 9.8
portrait 9.7
one 9.7
dollars 9.7
payment 9.6
saint 9.6
spirituality 9.6
closeup 9.4
rich 9.3
letter 9.2
prophet 8.9
twenty 8.9
postal 8.8
sacred 8.8
design 8.7
prayer 8.7
artist 8.7
exchange 8.6
painted 8.6
post 8.6
commerce 8.4
investment 8.2
global 8.2
envelope 8.1
history 8
detail 8
decoration 7.9
stamps 7.9
printed 7.9
people 7.8
bills 7.8
head 7.6
pattern 7.5
color 7.2
market 7.1
interior 7.1
travel 7

Google
created on 2019-05-22

Text 85.2
Illustration 84.9
Art 84.4
Painting 81.3
Visual arts 73.1
Vintage clothing 72.5
Fiction 57

Microsoft
created on 2019-05-22

human face 95.3
indoor 92.9
painting 89.8
drawing 89.6
person 79
clothing 69.1
cartoon 60.9
old 48.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-38
Gender Male, 95.3%
Happy 1.8%
Sad 20.5%
Calm 40.6%
Disgusted 5.8%
Confused 13.3%
Angry 10.2%
Surprised 7.8%

AWS Rekognition

Age 26-43
Gender Female, 97.6%
Angry 13.4%
Confused 18.2%
Happy 12.9%
Calm 9.9%
Sad 8.5%
Disgusted 14.4%
Surprised 22.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Painting 66.7%

Categories

Imagga

paintings art 99.5%

Captions

Microsoft
created on 2019-05-22

a person lying on a rug 40.6%