Human Generated Data

Title

Family Concert
Date

17th century
People

Artist: Schelte Adams à Bolswert, Flemish c. 1586 - 1659

Artist after: Jacques Jordaens, Flemish 1593 - 1678
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2238

Human Generated Data

Title

Family Concert

People

Artist: Schelte Adams à Bolswert, Flemish c. 1586 - 1659

Artist after: Jacques Jordaens, Flemish 1593 - 1678

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Art 97.6
Painting 97.6
Human 97.5
Person 97.5
Person 97.3
Person 96.2
Person 95.4
Person 93.1
Person 91.6
Archaeology 61.3
Photography 60.1
Photo 60.1
Face 57.4
Portrait 57.4

Clarifai
created on 2019-11-16

people 99.8
art 99.4
print 98.7
illustration 98.2
man 97.7
group 97.5
adult 97.3
engraving 95.9
Renaissance 95
furniture 93.7
painting 93.4
portrait 92.3
one 90.6
two 90
baby 89.1
woman 88.8
leader 88.6
book bindings 87.6
lithograph 87.6
old 86.5

Imagga
created on 2019-11-16

sketch 48.2
money 47.7
cash 45.8
currency 44
dollar 40
finance 37.2
drawing 35.7
bank 33.2
representation 32.4
banking 32.2
dollars 31.9
bill 30.5
financial 30.3
wealth 28.8
paper 28.3
sculpture 26.4
hundred 26.2
business 26.2
savings 25.2
us 24.1
carving 23.3
rich 22.4
loan 22.1
exchange 22
bills 21.4
art 21.2
banknotes 20.6
pay 20.2
memorial 18.1
brass 18
investment 17.4
finances 17.4
ancient 17.3
one 17.2
close 17.1
economy 16.7
history 16.1
franklin 15.8
architecture 15.7
statue 15.5
religion 15.3
note 14.7
old 14.6
temple 14.6
structure 14.6
profit 14.4
capital 14.3
market 14.2
banknote 13.6
states 13.5
culture 12.8
funds 12.8
economic 12.6
stone 11.6
payment 11.6
god 11.5
commerce 11.2
figure 10.9
closeup 10.8
debt 10.6
notes 10.6
newspaper 10.5
united 10.5
religious 10.3
creation 10
treasury 9.8
monetary 9.8
comic book 9.5
historical 9.4
vintage 9.1
sign 9
antique 9
success 8.9
twenty 8.9
carved 8.8
legal 8.8
wealthy 8.8
paying 8.8
price 8.7
spirituality 8.7
product 8.6
monument 8.4
decoration 8.3
historic 8.3
symbol 8.1
concepts 8
greenback 7.9
salary 7.9
wages 7.9
income 7.8
dough 7.8
value 7.8
change 7.7
sales 7.7
save 7.6
stock 7.5
famous 7.5
church 7.4
detail 7.2
face 7.1
travel 7.1

Google
created on 2019-11-16

Painting 88.7
Art 87.6
Illustration 74.4
Stock photography 70.9
Visual arts 69.9
Picture frame 66.9
Antique 65.6
History 62.6
Collection 52.1

Microsoft
created on 2019-11-16

text 100
book 100
person 96.1
clothing 93.7
drawing 92.1
sketch 83.4
old 80.2
human face 77
painting 76.8
man 70.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 97.7%
Sad 3.8%
Surprised 25.8%
Confused 4.9%
Angry 1.5%
Calm 51.5%
Fear 4.8%
Happy 6.8%
Disgusted 0.8%

AWS Rekognition

Age 1-7
Gender Female, 51.4%
Fear 45%
Calm 54.5%
Disgusted 45%
Angry 45.1%
Surprised 45%
Happy 45%
Sad 45.4%
Confused 45%

AWS Rekognition

Age 5-15
Gender Male, 55%
Disgusted 45%
Angry 45%
Calm 55%
Surprised 45%
Sad 45%
Confused 45%
Fear 45%
Happy 45%

AWS Rekognition

Age 51-69
Gender Male, 92.7%
Calm 10.9%
Surprised 29.1%
Happy 0.8%
Sad 7.5%
Confused 1.9%
Angry 35.2%
Fear 14%
Disgusted 0.7%

AWS Rekognition

Age 37-55
Gender Male, 90.7%
Angry 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Sad 0.8%
Happy 0%
Calm 99%
Fear 0%

AWS Rekognition

Age 49-67
Gender Male, 97.1%
Calm 17.9%
Surprised 16.6%
Happy 0.6%
Sad 1.7%
Confused 1%
Angry 43.6%
Fear 18.2%
Disgusted 0.5%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.6%
Person 97.5%

Captions

Microsoft

a vintage photo of a book 69.8%
a vintage photo of a person holding a book 58.1%
an old photo of a book 58%

Text analysis

Amazon

De
Cantant
Soo
Senibus
ore
Zenris
Bene
Songen
Artem,
Tubis
Hec
freguenter,
Si
Cauta
Longen.
D'
ekinxit
maiores
Hoe
bis
onusg
Pepen
Soo D' ouie Songen So Pepen De Longen.
foret
Owod Cantant pahule maiores ore freguenter, Faig eneert Hec Bene ekinxit Zenris Jueerauerat Artem,
Hoe REonane Jubis Cauta Tuventuafroet Si foret bis Senibus ota, onusg Tubis
Jubis
Jueerauerat
REonane
eneert
pahule
ota,
ouie
So
Tuventuafroet
Faig
Owod
Torlis
emi

Google

errat
Si
fored
Cantant
Refonare
Cut
fet
S
D'ouee
Songen
Pepen
De
amusg
Ouo
Tay
ore
T
innt
et
Zei
frtem,
freguenter
He
uea
Baere
fae
Soo D'ouee Songen Soo Pepen De dongen. He Bene a Zei errat frtem, Si fored bus Sebus amusg Tas Ouo Cantant eatle freguenter He Refonare Trabins Cut uea fet Tay mores ore T londes innt et p S Baere fae
Soo
dongen.
bus
Sebus
eatle
p
Bene
a
Tas
Trabins
mores
londes