Human Generated Data

Title

The Bad Rich Man

Date

18th century

People

Artist: Marie Catherine Riollet Beauvarlet, 1755 - 1788

Artist after: David Teniers II, Flemish 1610 - 1690

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3323

Human Generated Data

Title

The Bad Rich Man

People

Artist: Marie Catherine Riollet Beauvarlet, 1755 - 1788

Artist after: David Teniers II, Flemish 1610 - 1690

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.1
Person 99.1
Painting 98.8
Art 98.8
Person 98.5
Person 96
Person 93.5
People 89.6
Person 63.3
Female 62.4
Leisure Activities 61.2
Family 59.4
Girl 57
Person 53.1

Imagga
created on 2022-03-05

kin 50.3
mother 47.5
parent 32.9
newspaper 30.9
man 28.2
home 26.3
people 26.2
male 25.6
happy 24.4
sitting 24
product 23.4
person 22.6
couple 21.8
adult 20.6
lifestyle 20.2
family 19.6
portrait 19.4
couch 18.3
creation 18.1
happiness 18
indoors 17.6
smiling 16.6
love 16.6
aged 16.3
together 15.8
room 15.7
old 14.6
women 14.2
senior 14.1
smile 13.5
elderly 13.4
child 13.3
togetherness 13.2
cheerful 13
indoor 12.8
outdoors 12.7
day 12.5
looking 12
casual 11.9
retired 11.6
daughter 11.6
cute 11.5
chair 11.4
boy 11.3
mature 11.2
relaxing 10.9
lady 10.5
attractive 10.5
color 10
pensioner 9.8
fun 9.7
father 9.6
living 9.5
face 9.2
laptop 9.1
pretty 9.1
park 9.1
handsome 8.9
interior 8.8
computer 8.8
bench 8.8
seated 8.8
older 8.7
affection 8.7
sofa 8.6
two 8.5
clothing 8.4
joy 8.3
leisure 8.3
fashion 8.3
playing 8.2
patient 8
romance 8
model 7.8
husband 7.6
loving 7.6
age 7.6
enjoying 7.6
relaxed 7.5
relationship 7.5
care 7.4
glasses 7.4
teen 7.3
grandfather 7.3
teenager 7.3
children 7.3
kid 7.1

Google
created on 2022-03-05

Dress 89.3
Chair 86.3
Art 85.4
Picture frame 82.2
Painting 81.8
Table 81.7
Vintage clothing 73.9
Illustration 72.8
Drawing 70.9
Visual arts 70.6
Poster 69
Room 68.5
History 67.9
Event 66
Classic 64.8
Sitting 64.6
Curtain 62.9
Stock photography 62.3
Artwork 57
Antique 55.5

Microsoft
created on 2022-03-05

person 95.9
clothing 93.6
text 93.1
old 77.3
black 65.2
white 63.4
child 56.5
photograph 54.9
woman 51.5
vintage 49.9

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 99.9%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 12-20
Gender Female, 99.8%
Calm 99.8%
Disgusted 0.1%
Happy 0%
Confused 0%
Sad 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Female, 99.6%
Calm 73.2%
Sad 8.7%
Fear 5.7%
Surprised 5.6%
Happy 2.6%
Confused 1.6%
Angry 1.3%
Disgusted 1.2%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Sad 53.9%
Calm 24.7%
Angry 10.8%
Happy 3.5%
Confused 2.5%
Fear 1.7%
Disgusted 1.6%
Surprised 1.5%

AWS Rekognition

Age 20-28
Gender Male, 78%
Calm 99.1%
Sad 0.4%
Fear 0.2%
Happy 0.1%
Disgusted 0.1%
Confused 0%
Surprised 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 98.8%

Captions

Microsoft

a vintage photo of a group of people in a room 96%
a vintage photo of some people in a room 95.9%
a vintage photo of a group of people sitting in a room 93%

Text analysis

Amazon

Tableau
original
Teniers
de
le
par
LE
MAUVAIS
David
d'apres
Gravé
LE MAUVAIS RICHE.
C.Riollet
Gravé d'apres le Tableau original de David Teniers par Mella C.Riollet
RICHE.
Mella
m
Parade m o -
o
in
Jon in
Parade
-
Jon

Google

LE MAUVAIS RICIHE. Gravé dapres le Tableau original de David Temers par M GRiollet P er amrarle nan peer kamd
MAUVAIS
GRiollet
le
David
Temers
par
LE
original
peer
RICIHE.
de
M
P
er
nan
kamd
Gravé
dapres
Tableau
amrarle