Human Generated Data

Title

A Peasant Family Going to Market
Date

18th century
People

Artist: Thomas Gainsborough, British 1727 - 1788
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.707

Human Generated Data

Title

A Peasant Family Going to Market

People

Artist: Thomas Gainsborough, British 1727 - 1788

Date

18th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.707

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Human 93.2
Person 93.2
Person 91.6
Person 90.7
Art 90.5
Painting 90.4
Mammal 86
Horse 86
Animal 86
Canine 60.6
Dog 60.6
Pet 60.6

Clarifai
created on 2020-05-02

art 99.8
print 99.8
people 99.7
illustration 99.5
engraving 99.2
group 98.8
cavalry 98.3
painting 98.1
mammal 97.5
Renaissance 95.8
man 94.3
adult 93.6
baroque 93.1
antique 91.9
wear 89.7
vintage 88.8
etching 88.2
three 84.4
visuals 84.3
lithograph 84.1

Imagga
created on 2020-05-02

brass 56.9
television 51.6
memorial 49.7
telecommunication system 37.2
structure 34.9
money 28.1
monitor 27.9
cash 26.5
currency 26
tray 24.9
vintage 23.1
finance 21.1
old 20.9
financial 20.5
dollar 20.4
receptacle 20.1
dollars 19.3
banking 18.4
letter 18.3
business 18.2
postmark 17.7
postage 17.7
screen 17.5
stamp 17.4
art 17.3
mail 17.2
one 17.2
close 17.1
bill 17.1
bank 17
postal 16.7
wealth 16.2
envelope 15.6
symbol 15.5
us 15.4
savings 14.9
container 14.2
paper 14.1
retro 13.1
rich 13
shows 12.8
printed 12.8
global 12.8
banknotes 12.7
black 12.6
post 12.4
ancient 12.1
circa 11.8
hundred 11.6
states 11.6
pay 11.5
exchange 11.5
united 11.4
sculpture 11.2
economy 11.1
culture 11.1
masterpiece 10.9
aged 10.9
funds 10.8
closeup 10.8
banknote 10.7
communications 10.5
profit 10.5
background 10.3
investment 10.1
known 9.9
paintings 9.8
bills 9.7
museum 9.7
office 9.6
loan 9.6
painted 9.5
display 9.5
unique 9.5
painter 9
post mail 8.9
zigzag 8.9
fame 8.9
renaissance 8.8
delivery 8.7
man 8.7
icon 8.7
cutting 8.7
antique 8.7
notes 8.6
fine 8.6
capital 8.5
grunge 8.5
church 8.3
person 8.3
note 8.3
message 8.2
religion 8.1
market 8
philately 7.9
stamps 7.9
design 7.9
finances 7.7
card 7.6
frame 7.5
carving 7.4
people 7.2
color 7.2
history 7.1
concepts 7.1
face 7.1
male 7.1

Google
created on 2020-05-02

Painting 95
Art 85.3
Picture frame 79.9
Stock photography 74.1
Illustration 73.2
Drawing 63.2
Visual arts 59.3
Artwork 58

Microsoft
created on 2020-05-02

sketch 99.6
drawing 99.5
text 99.4
book 94.1
window 92.1
painting 90.7
horse 90
old 86.2
cartoon 83.1
animal 74.2
person 71.6
mammal 68.3
illustration 65.9
black 65.7
child art 64.5
picture frame 20.8

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 12-22
Gender Male, 54.3%
Sad 45%
Angry 45%
Disgusted 45%
Calm 54.9%
Fear 45%
Happy 45.1%
Confused 45%
Surprised 45%

AWS Rekognition

Age 19-31
Gender Male, 54.4%
Happy 45.5%
Angry 45.1%
Surprised 45%
Confused 45.1%
Calm 53.9%
Sad 45.4%
Disgusted 45%
Fear 45%

AWS Rekognition

Age 21-33
Gender Male, 54.6%
Disgusted 45%
Fear 45.3%
Happy 45%
Calm 53.7%
Sad 45.1%
Angry 45.5%
Confused 45.1%
Surprised 45.4%

AWS Rekognition

Age 2-8
Gender Male, 54.9%
Fear 45%
Happy 45.3%
Sad 45.2%
Angry 46.9%
Surprised 45%
Confused 45.1%
Calm 52.4%
Disgusted 45%

AWS Rekognition

Age 39-57
Gender Male, 50.2%
Sad 51.7%
Angry 45.8%
Happy 46%
Calm 46%
Disgusted 45.1%
Fear 45.2%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 40-58
Gender Male, 50.2%
Sad 47%
Confused 45%
Happy 45%
Angry 45.5%
Surprised 45%
Calm 52.3%
Fear 45%
Disgusted 45.1%

Microsoft Cognitive Services

Age 21
Gender Female

Feature analysis

Amazon

Person 93.2%
Painting 90.4%
Horse 86%
Dog 60.6%

Captions

Microsoft
created on 2020-05-02

a vintage photo of a person 70%
a vintage photo of a book 45.3%
a vintage photo of a person 45.2%

Text analysis

Amazon

FAMILY
GYPSY
A GYPSY FAMILY
GAINSBOROUOH
A
THOMAS GAINSBOROUOH
THOMAS

Google

A GYPSY FAMILY THOMAS GAINSBOROUGH
A
GYPSY
FAMILY
THOMAS
GAINSBOROUGH