Human Generated Data

Title

Peasants in a Tavern

Date

18th-19th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. and Mrs. Samuel B. Grimson, 1968.67

Human Generated Data

Title

Peasants in a Tavern

People

Artist: Unidentified Artist,

Date

18th-19th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. and Mrs. Samuel B. Grimson, 1968.67

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 99
Person 99
Person 98.5
Person 98.1
Art 97.3
Person 94.4
Painting 94.2
Person 93.6

Clarifai
created on 2020-04-24

people 100
adult 99.1
group 99.1
two 98.5
art 98
man 96.5
woman 96.2
gown (clothing) 94
three 92.6
child 91.8
sit 90.4
furniture 88
four 86.6
print 86.3
religion 85.1
several 84.3
wear 82.4
veil 82.3
elderly 82
seat 79.8

Imagga
created on 2020-04-24

statue 31.7
old 27.2
sculpture 26.4
architecture 24.2
religion 24.2
ancient 22.5
history 19.7
religious 19.7
monument 18.7
stone 17.9
art 16.5
god 16.3
culture 16.2
building 16
cell 15.9
temple 15.3
antique 14.7
historical 14.1
travel 14.1
historic 12.8
vintage 12.4
city 11.6
kin 11.5
mother 11.5
world 11.3
child 11.3
famous 11.2
device 10.7
pray 10.7
marble 10.7
people 10.6
tourism 9.9
catholic 9.8
holy 9.6
spiritual 9.6
scene 9.5
decoration 9.5
man 9.4
peace 9.1
landmark 9
prayer 8.7
male 8.6
grunge 8.5
carving 8.5
house 8.4
guillotine 8.3
church 8.3
traditional 8.3
tourist 8.2
symbol 8.1
washboard 7.8
sepia 7.8
spirituality 7.7
monk 7.6
classic 7.4
detail 7.2

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 91.5
person 91
clothing 90.7
painting 86.5
drawing 86.5
building 80.4
sketch 79.8
old 61.1
woman 51.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 34-50
Gender Male, 54.7%
Sad 45%
Surprised 45.1%
Happy 45.4%
Fear 45%
Angry 45.1%
Confused 45%
Disgusted 45.1%
Calm 54.3%

AWS Rekognition

Age 13-23
Gender Male, 54.7%
Calm 46.2%
Sad 45%
Fear 45%
Happy 53.6%
Disgusted 45%
Surprised 45.1%
Confused 45%
Angry 45%

AWS Rekognition

Age 15-27
Gender Female, 50.2%
Angry 45.1%
Fear 45.1%
Calm 49.5%
Sad 45.3%
Happy 50%
Confused 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 26-40
Gender Male, 53.8%
Angry 45.5%
Happy 45%
Disgusted 45.1%
Surprised 45.2%
Fear 45%
Sad 45.4%
Confused 45.2%
Calm 53.6%

AWS Rekognition

Age 17-29
Gender Male, 54.7%
Surprised 45.2%
Confused 45.1%
Sad 45.6%
Disgusted 45%
Happy 48.8%
Angry 45.1%
Calm 50.2%
Fear 45.1%

Feature analysis

Amazon

Person 99%
Painting 94.2%

Categories

Imagga

people portraits 70.2%
events parties 27.6%

Captions

Microsoft
created on 2020-04-24

an old photo of a person 83.8%
an old photo of a boy 62.6%
an old photo of a person 62.5%