Human Generated Data

Title

Conversation

Date

17th century

People

Artist: Cornelis Visscher, Dutch 1628/29 - 1658

Artist after: Adriaen van Ostade, Dutch 1610 - 1685

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R4759

Human Generated Data

Title

Conversation

People

Artist: Cornelis Visscher, Dutch 1628/29 - 1658

Artist after: Adriaen van Ostade, Dutch 1610 - 1685

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-08

Human 99.2
Person 99.2
Painting 98.7
Art 98.7
Person 98.5
Apparel 90.1
Hat 90.1
Clothing 90.1

Clarifai
created on 2019-08-08

people 100
print 98.4
adult 98.2
engraving 98.1
two 97.9
art 97.9
portrait 96.7
man 95.5
elderly 93.7
sit 90.2
one 89.3
seat 89
leader 88.6
woman 88.5
lid 87.6
veil 86.5
furniture 84.7
three 84.3
group 83.7
wear 83.6

Imagga
created on 2019-08-08

world 33
kin 27.9
child 23.9
people 19.5
mother 19.1
person 17.5
man 17.5
face 17
portrait 16.8
adult 16.8
statue 16.3
male 15.4
sculpture 14.6
religion 14.3
parent 14.3
old 13.9
love 13.4
family 13.3
happy 11.9
ancient 11.2
sitting 11.2
hair 11.1
brother 11.1
stone 11
architecture 10.9
lifestyle 10.8
outdoors 10.5
culture 10.3
head 10.1
lady 9.7
sepia 9.7
one 9.7
boy 9.6
smiling 9.4
happiness 9.4
religious 9.4
monument 9.3
art 9.2
alone 9.1
hand 9.1
black 9
human 9
history 8.9
home 8.8
sadness 8.8
dad 8.7
antique 8.7
cute 8.6
historical 8.5
attractive 8.4
life 8.4
relaxation 8.4
building 8.4
city 8.3
fashion 8.3
vintage 8.3
sibling 8
kid 8
father 8
interior 8
together 7.9
urban 7.9
men 7.7
spiritual 7.7
holding 7.4
historic 7.3
dress 7.2
looking 7.2
smile 7.1
summer 7.1
travel 7
model 7

Google
created on 2019-08-08

Microsoft
created on 2019-08-08

text 99.7
clothing 98
person 93.2
old 84.8
human face 84.2
drawing 82.7
hat 78.5
painting 63.6
sketch 57.4
man 51.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 95.3%
Surprised 1.2%
Sad 7.3%
Angry 2.5%
Confused 2.3%
Disgusted 1.1%
Happy 2.2%
Calm 83.5%

AWS Rekognition

Age 35-53
Gender Male, 97.9%
Angry 7%
Confused 14.4%
Sad 12.8%
Happy 2.7%
Surprised 3.1%
Calm 12.5%
Disgusted 47.4%

Microsoft Cognitive Services

Age 18
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 98.7%
Hat 90.1%

Captions

Microsoft

an old photo of a person 91.6%
an old photo of a person 91.5%
old photo of a person 89.7%

Text analysis

Amazon

forti.
Excudit
CUrjoelerfeetagua forii. forti.
CUrjoelerfeetagua forii.
Ontdoe
Dhsloner
-VRoolbu.s Dhsloner
-VRoolbu.s

Google

Excudit
Meolans
Pifeher
fecit
aexcud
forti.
(feler
agua
Meolans Pifeher Excudit nOpae pincit aexcud (feler fecit agua forti.
nOpae
pincit