Human Generated Data

Title

Saint Stephen
Date

1600-1650
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Thomas Whittemore, 1951.31.20.A

Human Generated Data

Title

Saint Stephen

People

Artist: Unidentified Artist,

Date

1600-1650

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Thomas Whittemore, 1951.31.20.A

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 95.3
Person 95.3
Art 89.3
Wall 77.8
Worship 77
Drawing 72.2
Architecture 63.6
Building 63.6
Shrine 62.9
Temple 62.9
Face 61.2
Painting 57.2

Clarifai
created on 2020-04-24

old 98.7
retro 98.3
people 97.8
one 97.4
antique 97
art 94.3
wear 93.9
vintage 93.9
wood 90.8
man 89.4
ancient 88.7
dirty 87.9
street 86.3
portrait 83
monochrome 82.1
door 79.4
child 77.3
wall 77
adult 76.7
no person 75.9

Imagga
created on 2020-04-24

statue 38.4
sculpture 32.5
architecture 27.5
old 27.2
ancient 23.4
building 22.5
stone 21.8
antique 17.3
history 16.1
art 15.9
monument 15.9
historical 15.1
support 14.9
stucco 14.7
historic 14.7
religion 14.3
structure 14.2
wall 13.8
marble 13.7
device 13.1
city 12.5
travel 12
cemetery 11.6
vintage 11.6
god 11.5
detail 11.3
religious 11.2
landmark 10.8
tourism 10.7
catholic 10.7
door 10.5
column 10.4
culture 10.3
famous 10.2
house 10.2
aged 10
carving 9.9
palace 9.8
fountain 9.6
fence 9.5
mother 9.3
arch 9.3
black 9
decoration 9
temple 8.9
sill 8.9
style 8.9
entrance 8.7
grunge 8.5
church 8.3
dirty 8.1
window 8.1
memorial 7.9
facade 7.8
structural member 7.5
man 7.4
pedestal 7.3
people 7.3
home 7.2

Google
created on 2020-04-24

Standing 80.9
History 75.2
Art 74.8
Stock photography 69.2
Temple 65.5
Visual arts 64.9
Photography 62.4
Statue 60.6
Black-and-white 56.4
Middle ages 54.4
Style 51

Microsoft
created on 2020-04-24

drawing 99.7
sketch 99.6
painting 92.6
art 92.2
text 88.8
black and white 86.1
child art 83.2
cartoon 81.9
human face 59.6
person 53.7
old 40.3

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-35
Gender Female, 61.1%
Happy 0.1%
Surprised 67.7%
Sad 0.4%
Calm 0.4%
Fear 29.1%
Angry 1.1%
Disgusted 0.1%
Confused 1.1%

Microsoft Cognitive Services

Age 10
Gender Male

Feature analysis

Amazon

Person 95.3%

Categories

Imagga

streetview architecture 93.7%
nature landscape 4.4%
paintings art 1.9%

Captions

Microsoft
created on 2020-04-24

an old photo of a person 78.9%
a black and white photo of a person 69.2%
old photo of a person 69.1%

Text analysis

Amazon

D