Human Generated Data

Title

Tobias and the Angel
Date

17th century
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Christopher H. Phillips, Class of 1943, 1997.120

Human Generated Data

Title

Tobias and the Angel

People

Artist: Unidentified Artist,

Date

17th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Painting 98.6
Art 98.6
Human 90.6
Person 90.6
Person 89.9
Person 51.6

Clarifai
created on 2020-04-24

people 99.2
vehicle 98.5
art 98.4
tree 96.7
group 96.5
print 96.2
painting 95.5
landscape 93.6
illustration 93.1
transportation system 89
no person 87.6
adult 86.7
recreation 84.6
mountain 83.7
movie 80.9
home 80.3
wear 79.6
cavalry 79.6
river 77.7
man 77.6

Imagga
created on 2020-04-24

fountain 100
structure 100
landscape 24.5
travel 23.2
stone 21.2
water 18.7
architecture 18
old 17.4
history 17
forest 16.5
tourism 15.7
outdoor 15.3
tree 15.3
art 14.3
city 14.1
park 14
black 13.8
grunge 13.6
sky 13.4
vintage 13.2
culture 12.8
building 12.7
river 12.5
light 12
ancient 11.2
texture 11.1
memorial 11.1
rock 10.4
summer 10.3
monument 10.3
season 10.1
dark 10
ocean 10
landmark 9.9
antique 9.5
snow 9.4
natural 9.4
fall 9
color 8.9
trees 8.9
scenic 8.8
sculpture 8.7
grave 8.5
frame 8.3
environment 8.2
retro 8.2
dirty 8.1
scenery 8.1
mountain 8
colorful 7.9
day 7.8
sea 7.8
scene 7.8
cold 7.7
fog 7.7
grungy 7.6
traditional 7.5
famous 7.4
man 7.4
lake 7.3
sun 7.2
religion 7.2
autumn 7
textured 7
seasonal 7

Google
created on 2020-04-24

Painting 96.5
Picture frame 89.3
Art 81.1
Stock photography 73.1
Visual arts 71.1
Photography 67.8
Still life photography 61.6
Still life 60.2
Landscape 59.3
Artwork 58.6
Black-and-white 56.4

Microsoft
created on 2020-04-24

text 98.6
drawing 96.6
sketch 91.4
window 80.4
old 74.8
tree 72.9
picture frame 44.4
painting 18.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 28-44
Gender Male, 50%
Angry 49.5%
Disgusted 49.5%
Calm 49.9%
Surprised 49.5%
Sad 49.7%
Fear 49.6%
Happy 49.7%
Confused 49.5%

AWS Rekognition

Age 11-21
Gender Male, 50.5%
Calm 49.5%
Disgusted 49.6%
Sad 50.2%
Surprised 49.5%
Confused 49.6%
Angry 49.5%
Fear 49.5%
Happy 49.5%

Feature analysis

Amazon

Painting 98.6%
Person 90.6%

Captions

Microsoft

an old photo of a train window 39.3%
a painting of a train window 32.3%