Human Generated Data

Title

The Swing
Date

18th century
People

Artist: Unidentified Artist,

Previous attribution: Jean-Baptiste-Joseph Pater, French 1695 - 1736

Previous attribution: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1939.109

Human Generated Data

Title

The Swing

People

Artist: Unidentified Artist,

Previous attribution: Jean-Baptiste-Joseph Pater, French 1695 - 1736

Previous attribution: Unidentified Artist,

Date

18th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1939.109

Machine Generated Data

Tags

Amazon
created on 2019-07-30

Painting 99.8
Art 99.8
Person 89.8
Human 89.8
Person 88
Photo 59.3
Photography 59.3
Portrait 59.1
Face 59.1

Clarifai
created on 2019-07-30

painting 100
museum 100
art 99.9
exhibition 99.8
picture frame 99.6
people 99.6
baroque 98.6
portrait 98.2
veranda 97.3
woman 96.6
interior 96.2
Renaissance 96.1
baby 96.1
carve 95.8
painter 95.5
man 95.1
old 94.9
one 94.6
two 93.8
wall 93.6

Imagga
created on 2019-07-30

frame 46.2
vintage 45.5
art 43
book jacket 40.8
antique 38.3
old 38.3
gold 32.1
decoration 31.8
jacket 31.7
retro 30.3
covering 28.6
binding 27.2
ancient 26.8
museum 26.2
empty 24.9
wrapping 24.1
design 23.6
ornate 22.9
blank 22.3
prayer rug 22.1
border 21.7
paintings 21.5
grunge 21.3
decorative 20.9
painting 20.8
postage 20.6
golden 20.6
stamp 20.3
postmark 19.7
texture 19.4
letter 19.3
wall 19.2
mail 19.2
culture 18.8
postal 18.7
aged 18.1
rug 17.6
wood 17.5
post 17.2
style 17.1
envelope 16.7
religion 16.1
decor 15.9
pattern 15.7
mosaic 15.2
icon 15
interior 15
painter 14.7
painted 14.3
church 13.9
zigzag 13.8
masterpiece 13.8
printed 13.8
renaissance 13.8
gallery 13.8
delivery 13.6
cutting 13.5
communications 13.4
fine 13.4
furnishing 13.3
unique 13.3
floor cover 13.3
framework 13.3
wooden 13.2
amulet 13
post mail 12.9
fame 12.8
known 12.8
shows 12.8
symbol 12.8
global 12.8
deco 12.7
carved 12.7
black 12.6
paper 12.5
ornamental 12.3
wallpaper 12.2
ornament 12.1
office 12.1
stamps 11.8
gilded 11.8
portrait 11.6
carving 11.6
rustic 11.5
religious 11.2
one 11.2
space 10.9
exhibition 10.8
frames 10.8
baroque 10.7
artist 10.6
decorate 10.5
charm 10.3
object 10.3
classic 10.2
letters 9.7
saint 9.6
home 9.6
decorated 9.6
brown 9.6
closeup 9.4
photograph 9.4
historic 9.2
close 9.1
paint 9.1
history 8.9
circa 8.9
textured 8.8
god 8.6
old fashioned 8.6
sculpture 8.5
backdrop 8.2
square 8.1
device 8.1
canceled 7.9
temple 7.9
rectangle 7.8
obsolete 7.7
traditional 7.5
collection 7.2
architecture 7

Google
created on 2019-07-30

Painting 98.3
Picture frame 97.4
Lady 89.2
Art 86.9
Visual arts 79.3
Portrait 68.6
Stock photography 68.5
Antique 60.5
Modern art 60.1
Still life 51.2
Art gallery 51.1
Artwork 51.1

Microsoft
created on 2019-07-30

indoor 96
text 92.9
painting 91.2
museum 90
person 88.5
art 86.1
woman 82.6
drawing 69
clothing 53.4
picture frame 17.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 54.6%
Happy 45.3%
Surprised 45.3%
Angry 45.2%
Confused 45.3%
Disgusted 45.1%
Sad 47.3%
Calm 51.5%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Angry 45.1%
Disgusted 45%
Calm 53.5%
Surprised 45.1%
Confused 45.1%
Happy 45%
Sad 46.1%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 16
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.8%
Person 89.8%

Categories

Imagga

paintings art 58.6%
events parties 20.9%
text visuals 11.7%
streetview architecture 6.5%

Captions

Microsoft
created on 2019-07-30

a painting of a person 82.3%
a painting of a person 81.4%
a painting in a frame hanging on a wall 78%