Human Generated Data

Title

Untitled (couple, seated, half-length, front view)
Date

c 1856-c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.25

Human Generated Data

Title

Untitled (couple, seated, half-length, front view)

People

Artist: Unidentified Artist,

Date

c 1856-c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.25

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Person 99.4
Human 99.4
Painting 99.4
Art 99.4
Person 98.6
Portrait 70.5
Photo 70.5
Face 70.5
Photography 70.5

Clarifai
created on 2019-11-05

people 99.9
print 98.9
adult 98.6
painting 98
two 97.6
portrait 97.5
art 97.3
woman 97.3
wear 96.3
group 94.8
man 93.7
retro 93.7
monarch 93.3
one 93.3
illustration 92.5
royalty 90
vintage 89
music 87.2
leader 85.4
seat 83.7

Imagga
created on 2019-11-05

art 39
book jacket 33.2
prayer rug 33
religion 30.5
antique 30
old 29.9
covering 28.4
church 27.7
rug 26.3
jacket 26
vintage 25.6
culture 23.1
religious 22.5
furnishing 22.4
frame 21.7
gold 21.4
floor cover 19.9
ancient 19.9
architecture 19.6
wrapping 19.6
decoration 18.8
interior 18.6
history 17.9
icon 17.4
historic 17.4
retro 17.2
museum 17.1
design 16.9
postage 16.7
letter 16.5
stamp 16.4
holy 16.4
postmark 15.8
paintings 15.6
symbol 15.5
prayer 15.4
saint 15.4
mail 15.3
post 15.3
historical 15
postal 14.7
envelope 14.6
golden 14.6
spiritual 14.4
faith 14.3
travel 14.1
painter 14
masterpiece 13.8
detail 13.7
one 13.4
temple 13.4
painted 13.3
fine 13.3
sculpture 13.1
known 12.8
ornate 12.8
sacred 12.7
style 12.6
unique 12.3
post mail 11.9
zigzag 11.9
fame 11.8
shows 11.8
printed 11.8
renaissance 11.8
window 11.7
decorative 11.7
belief 11.7
delivery 11.7
pattern 11.6
cutting 11.6
spirituality 11.5
communications 11.5
god 11.5
office 11.2
global 10.9
landmark 10.8
tourism 10.7
catholic 10.7
building 10.6
cathedral 10.5
door 10.5
portrait 10.3
monument 10.3
furniture 10.1
bible 9.8
pray 9.7
black 9.6
statue 9.5
carving 9.5
famous 9.3
face 9.2
elegance 9.2
stamps 8.9
wall 8.8
artist 8.7
luxury 8.6
stone 8.4
bookend 8.3
color 8.3
wood 8.3
closeup 8.1
colorful 7.9
paper 7.8
altar 7.8
letters 7.7
worship 7.7
texture 7.6
structure 7.5
home 7.3
throne 7.3
aged 7.2
border 7.2
support 7.2
currency 7.2
palace 7.2
chair 7

Google
created on 2019-11-05

Picture frame 97
Photograph 95.3
Painting 80.6
Antique 75.2
Portrait 69.7
Art 65.5
Visual arts 55
Interior design 54.4

Microsoft
created on 2019-11-05

clothing 97.4
person 96.9
wall 95.8
human face 94.5
indoor 93.4
woman 92.4
old 89.2
picture frame 81.1
victorian 72
painting 64.6
decorated 29.9
older 20.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 84.9%
Disgusted 0.3%
Confused 1%
Happy 0.3%
Angry 4.6%
Calm 93.2%
Fear 0%
Surprised 0.4%
Sad 0.3%

AWS Rekognition

Age 22-34
Gender Female, 70.2%
Happy 0.1%
Disgusted 0.1%
Calm 73.3%
Sad 3.4%
Surprised 0.2%
Angry 22.1%
Confused 0.3%
Fear 0.6%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 99.4%

Categories

Imagga

people portraits 59.9%
events parties 32.1%
paintings art 5.4%

Captions

Microsoft
created on 2019-11-05

a painting of a person 90.9%
a painting of a person 84.3%
a painting in an old photo of a person 74%

Text analysis

Amazon

L

Google

ANEE
ANEE