Human Generated Data

Title

Untitled (post-mortem portrait of mother and dead child, bust-length, frontal view)
Date

1858
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3879

Human Generated Data

Title

Untitled (post-mortem portrait of mother and dead child, bust-length, frontal view)

People

Artist: Unidentified Artist,

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3879

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.2
Human 99.2
Painting 98.8
Art 98.8
Face 85
Clothing 79.1
Apparel 79.1
Female 75.4
Portrait 75.4
Photography 75.4
Photo 75.4
Girl 67.9
Sitting 56.4
Mirror 56.1
Kid 55
Child 55

Clarifai
created on 2023-10-28

picture frame 100
painting 99.9
baroque 99.7
art 99.7
ornate 99.5
victorian 99.4
margin 99.2
museum 99.1
gold 98.8
baby 98.4
antique 98.3
decoration 98.2
gilt 97.5
vintage 97.1
people 96.3
old 96
interior 95.2
portrait 95
exhibition 94.7
son 93.7

Imagga
created on 2022-01-29

prayer rug 79.6
rug 63.4
furnishing 55.3
antique 51.6
throne 49.1
floor cover 47.9
chair of state 39.3
old 39
art 38.5
covering 32.3
frame 31.5
gold 31.3
chair 31
vintage 28.1
religion 27.8
furniture 26.9
decoration 26.1
culture 25.6
ancient 24.2
golden 23.2
ornate 22.9
design 21.4
retro 21.3
architecture 20.3
seat 20.2
history 19.7
style 18.6
museum 18.4
historic 18.3
antiquity 18.2
religious 17.8
interior 16.8
decorative 16.7
church 16.7
aged 16.3
border 16.3
god 16.3
wood 15.9
temple 15.3
travel 14.8
ornament 14.7
prayer 14.5
painting 14.5
landmark 14.4
historical 14.1
empty 13.7
detail 13.7
pattern 13.7
sculpture 13.7
worship 13.5
tourism 13.2
blank 12.9
paintings 12.7
palace 12.6
stamp 12.6
texture 12.5
post 12.4
carving 12.3
monument 12.1
symbol 12.1
icon 11.9
postage 11.8
deco 11.7
carved 11.7
object 11.7
pray 11.6
spiritual 11.5
decor 11.5
mail 11.5
wall 11.3
letter 11
postmark 10.8
traditional 10.8
baroque 10.7
holy 10.6
spirituality 10.6
decorated 10.5
decorate 10.5
door 10.5
statue 10.5
ornamental 10.4
grunge 10.2
renaissance 9.8
postal 9.8
painter 9.8
wooden 9.7
building 9.7
wardrobe 9.6
home 9.6
faith 9.6
painted 9.5
luxury 9.4
famous 9.3
classic 9.3
elegance 9.2
close 9.1
portrait 9.1
framework 9
one 9
masterpiece 8.9
shows 8.9
printed 8.9
gallery 8.8
frames 8.8
envelope 8.8
sacred 8.8
delivery 8.8
cutting 8.7
fine 8.6
old fashioned 8.6
face 8.5
black 8.4
post mail 7.9
zigzag 7.9
fame 7.9
known 7.9
gilded 7.9
color 7.8
catholic 7.8
royal 7.7
saint 7.7
rustic 7.7
communications 7.7
unique 7.6
city 7.5
east 7.5
global 7.3
paint 7.2
paper 7.1
mosaic 7

Google
created on 2022-01-29

Cheek 97.9
Head 97.3
Chin 96.6
Picture frame 96.5
Hairstyle 95.1
Organ 90.2
Rectangle 86.3
Painting 85.2
Art 83.8
Vintage clothing 67.8
Visual arts 67.3
History 66.9
Baby 66.8
Stock photography 66
Oval 64.9
Antique 64.5
Interior design 62
Event 61.9
Illustration 60
Portrait 59

Microsoft
created on 2022-01-29

human face 97.8
person 96.4
baby 95.4
clothing 94.7
indoor 86.5
museum 78.2
smile 75.5
art 71.6
toddler 68.5
rug 61.1
painting 54.1
picture frame 51.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Female, 100%
Calm 91.7%
Angry 1.9%
Surprised 1.9%
Sad 1.5%
Confused 1.4%
Fear 0.8%
Disgusted 0.6%
Happy 0.2%

AWS Rekognition

Age 1-7
Gender Male, 92.2%
Calm 46.5%
Sad 33.1%
Confused 8.7%
Fear 4.9%
Surprised 2.8%
Angry 1.9%
Disgusted 1.3%
Happy 0.8%

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99.2%
Painting 98.8%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2022-01-29

a painting of a person 89.2%
a painting of a person 80.4%
a painting of a person sitting on a rug 76.5%