Human Generated Data

Title

Mrs. Henry Clay Frick and Children, Pittsburgh

Date

1990, printed 2013

People

Artist: Nathan Benn, American born 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Nathan Benn, 2018.179

Copyright

© Nathan Benn

Human Generated Data

Title

Mrs. Henry Clay Frick and Children, Pittsburgh

People

Artist: Nathan Benn, American born 1950

Date

1990, printed 2013

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Human 99.2
Person 99.2
Person 99.2
Art 98.8
Painting 98.8
Person 96.3
Person 91.5
Person 70.5
Photo 55.3
Photography 55.3

Clarifai
created on 2019-07-20

painting 99.4
museum 99.3
picture frame 98.8
baroque 98.7
people 98.3
exhibition 98.1
furniture 97.5
art 97.4
mirror 96.4
decoration 96.4
gold 95.1
ornate 93.2
portrait 92.5
luxury 91.7
family 91.1
room 90.9
two 90.8
indoors 89.4
woman 89
wood 86.7

Imagga
created on 2019-07-20

antique 44.1
religion 34.9
art 31
altar 29.8
religious 29
old 28.5
gold 27.1
church 25.9
music box 22.9
vintage 22.3
ancient 21.6
antiquity 20.7
structure 19.8
culture 19.6
temple 19.3
frame 19.2
musical instrument 18.9
history 17.9
palanquin 17.3
god 17.2
architecture 17.2
travel 16.9
interior 16.8
device 16.7
historic 16.5
golden 15.5
building 14.4
faith 14.3
statue 14.2
wood 14.2
litter 13.8
design 13.5
saint 13.4
style 13.3
icon 12.7
landmark 12.6
prayer 12.5
holy 12.5
decoration 12.5
sculpture 12.4
retro 12.3
museum 12.3
east 12.1
pray 11.6
worship 11.6
tourism 11.5
cathedral 11.5
spirituality 11.5
historical 11.3
ornate 11
entrance 10.6
wall 10.5
conveyance 10.3
luxury 10.3
monument 10.3
case 10
painting 9.9
oriental 9.9
belief 9.7
texture 9.7
detail 9.6
black 9.6
fine 9.5
door 9.5
ornament 9.5
symbol 9.4
face 9.2
television 9.1
portrait 9
furniture 9
catholic 9
painter 8.8
paintings 8.8
window 8.7
spiritual 8.6
decorative 8.3
city 8.3
pattern 8.2
chest 8.2
aged 8.1
border 8.1
box 8
home 8
decor 7.9
masterpiece 7.9
framework 7.9
renaissance 7.8
carving 7.8
bible 7.8
sacred 7.8
gate 7.8
royal 7.7
blank 7.7
container 7.7
painted 7.6
unique 7.6
traditional 7.5
one 7.5
classic 7.4
wooden 7

Google
created on 2019-07-20

Picture frame 97
Photograph 96.7
Visual arts 73.1
Room 71.4
Antique 69.5
Interior design 68.4
Rectangle 65.2
Photography 62.4
Ornament 60.4
Art 58.1
Square 50.6

Microsoft
created on 2019-07-20

wall 99.4
indoor 97.6
art 85.1
museum 84.1
human face 83.2
person 80.4
baby 80.4
clothing 61.5
toddler 57.1
picture frame 38
decorated 30.9
painting 30.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.4%
Calm 86.4%
Disgusted 0.8%
Confused 4%
Happy 0.2%
Angry 4.3%
Surprised 1.4%
Sad 3%

AWS Rekognition

Age 4-9
Gender Female, 97.1%
Disgusted 0.3%
Surprised 0.7%
Angry 0.9%
Calm 95.6%
Confused 0.9%
Happy 0.4%
Sad 1.1%

AWS Rekognition

Age 2-5
Gender Male, 76.3%
Surprised 0.9%
Disgusted 1.2%
Happy 1.7%
Calm 82.3%
Confused 2%
Angry 2%
Sad 10%

AWS Rekognition

Age 4-9
Gender Female, 99.7%
Disgusted 0.2%
Sad 1.3%
Happy 0.6%
Confused 4.4%
Angry 1.3%
Surprised 0.7%
Calm 91.5%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 98.8%

Captions

Microsoft

a painting in a frame hanging on a wall 76.2%
a painting hanging on a wall 76.1%
a painting of a person 69.1%

Text analysis

Google

\29
\29