Human Generated Data

Title

Mrs. Henry Clay Frick and Children, Pittsburgh

Date

1990, printed 2013

People

Artist: Nathan Benn, American born 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Nathan Benn, 2018.179

Copyright

© Nathan Benn

Human Generated Data

Title

Mrs. Henry Clay Frick and Children, Pittsburgh

People

Artist: Nathan Benn, American born 1950

Date

1990, printed 2013

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Nathan Benn, 2018.179

Copyright

© Nathan Benn

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Person 99.2
Human 99.2
Person 99.2
Art 98.8
Painting 98.8
Person 96.3
Person 91.5
Person 70.5
Photo 55.3
Photography 55.3

Clarifai
created on 2019-07-20

painting 99.4
museum 99.3
picture frame 98.8
baroque 98.7
people 98.3
exhibition 98.1
furniture 97.5
art 97.4
mirror 96.4
decoration 96.4
gold 95.1
ornate 93.2
portrait 92.5
luxury 91.7
family 91.1
room 90.9
two 90.8
indoors 89.4
woman 89
wood 86.7

Imagga
created on 2019-07-20

antique 44.1
religion 34.9
art 31
altar 29.8
religious 29
old 28.5
gold 27.1
church 25.9
music box 22.9
vintage 22.3
ancient 21.6
antiquity 20.7
structure 19.8
culture 19.6
temple 19.3
frame 19.2
musical instrument 18.9
history 17.9
palanquin 17.3
god 17.2
architecture 17.2
travel 16.9
interior 16.8
device 16.7
historic 16.5
golden 15.5
building 14.4
faith 14.3
statue 14.2
wood 14.2
litter 13.8
design 13.5
saint 13.4
style 13.3
icon 12.7
landmark 12.6
prayer 12.5
holy 12.5
decoration 12.5
sculpture 12.4
retro 12.3
museum 12.3
east 12.1
pray 11.6
worship 11.6
tourism 11.5
cathedral 11.5
spirituality 11.5
historical 11.3
ornate 11
entrance 10.6
wall 10.5
conveyance 10.3
luxury 10.3
monument 10.3
case 10
painting 9.9
oriental 9.9
belief 9.7
texture 9.7
detail 9.6
black 9.6
fine 9.5
door 9.5
ornament 9.5
symbol 9.4
face 9.2
television 9.1
portrait 9
furniture 9
catholic 9
painter 8.8
paintings 8.8
window 8.7
spiritual 8.6
decorative 8.3
city 8.3
pattern 8.2
chest 8.2
aged 8.1
border 8.1
box 8
home 8
decor 7.9
masterpiece 7.9
framework 7.9
renaissance 7.8
carving 7.8
bible 7.8
sacred 7.8
gate 7.8
royal 7.7
blank 7.7
container 7.7
painted 7.6
unique 7.6
traditional 7.5
one 7.5
classic 7.4
wooden 7

Google
created on 2019-07-20

Picture frame 97
Photograph 96.7
Visual arts 73.1
Room 71.4
Antique 69.5
Interior design 68.4
Rectangle 65.2
Photography 62.4
Ornament 60.4
Art 58.1
Square 50.6

Microsoft
created on 2019-07-20

wall 99.4
indoor 97.6
art 85.1
museum 84.1
human face 83.2
person 80.4
baby 80.4
clothing 61.5
toddler 57.1
picture frame 38
decorated 30.9
painting 30.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.4%
Calm 86.4%
Disgusted 0.8%
Confused 4%
Happy 0.2%
Angry 4.3%
Surprised 1.4%
Sad 3%

AWS Rekognition

Age 4-9
Gender Female, 97.1%
Disgusted 0.3%
Surprised 0.7%
Angry 0.9%
Calm 95.6%
Confused 0.9%
Happy 0.4%
Sad 1.1%

AWS Rekognition

Age 2-5
Gender Male, 76.3%
Surprised 0.9%
Disgusted 1.2%
Happy 1.7%
Calm 82.3%
Confused 2%
Angry 2%
Sad 10%

AWS Rekognition

Age 4-9
Gender Female, 99.7%
Disgusted 0.2%
Sad 1.3%
Happy 0.6%
Confused 4.4%
Angry 1.3%
Surprised 0.7%
Calm 91.5%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 98.8%

Captions

Azure OpenAI

Created by gpt-4 on 2024-11-16

The image shows a framed picture within an ornate gold-colored frame. The frame has intricate floral patterns and rococo style swirls. The picture within the frame appears to be a classical style painting of two children, with a pastel background that hints at an interior space. The child on the right side of the painting seems to be wearing a pink dress with a white collar, while the left shows a figure in a dark attire with light-toned details. The painting captures a moment of gentle interaction, and the color palette is soft and warm, giving the image a tender and nostalgic feeling. The frame itself adds to the sense of grandeur and artistic value of the displayed artwork.

Anthropic Claude

Created on 2024-11-14

The image shows a portrait of a woman and three children in an ornate, gilded frame. The woman is sitting and holding a young child, while two older children stand beside her. The children appear to be dressed in formal attire, suggesting this is a family portrait. The frame is highly decorated with intricate carvings and designs, typical of a vintage or antique frame style.

Meta Llama

Created on 2024-11-21

The image depicts a framed painting of a woman and three children, likely a family portrait. The woman is dressed in a black dress with her hair pulled back, while the children are dressed in formal attire. The boy on the left wears a dark blue velvet jacket with a white collar, the girl in the middle is dressed in a white dress, and the girl on the right wears a pink and green dress. The background of the painting is a light-colored wall with a floral pattern, and the frame is gold and ornate. The overall atmosphere of the image suggests a sense of elegance and sophistication, with the formal clothing and the ornate frame contributing to a feeling of luxury and refinement. The painting appears to be a high-quality work of art, with attention to detail and a sense of realism that makes the subjects seem lifelike.

Text analysis

Google

\29
\29