Human Generated Data

Title

The Sisters

Date

c. 1816-1817

People

Artist: Washington Allston, American 1779 - 1843

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Edward W. Moore, 1957.1

Human Generated Data

Title

The Sisters

People

Artist: Washington Allston, American 1779 - 1843

Date

c. 1816-1817

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Edward W. Moore, 1957.1

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Painting 99.6
Art 99.6
Human 90
Person 90

Clarifai
created on 2020-04-23

people 99.9
two 99.8
woman 99.6
adult 99.4
painting 99.3
wear 99.2
art 99.1
portrait 98.9
man 97.5
love 96.8
retro 96.6
son 96.2
affection 95.9
dress 95.2
girl 94.6
one 94.5
vintage 92.6
baby 92
music 91.1
dancing 87.9

Imagga
created on 2020-04-23

person 32.4
male 27.2
adult 27.1
man 26.2
people 25.6
portrait 25.2
attractive 25.2
fashion 24.9
couple 20
model 19.4
sexy 19.3
lady 17.8
hair 17.4
dress 17.2
face 17
love 16.6
human 16.5
costume 16.4
pretty 16.1
style 14.8
posing 14.2
sensual 13.6
sensuality 13.6
together 12.3
passion 12.2
black 12.2
body 12
room 12
one 11.9
makeup 11.9
handsome 11.6
happy 11.3
two 11
dark 10.9
seductive 10.5
sitting 10.3
happiness 10.2
lifestyle 10.1
dance 10.1
monk 9.9
studio 9.9
romance 9.8
looking 9.6
expression 9.4
casual 9.3
night 8.9
interior 8.8
clothing 8.7
men 8.6
wife 8.5
erotic 8.5
hot 8.4
guy 8.3
gorgeous 8.2
performer 7.9
passionate 7.8
smile 7.8
glamorous 7.7
elegant 7.7
dancing 7.7
girlfriend 7.7
art 7.6
hand 7.6
head 7.6
elegance 7.6
leisure 7.5
vintage 7.4
dancer 7.3
indoor 7.3
smiling 7.2
suit 7.2
romantic 7.1
mother 7.1

Google
created on 2020-04-23

Painting 98.2
Art 90.1
Visual arts 85
Portrait 83.7
Modern art 65.7
Still life 55.8
Picture frame 55.3
Artwork 52.3

Microsoft
created on 2020-04-23

text 95.4
man 94.6
human face 94.5
art 90.7
person 88.7
drawing 87.1
woman 84.7
portrait 82.1
clothing 76.9
sketch 53.5
painting 18.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 17-29
Gender Female, 90.4%
Calm 93.3%
Happy 2.7%
Angry 1.6%
Surprised 1%
Fear 0.1%
Sad 0.5%
Confused 0.6%
Disgusted 0.2%

AWS Rekognition

Age 19-31
Gender Female, 61.2%
Disgusted 0.2%
Calm 96.6%
Sad 1%
Fear 0.1%
Surprised 0.4%
Confused 0.1%
Happy 1.4%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.6%
Person 90%

Categories

Imagga

events parties 99.3%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The image is a painting depicting two figures in close embrace. The atmosphere suggests an intimate or tender moment shared between them. They are dressed in period clothing, with rich, dark fabrics and elaborate detailing. The figure on the left has a ribbon in their hair, and dramatic red drapery forms the backdrop, adding to the overall sense of drama and intimacy in the scene. The use of light and shadow creates depth and highlights the textures of the clothing and backdrop.

Created by gpt-4 on 2024-01-25

This is a painting of a person dressed in historical attire. The clothing suggests a style that might be from the 16th to 17th century, characterized by a wide neckline and puffed shoulders. The attire is opulent, with rich, dark velvet and what appears to be a greenish-golden embroidered fabric. The person seems to be standing next to a piece of dark furniture, possibly a table, on which there are some indistinct objects. The background is dimly lit and does not provide any specific details that would give context to the setting. The overall color palette is composed of deep, dark tones, conveying a sense of antiquity and richness.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts two figures - a woman in a richly colored green and gold dress, and a man in a dark robe, embracing each other. The woman has an introspective expression on her face, with her curly hair adorned by a decorative headpiece. The man seems to be comforting or consoling the woman, with his arm wrapped around her. The overall scene has a dramatic, theatrical quality, with the figures set against a dark, shadowy background that adds to the emotional intensity of the moment captured.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

This image is a painting of two women in a room. The woman on the left has red hair and is wearing a dark dress with a white lace collar and a black and gold headband. She is looking at the other woman, who has dark hair and is wearing a dark dress. The background of the painting is a dark red wall with a window on the right side. The overall atmosphere of the painting is one of elegance and sophistication.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a painting of two women in a room, with one woman standing and the other seated. The standing woman has her back to the viewer and is wearing a dark dress with her hair pulled back. The seated woman is facing the standing woman and is wearing a lighter-colored dress with her hair down. The background of the painting is a muted color, with a subtle gradient effect that gives the impression of depth and texture. The overall atmosphere of the painting is one of intimacy and quiet contemplation. The two women appear to be engaged in a private conversation, and the soft lighting and muted colors create a sense of warmth and coziness. The painting may have been created in the 17th or 18th century, based on the style and technique used. The painting is likely a portrait of two women who were close friends or family members. The artist may have been trying to capture the unique bond between the two women, and the painting conveys a sense of warmth and connection between them. The use of muted colors and soft lighting adds to the sense of intimacy and quiet contemplation, creating a peaceful and serene atmosphere.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts two women, one of whom is wearing a headband, standing near each other. The woman on the left is looking at something, while the woman on the right is looking at her. The woman on the right is wearing a bracelet and a ring on her left hand, which is resting on her hip. Behind them is a curtain, and beyond that is a view of the sky.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a painting of two women standing close to each other, with one woman looking at the other. The woman on the left has long, flowing hair and is wearing a green dress with a white collar. She is looking at the woman on the right, who has short hair and is wearing a brown dress. The woman on the right is holding the woman on the left's shoulder with her left hand, while her right hand is on her hip. The painting has a dark background, with a red curtain on the left and a blue sky with clouds on the right.