Human Generated Data

Title

The Summons

Date

1856

People

Artist: Emanuel Gottlieb Leutze, American 1816 - 1868

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Theodore E. Stebbins Jr., 2007.224

Human Generated Data

Title

The Summons

People

Artist: Emanuel Gottlieb Leutze, American 1816 - 1868

Date

1856

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Theodore E. Stebbins Jr., 2007.224

Machine Generated Data

Tags

Amazon
created on 2019-04-02

Human 99.1
Person 99.1
Art 96.6
Painting 96.4
Person 96.3
Person 93.4
Person 88.5
Person 87.6
Person 87.4
Crypt 85.9
Person 60.6
Person 55.7

Clarifai
created on 2018-04-18

people 99.4
religion 97.6
church 97.5
art 96.7
painting 93.5
adult 93.2
woman 92.7
group 92.4
architecture 90.8
indoors 90.1
travel 84.6
cathedral 84.2
building 84
museum 84
man 82.1
bedrock 81.1
arch 80.3
home 79.8
city 78.8
monastery 78.2

Imagga
created on 2018-04-18

vault 92.3
roof 70.4
architecture 60.5
protective covering 52.7
building 50
church 44.5
religion 41.3
cathedral 40.5
old 39.8
covering 35.8
ancient 35.5
arch 34
stone 31.4
historic 28.5
hall 26.3
monastery 25.2
history 24.2
door 23.8
wall 22.6
tourism 22.3
historical 21.7
travel 21.2
medieval 21.1
window 21.1
religious 19.7
landmark 19
catholic 18.9
interior 18.6
city 18.3
monument 16.8
house 16.3
culture 16.3
tourist 15.4
light 15.4
palace 15.2
anteroom 14.8
arches 14.7
column 14.7
faith 14.4
god 14.4
art 14.3
chapel 13.8
castle 13.5
cross 13.2
street 12.9
entrance 12.6
tower 12.6
religious residence 12.4
brick 12.3
place 12.1
altar 12.1
town 12.1
residence 12
fortress 11.8
holy 11.6
architectural 11.6
construction 11.1
abbey 10.9
columns 10.8
antique 10.4
worship 9.7
detail 9.7
spirituality 9.6
corridor 8.9
stained 8.7
temple 8.3
inside 8.3
vacation 8.2
structure 8
catholicism 7.9
sacred 7.8
saint 7.7
traditional 7.5
famous 7.5
decoration 7.2
night 7.1

Google
created on 2018-04-18

Microsoft
created on 2018-04-18

building 91.9
arch 39.6
stone 21
colonnade 14.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Happy 45.2%
Sad 46.2%
Disgusted 45.5%
Calm 52.4%
Angry 45.4%
Confused 45.1%
Surprised 45.2%

AWS Rekognition

Age 35-52
Gender Female, 54.3%
Angry 45%
Happy 45%
Calm 45%
Disgusted 45%
Confused 45%
Sad 54.9%
Surprised 45%

AWS Rekognition

Age 14-23
Gender Female, 54.6%
Sad 54.2%
Confused 45%
Disgusted 45.1%
Happy 45.6%
Angry 45.1%
Surprised 45%
Calm 45%

AWS Rekognition

Age 16-27
Gender Male, 50.5%
Surprised 49.5%
Angry 49.6%
Disgusted 49.5%
Confused 49.6%
Happy 49.5%
Calm 49.5%
Sad 50.2%

AWS Rekognition

Age 6-13
Gender Female, 50.1%
Disgusted 49.6%
Sad 49.8%
Calm 49.9%
Happy 49.6%
Angry 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Confused 45.2%
Surprised 45.2%
Calm 50.4%
Sad 48.6%
Angry 45.3%
Happy 45.1%
Disgusted 45.3%

AWS Rekognition

Age 29-45
Gender Female, 50.1%
Angry 49.6%
Confused 49.6%
Calm 49.7%
Sad 49.9%
Disgusted 49.6%
Happy 49.6%
Surprised 49.6%

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 96.4%

Captions

Azure OpenAI

Created on 2024-01-25

This image depicts a richly detailed scene set within an ornate architectural space that appears to be from a historical period. The architecture includes elegant arched ceilings, a column with intricate carvings, and a large window that allows natural light to illuminate the interior. The room is adorned with a hunting trophy, paintings, wall sconces, and statues, conveying a sense of opulence and attention to artistic detail. In the foreground, a figure stands confidently with one hand on their hip. Near the center of the room, there appears to be a group of figures gathered around a table, engaged in a social activity. The interaction among them suggests a moment of leisure and conversation. The daylight casts soft shadows and highlights throughout the space, enhancing the textures and materials of the various objects, from the tapestries to the furnishings. A dog is lying on the floor, contributing to the domestic feel of the scene. In the lower right corner of the image, a pair of thrown objects and a sword with a richly decorated hilt add a sense of action or reaction to the artwork, suggesting a narrative or a moment captured in time. The interior is furnished with period-appropriate furniture, including chairs upholstered with dark material and accented with studs, adding to the historical ambiance of the setting.

Anthropic Claude

Created on 2024-03-29

This image depicts a grand, ornate interior space with intricate Gothic-style architecture. The scene shows a group of people engaged in what appears to be a social gathering or celebration. In the center, a number of well-dressed individuals are seated around a table, suggesting a formal meal or gathering. A man in a burgundy robe stands to one side, gesturing or interacting with the group. The overall atmosphere conveys a sense of elegance and historical setting, with the ornate columns, arched ceilings, and antique furnishings creating a richly detailed and visually striking scene.

Meta Llama

Created on 2024-11-23

The image depicts a scene from William Shakespeare's play "Hamlet," specifically Act 3, Scene 4, where Polonius is hiding behind a curtain to observe Hamlet's behavior. The painting shows Polonius standing behind a dark curtain, watching Hamlet, who is standing in the center of the room. Hamlet is holding a letter and appears to be deep in thought. The room is filled with other characters, including Ophelia, who is sitting on the floor, and Rosencrantz and Guildenstern, who are standing near the window. The atmosphere is tense and suspenseful, with Polonius's presence adding to the sense of drama and intrigue. The painting captures the intensity of the scene, with the characters' emotions and actions conveyed through their facial expressions and body language. The use of muted colors and dramatic lighting adds to the overall mood of the painting, creating a sense of foreboding and tension. Overall, the image effectively conveys the complexity and depth of Shakespeare's play, inviting the viewer to explore the characters and their motivations.