Human Generated Data

Title

The Agony in the Garden

Date

c. 1425-1430

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Association Fund, BR57.126

Human Generated Data

Title

The Agony in the Garden

People

Artist: Unidentified Artist,

Date

c. 1425-1430

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Association Fund, BR57.126

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Person 99
Human 99
Art 96.2
Painting 96.2
Person 80.5
Person 73
Person 71.2
Sculpture 62.3

Clarifai
created on 2020-04-23

people 99.7
art 99.1
painting 97
woman 96.1
adult 95
portrait 94.9
wear 94.8
one 93.7
man 93
illustration 90.7
print 90.3
fear 89.3
group 88.7
religion 85.8
child 85.1
old 84.3
vintage 82.6
horror 80.9
ghost 78.5
baby 77.2

Imagga
created on 2020-04-23

column 100
totem pole 100
structure 67.9
statue 60.8
sculpture 58.4
architecture 38.3
stone 37
ancient 36.4
art 34.8
monument 32.7
old 32.1
religion 30.5
temple 29.2
culture 29.1
history 27.7
famous 24.2
carving 23.8
travel 22.6
religious 20.6
building 19.1
historical 18.8
city 17.5
marble 17.5
historic 17.4
landmark 17.2
tourism 16.5
palace 16.4
god 16.3
cemetery 15.7
antique 14.7
figure 13.8
heritage 13.5
memorial 12.9
spirituality 12.5
spiritual 12.5
tourist 11.8
obelisk 11.7
museum 11.6
capital 11.4
detail 11.3
decoration 10.9
fountain 10.1
face 10
statues 9.9
pray 9.7
gravestone 9.7
holy 9.6
facade 9.6
symbol 9.4
east 9.3
place 9.3
church 9.3
traditional 9.2
vintage 9.1
carved 8.8
catholic 8.8
ruin 8.8
meditation 8.6
classical 8.6
gold 8.2
grave 7.9
civilization 7.9
lion 7.8
attraction 7.6
oriental 7.6
china 7.5
peace 7.3
square 7.2
cathedral 7.1

Google
created on 2020-04-23

Microsoft
created on 2020-04-23

painting 95.5
drawing 94.8
person 91.4
text 90.6
clothing 89.9
old 89.6
human face 89.5
sketch 77.5
black and white 66.6
cartoon 55.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-55
Gender Female, 51.2%
Sad 73.4%
Happy 0.1%
Confused 0.3%
Angry 0.3%
Calm 25.7%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 25-39
Gender Female, 67.7%
Surprised 1.1%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Sad 0.2%
Calm 0.2%
Confused 0.1%
Fear 98%

AWS Rekognition

Age 22-34
Gender Male, 53.6%
Angry 45.4%
Happy 45.2%
Disgusted 45.1%
Surprised 46.1%
Fear 52.3%
Sad 45.1%
Confused 45.1%
Calm 45.9%

AWS Rekognition

Age 42-60
Gender Male, 51.1%
Happy 45%
Calm 46%
Disgusted 45%
Surprised 45%
Confused 45%
Angry 45.1%
Fear 51%
Sad 47.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99%
Person 80.5%
Person 73%
Person 71.2%
Painting 96.2%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-01-24

This is a grayscale image of an old, possibly ancient, wall mural or painting. The image shows a central figure, standing and facing towards what appears to be a bird in flight. The bottom portion of the artwork depicts two sitting figures, each adorned with what seems to be a halo, indicating that these could be figures of significance or sanctity. Surrounding the figures are elements of foliage, adding to the suggestion that the scene might be depicting a garden or natural setting. The paint looks aged with visible damage, suggesting historical value. The artwork is mounted on a support, possibly for preservation or display purposes.

Created by gpt-4o-2024-05-13 on 2025-01-04

The image appears to be an old, possibly religious painting, showing a scene with multiple figures in prayer or contemplative poses. It has a dark, textured background that looks like a night setting with elements such as trees and a bird flying across the sky. There are several figures with halos, suggesting they are saints or holy people. One central figure is kneeling on an elevated surface with hands folded in prayer, while other figures are positioned around, some sitting and some kneeling. The painting seems to have a worn, aged appearance with visible signs of wear and tear.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image appears to be a black and white photograph of an old painting or mural. The painting depicts a religious or spiritual scene, with a central figure in a long, flowing robe reaching up toward a bird or winged creature in the sky. The background is filled with intricate details, including what looks like trees or other natural elements. The painting has an aged and weathered appearance, suggesting it is an older work of art.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

This image is a black-and-white photograph of a painting that appears to be religious in nature. The painting depicts a man standing on a platform, with his hands raised in prayer. He is surrounded by other figures, some of whom are also praying or looking up at him. The background of the painting is dark and indistinct, but it appears to be a landscape with trees and hills. The painting itself is old and worn, with visible cracks and damage to the surface. It is mounted on a wall or board, and there are some objects visible at the bottom of the image that may be part of the display or storage system for the painting. Overall, the image suggests that the painting is an important work of art that has been preserved and displayed for its cultural or historical significance.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a black-and-white photograph of an old painting, likely from the medieval period, featuring a scene with multiple figures. The painting is in a state of disrepair, with visible signs of aging and damage. The central figure appears to be kneeling in prayer, surrounded by other individuals who seem to be engaged in various activities. The background of the painting is dark and indistinct, but it appears to feature trees and other foliage. The overall atmosphere of the painting is one of reverence and contemplation, suggesting that it may be a religious or devotional work.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is a black-and-white photograph of an old painting. The painting depicts a religious scene with a central figure of a man sitting on a rock and appearing to be in a state of prayer or meditation. The man is dressed in a long robe and has a halo around his head, indicating his spiritual significance. In the background, there is a mountain and a bird flying above it. On the left side of the painting, there are two figures, one of whom is wearing a crown and holding a scepter, possibly representing a king or a ruler. The painting appears to be old and worn, with some areas of discoloration and fading.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a monochromatic photograph of a painting that appears to be an old religious artwork. The painting depicts a central figure, possibly a saint or a holy person, seated on a rock or a cloud, with a serene expression. The figure is dressed in a long robe and has their hands raised in a gesture of prayer or blessing. The background is dark and somewhat abstract, with a few faint details, such as a bird flying above and some vegetation. There are also two smaller figures at the bottom of the painting, one of whom is kneeling in prayer. The overall atmosphere of the painting is one of contemplation and reverence.