Human Generated Data

Title

Adoration of the Magi

Date

c. 1600

People

Artist: Jacopo Tintoretto, Italian 1519 - 1594

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Radcliffe College, Gift of Mrs. Cornelius Conway Felton, 1966.75

Human Generated Data

Title

Adoration of the Magi

People

Artist: Jacopo Tintoretto, Italian 1519 - 1594

Date

c. 1600

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Radcliffe College, Gift of Mrs. Cornelius Conway Felton, 1966.75

Machine Generated Data

Tags

Amazon
created on 2023-08-30

Art 100
Painting 100
Adult 96.6
Bride 96.6
Female 96.6
Person 96.6
Wedding 96.6
Woman 96.6
Adult 96.4
Person 96.4
Male 96.4
Man 96.4
Person 95.5
Person 93.3
Adult 93.1
Bride 93.1
Female 93.1
Person 93.1
Woman 93.1
Person 87.6
Person 86.2
Face 85.8
Head 85.8
Person 85.3
Person 83.1
Person 82.6
Person 81.3
Person 81.2
Person 80.6
Person 79.6
Person 79.3
Person 78.7
Person 77.2
Animal 76.8
Horse 76.8
Mammal 76.8
Person 71.5
Person 68.9
Person 68
Person 65
Archaeology 55

Clarifai
created on 2023-11-01

people 99.9
group 99.4
adult 98.6
art 98.1
many 97.3
man 96.3
illustration 96.3
cavalry 95.7
mammal 94.1
print 93.6
war 92.7
skirmish 91.7
soldier 91.3
woman 90.6
painting 90.6
vehicle 89.7
interaction 88.9
military 86
child 85.5
transportation system 84.7

Imagga
created on 2018-12-21

blackboard 100
freight car 32.8
art 25.4
grunge 24.7
car 24.4
old 24.4
graffito 22.5
decoration 22
wheeled vehicle 19.8
vintage 18.2
texture 18.1
design 15.8
wall 15.4
pattern 15
retro 14.7
antique 14.7
aged 14.5
ancient 13.8
paint 12.7
architecture 12.5
vehicle 12.4
dirty 11.7
detail 11.3
grungy 10.4
black 10.2
dark 10
building 9.8
text 9.6
canvas 9.5
symbol 9.4
paper 9.4
decorative 9.2
history 8.9
artistic 8.7
wallpaper 8.4
frame 8.3
artwork 8.2
technology 8.2
border 8.1
digital 8.1
religion 8.1
graphic 8
light 8
creative 7.9
textured 7.9
sculpture 7.6
finance 7.6
style 7.4
letter 7.3
business 7.3
world 7.2

Google
created on 2018-12-21

Microsoft
created on 2018-12-21

text 99.8
book 98.2
old 90
horse 57.9
group 57.9
crowd 53.4
black and white 50.5
music 39.5
person 36.7
show 30.5
child 29.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Female, 99.7%
Calm 71%
Surprised 13.3%
Confused 8.1%
Fear 6.5%
Happy 3.6%
Sad 2.9%
Disgusted 2.2%
Angry 1.9%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Disgusted 62.5%
Surprised 9.6%
Angry 9.2%
Calm 9.1%
Sad 8%
Fear 6.4%
Confused 2.1%
Happy 0.8%

AWS Rekognition

Age 19-27
Gender Male, 63.1%
Calm 62.8%
Surprised 23.3%
Fear 7%
Confused 6.5%
Happy 5.2%
Sad 2.8%
Angry 1.7%
Disgusted 1.6%

AWS Rekognition

Age 23-31
Gender Female, 99.8%
Calm 60.7%
Sad 24%
Happy 15%
Surprised 6.9%
Fear 6.2%
Confused 1.9%
Disgusted 0.9%
Angry 0.8%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Calm 66.4%
Confused 15.8%
Sad 11.2%
Surprised 6.9%
Fear 6.2%
Angry 2.1%
Disgusted 0.7%
Happy 0.6%

AWS Rekognition

Age 18-26
Gender Male, 88.5%
Calm 97.7%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Confused 0.6%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 34-42
Gender Male, 86.3%
Calm 49.1%
Sad 30.3%
Confused 10.2%
Angry 9.7%
Surprised 8.6%
Fear 6.3%
Disgusted 3.6%
Happy 1.6%

AWS Rekognition

Age 20-28
Gender Male, 56.1%
Calm 94.6%
Surprised 6.6%
Fear 5.9%
Sad 3.2%
Happy 0.7%
Disgusted 0.4%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 22-30
Gender Female, 71.4%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0%
Disgusted 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Female, 94.2%
Calm 80%
Happy 15.4%
Surprised 6.8%
Fear 5.9%
Sad 2.3%
Confused 2.2%
Angry 0.6%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Female, 91.3%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 11-19
Gender Male, 66%
Calm 87.1%
Surprised 6.7%
Fear 6.1%
Disgusted 4.4%
Happy 3.7%
Sad 2.8%
Confused 0.9%
Angry 0.7%

AWS Rekognition

Age 20-28
Gender Female, 99.3%
Sad 99%
Calm 21.7%
Disgusted 7.9%
Fear 7.3%
Surprised 7.1%
Confused 2.5%
Angry 2.2%
Happy 1.7%

AWS Rekognition

Age 26-36
Gender Male, 96.6%
Calm 53.7%
Angry 13.5%
Confused 11.9%
Sad 8%
Surprised 7.1%
Fear 6.2%
Disgusted 5.9%
Happy 2.9%

AWS Rekognition

Age 20-28
Gender Female, 85.8%
Sad 69.8%
Calm 47.6%
Confused 10.1%
Surprised 7.2%
Fear 6.6%
Disgusted 2.7%
Angry 2.4%
Happy 1.2%

AWS Rekognition

Age 29-39
Gender Male, 99.3%
Calm 69.6%
Happy 27.1%
Surprised 6.4%
Fear 6%
Sad 2.5%
Angry 0.5%
Confused 0.5%
Disgusted 0.5%

AWS Rekognition

Age 22-30
Gender Male, 92.7%
Calm 92.4%
Surprised 7.1%
Fear 6.3%
Sad 3%
Confused 1%
Happy 0.8%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 23-33
Gender Female, 50.3%
Happy 57.2%
Confused 14.5%
Calm 11.2%
Surprised 7.9%
Fear 6.7%
Sad 6.2%
Disgusted 2.8%
Angry 1.5%

AWS Rekognition

Age 23-31
Gender Male, 73.7%
Calm 97.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 1%
Confused 0.8%
Disgusted 0.4%
Angry 0.2%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Male
Man
Horse
Adult 96.6%
Adult 96.4%
Adult 93.1%
Bride 96.6%
Bride 93.1%
Female 96.6%
Female 93.1%
Person 96.6%
Person 96.4%
Person 95.5%
Person 93.3%
Person 93.1%
Person 87.6%
Person 86.2%
Person 85.3%
Person 83.1%
Person 82.6%
Person 81.3%
Person 81.2%
Person 80.6%
Person 79.6%
Person 79.3%
Person 78.7%
Person 77.2%
Person 71.5%
Person 68.9%
Person 68%
Person 65%
Woman 96.6%
Woman 93.1%
Male 96.4%
Man 96.4%
Horse 76.8%

Captions

OpenAI GPT

Created by gpt-4 on 2024-12-04

The image appears to be a grayscale representation of a classical painting with a historical scene. It depicts numerous figures dressed in period attire suggestive of Renaissance or Baroque fashion. Central to the scene are a few prominent figures engaged in what appears to be an important event or ceremony — their stately attire and the attention they're being given by the figures around them suggest their significance. In the background, there are rows of onlookers, implying that this event is of public interest. Some figures are on horseback, including one prominently displayed on an elevated platform. The overall atmosphere evoked by the settings and the clothing suggests a significant historical or state occasion. Various aspects of the image show attention to fine detail, such as the folds in the garments and the texture of the fabrics, indicative of a painting of a high artistic caliber. The lighting in the scene is dramatic, with strong contrasts of light and shadow giving depth and focus to the central characters.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This appears to be a historical religious painting depicting the Adoration of the Magi, a scene from Christian tradition showing the visit of the Three Wise Men to the newborn Jesus. The image is in black and white or grayscale, suggesting it may be an old photograph of a painting. The composition shows a crowded scene with many figures in period dress, with the central focus being on a group gathered around an infant. The background includes what appears to be animals (possibly oxen or cattle) and architectural elements. The painting style suggests it's from the Renaissance or Baroque period, with dramatic lighting and elaborate costumes typical of that era. The scene includes many onlookers and participants arranged in a theatrical manner, with some figures bowing or presenting gifts, which is characteristic of this particular biblical narrative.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a large, dramatic scene reminiscent of a historical or religious event. It shows a group of people gathered around what appears to be a person lying on a bed or couch. The scene is heavily detailed, with many figures in the background and various elements that suggest a grand, ceremonial setting. The overall tone of the image is somber and solemn, with a sense of reverence and importance to the events being portrayed.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-30

The image depicts a black-and-white painting of the Nativity scene, with the Virgin Mary and Saint Joseph surrounding the newborn Jesus. The painting is divided into two sections: the left side features the Holy Family, while the right side shows the Three Wise Men presenting their gifts to the infant Jesus. The background of the painting is filled with various figures, including angels, shepherds, and other biblical characters. The painting appears to be a traditional representation of the Nativity scene, with the Virgin Mary and Saint Joseph depicted in a reverent and solemn manner. The Three Wise Men are shown in elaborate robes, symbolizing their wealth and status. The background figures add depth and context to the scene, highlighting the significance of the event. Overall, the painting is a beautiful and meaningful depiction of the Nativity scene, capturing the essence of the Christmas story in a powerful and evocative way.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-25

The image is a black-and-white painting of a religious scene, likely depicting a biblical event. The painting features a large group of people, including men, women, and children, gathered around a central figure lying on a bed or table. The central figure appears to be a man, possibly a king or a religious leader, who is surrounded by a sense of reverence and respect. In the foreground, several individuals are shown kneeling or standing near the central figure, while others are depicted in the background, looking on with interest or concern. The overall atmosphere of the painting is one of solemnity and reverence, suggesting that the scene is meant to evoke a sense of awe and wonder. The use of black and white tones adds to the dramatic effect of the painting, creating a sense of contrast and highlighting the emotions and expressions of the figures depicted. The style of the painting is reminiscent of Renaissance art, with its attention to detail and realism. Overall, the image presents a powerful and evocative depiction of a significant religious event, inviting the viewer to reflect on the themes and emotions conveyed in the painting.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image depicts a black and white painting of the nativity scene. The painting shows a group of people gathered around a manger where the baby Jesus is lying. The scene is set in a stable with a few animals, including a donkey and a cow. The people in the painting are dressed in traditional clothing and are shown kneeling or standing in reverence before the manger. The painting is a depiction of the birth of Jesus Christ, a significant event in Christian history.

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a historical scene with a large crowd of people gathered around a central event. In the foreground, there is a man lying on a bed, possibly a king or a noble figure, attended by a woman who appears to be a queen or a consort. The man is being presented with a gift by a standing figure, possibly a courtier or a messenger. In the background, there is a group of people, some of whom are wearing armor and helmets, suggesting a military or royal entourage. The scene is set in a grand hall or a palace, with a large archway and a balcony overlooking the crowd. The image is monochromatic, with a sepia tone, giving it a historical and timeless quality.