Human Generated Data

Title

The Last Judgment
Date

c. 1505
People

Artist: Jan Provoost, Netherlandish c. 1465 - 1529
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift and the Kate, Maurice R. and Melvin R. Seiden Special Purchase Fund in honor of Philip A. and Lynn Straus, 1997.2

Human Generated Data

Title

The Last Judgment

People

Artist: Jan Provoost, Netherlandish c. 1465 - 1529

Date

c. 1505

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift and the Kate, Maurice R. and Melvin R. Seiden Special Purchase Fund in honor of Philip A. and Lynn Straus, 1997.2

Machine Generated Data

Tags

Amazon
created on 2023-08-30

Art 100
Painting 100
Adult 100
Female 100
Person 100
Woman 100
Adult 99.4
Female 99.4
Person 99.4
Woman 99.4
Person 99.2
Adult 98.9
Person 98.9
Male 98.9
Man 98.9
Person 98.8
Adult 98.7
Female 98.7
Person 98.7
Woman 98.7
Person 98.4
Adult 98.4
Person 98.4
Male 98.4
Man 98.4
Person 97.7
Adult 97.2
Female 97.2
Person 97.2
Woman 97.2
Person 96.4
Person 96.3
Person 94.4
Person 91.2
Person 87.6
Face 87.4
Head 87.4
Person 86.5
Drawing 79.6
Person 64.3
Clothing 56.1
Shorts 56.1

Clarifai
created on 2018-08-20

people 99.7
art 99.6
religion 98.8
group 98.7
man 98.7
illustration 98.5
adult 98.5
woman 98.3
painting 97.6
child 97.4
god 96.8
dancing 93
nude 91.6
son 90.6
spirituality 89.3
recreation 89.2
baby 88.7
aura 87.5
wear 87.1
fun 86.8

Imagga
created on 2018-08-20

fan 54.1
follower 43.7
person 31.4
religion 27.8
art 20.8
temple 18.7
god 18.2
old 16.7
church 16.6
spiritual 16.3
culture 16.2
religious 15.9
sculpture 15.8
pray 15.5
faith 14.3
ancient 13.8
statue 13.5
holy 13.5
people 12.8
worship 12.6
traditional 12.5
man 12.1
decoration 11.9
prayer 11.6
colorful 11.5
painter 10.9
bible 10.8
gold 10.7
face 10.6
color 10.6
spirituality 10.6
comic book 9.9
cathedral 9.6
east 9.3
male 9.2
orange 9.2
travel 9.1
close 9.1
tattoo 9.1
portrait 9.1
monk 8.9
sacred 8.8
saint 8.7
scene 8.7
antique 8.6
adult 8.5
black 8.4
attractive 8.4
peace 8.2
love 7.9
couple 7.8
catholic 7.8
china 7.7
wall 7.7
design 7.7
historical 7.5
style 7.4
lady 7.3
child 7.1
architecture 7

Google
created on 2018-08-20

art 94.5
painting 89
religion 76.6
mythology 70.7
poster 68.4
modern art 67.2
artwork 63.6
visual arts 60.3
photomontage 57.8
illustration 51.2

Microsoft
created on 2018-08-20

text 97.7
person 96.2
posing 39.6
several 16.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 96.2%
Confused 95.1%
Surprised 6.6%
Fear 6.5%
Sad 2.3%
Calm 1.8%
Angry 0.5%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 80.2%
Calm 51.8%
Confused 35.8%
Surprised 6.7%
Fear 6.4%
Happy 4.2%
Sad 3.1%
Disgusted 2.2%
Angry 1.2%

AWS Rekognition

Age 6-14
Gender Female, 63%
Calm 98.8%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 42-50
Gender Male, 94.5%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Confused 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 6-14
Gender Female, 94.2%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 6-12
Gender Male, 98.8%
Calm 97.2%
Surprised 6.6%
Fear 6%
Sad 2.3%
Confused 0.4%
Disgusted 0.3%
Angry 0.3%
Happy 0.3%

AWS Rekognition

Age 33-41
Gender Female, 99.7%
Angry 37.5%
Sad 30.6%
Calm 14.3%
Confused 12.1%
Surprised 10.5%
Fear 8.5%
Disgusted 1.7%
Happy 0.9%

AWS Rekognition

Age 23-31
Gender Male, 65.3%
Calm 89%
Surprised 6.4%
Fear 6.2%
Sad 5.8%
Confused 1%
Happy 0.7%
Angry 0.5%
Disgusted 0.5%

AWS Rekognition

Age 30-40
Gender Female, 55.9%
Sad 99.9%
Angry 8.6%
Fear 7.3%
Surprised 7.1%
Calm 4.7%
Confused 2.1%
Disgusted 0.8%
Happy 0.8%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 88%
Confused 7.9%
Surprised 6.5%
Fear 5.9%
Sad 2.6%
Angry 1.3%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 13-21
Gender Female, 99.2%
Calm 79.5%
Surprised 7.9%
Fear 7.1%
Confused 6%
Sad 4.5%
Angry 1.4%
Disgusted 1.1%
Happy 0.6%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 70.6%
Surprised 16.1%
Confused 7.8%
Fear 6.5%
Sad 3.7%
Happy 1.5%
Disgusted 1.4%
Angry 1%

AWS Rekognition

Age 16-22
Gender Male, 80.6%
Surprised 82.5%
Fear 17.3%
Confused 13.2%
Sad 6.5%
Calm 4.8%
Angry 3.3%
Disgusted 2%
Happy 1.2%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 100%
Female 100%
Person 100%
Woman 100%
Male 98.9%
Man 98.9%
Shorts 56.1%

Captions

Microsoft
created on 2018-08-20

a group of people sitting posing for the camera 84.4%
a group of people posing for a photo 81.2%
a group of people posing for the camera 81.1%

Azure OpenAI

Created on 2024-02-09

The image is a painting that depicts a central figure clothed in white and red robes, seated on a cloud-like base, extending an arm in a gestural manner. The figure is surrounded by several other figures arrayed in an arc in the sky—some of whom are bearing musical instruments, such as a lute and a trumpet, while others appear to be in various poses of adoration or interaction. Below the central scene, additional figures are situated in what seems to be a lower, darker space. Some of these figures are looking up towards the central figure, while others are in various positions of reflection or distress. The overall composition seems to be rich in color and symbolic content, suggesting it is likely of religious or mythological significance.

Anthropic Claude

Created on 2024-03-30

The image depicts a religious scene with a central figure of Jesus Christ, surrounded by various biblical figures and images. Jesus is shown resurrected, wearing a red robe and standing amid a celestial background. Around him are several figures, including the Virgin Mary, apostles, and other religious figures. The scene also includes a group of nude figures, representing either the damned or the saved souls. The overall composition is complex and highly symbolic, reflecting traditional Christian imagery and themes of salvation, judgment, and the afterlife.