Human Generated Data

Title

The Holy Family with the Infant Saint John the Baptist and Saint Elizabeth

Date

1650

People

Artist: Nicolas Poussin, French 1594 - 1665

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Samuel Sachs in memory of her husband, Samuel Sachs, 1942.168

Human Generated Data

Title

The Holy Family with the Infant Saint John the Baptist and Saint Elizabeth

People

Artist: Nicolas Poussin, French 1594 - 1665

Date

1650

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Samuel Sachs in memory of her husband, Samuel Sachs, 1942.168

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Painting 99.7
Art 99.7
Person 99.2
Human 99.2
Person 98.8
Person 98.3
Person 96.6
Person 94.9
Person 91.5
Person 88.9
Person 87.3
Person 87.1
Person 80.8
Person 70
Person 69.7

Clarifai
created on 2020-04-24

people 99.7
adult 99
woman 98.6
art 98.4
group 98.2
religion 98
painting 98
man 97.9
child 97.3
two 97
gown (clothing) 95
veil 94.9
son 94.6
wear 93.4
travel 93.2
outdoors 90.2
position 89.9
Renaissance 89.8
illustration 89.4
baby 87.5

Imagga
created on 2020-04-24

monk 64.3
man 28.2
male 27.7
people 25.7
smiling 25.3
outdoors 24.5
kin 24
child 24
happy 23.8
couple 21.8
sitting 21.5
smile 20.7
family 20.5
mother 20.4
together 20.1
love 19.7
person 19.7
boy 19.1
adult 18.3
portrait 18.1
lifestyle 18.1
happiness 18
park 16.6
outside 16.3
vacation 15.5
cheerful 15.4
children 14.6
summer 14.1
playing 13.7
relaxing 13.6
fun 13.5
relationship 13.1
father 13.1
day 12.6
laughing 12.3
outdoor 12.2
holiday 12.2
youth 11.9
pretty 11.9
women 11.9
parent 11.8
cute 11.5
enjoying 11.4
group 11.3
home 11.2
joy 10.9
leisure 10.8
senior 10.3
religious 10.3
son 10.3
mature 10.2
two 10.2
teenager 10
casual clothing 9.8
girlfriend 9.6
friends 9.4
dress 9
religion 9
childhood 9
brother 8.8
affectionate 8.7
daughter 8.6
loving 8.6
togetherness 8.5
casual 8.5
friendship 8.4
relaxation 8.4
house 8.4
fashion 8.3
oriental 8.3
teen 8.3
resort 8.1
looking 8
little 7.9
sister 7.8
temple 7.8
husband 7.7
affection 7.7
boyfriend 7.7
attractive 7.7
teenage 7.7
faith 7.7
ethnic 7.6
wife 7.6
relaxed 7.5
traditional 7.5
romance 7.1
grass 7.1
sea 7

Google
created on 2020-04-24

Painting 97.9
Art 83.9
Visual arts 76.9
Mythology 65.1
Pilgrims 64.3
Artwork 58

Microsoft
created on 2020-04-24

painting 98.2
person 94.1
outdoor 89.2
art 88.6
clothing 53.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-20
Gender Female, 85.4%
Confused 0.4%
Fear 0.3%
Surprised 0.3%
Sad 95.3%
Happy 0.3%
Angry 0.7%
Calm 2.7%
Disgusted 0.1%

AWS Rekognition

Age 13-25
Gender Female, 99.5%
Happy 2%
Sad 0.8%
Fear 0.1%
Confused 0.2%
Calm 95.9%
Disgusted 0.1%
Angry 0.4%
Surprised 0.5%

AWS Rekognition

Age 29-45
Gender Female, 96.7%
Fear 1.1%
Confused 4.3%
Happy 36.7%
Calm 40.3%
Sad 1.3%
Surprised 2.8%
Disgusted 3.5%
Angry 10.1%

AWS Rekognition

Age 22-34
Gender Female, 76.3%
Sad 0.4%
Confused 0.7%
Happy 3.2%
Disgusted 0.3%
Calm 3%
Angry 3.6%
Surprised 86.8%
Fear 2%

AWS Rekognition

Age 2-8
Gender Female, 52.9%
Calm 98.2%
Happy 0%
Sad 1.2%
Angry 0%
Disgusted 0%
Confused 0.1%
Surprised 0.4%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Female, 84.6%
Fear 0.7%
Disgusted 0%
Angry 0.1%
Happy 0%
Surprised 0%
Calm 0.5%
Sad 98.5%
Confused 0.1%

AWS Rekognition

Age 8-18
Gender Male, 53.3%
Happy 0.6%
Surprised 1.5%
Confused 1.7%
Disgusted 0.9%
Calm 88.1%
Sad 3.9%
Fear 1.1%
Angry 2.2%

AWS Rekognition

Age 23-37
Gender Male, 75.5%
Sad 4.4%
Surprised 0.4%
Happy 3.3%
Fear 0.2%
Angry 1.6%
Confused 0.3%
Disgusted 0.3%
Calm 89.5%

AWS Rekognition

Age 28-44
Gender Male, 52.8%
Disgusted 45%
Confused 45%
Sad 45%
Surprised 45%
Calm 45%
Happy 45%
Fear 45%
Angry 55%

AWS Rekognition

Age 13-25
Gender Female, 50.4%
Fear 49.5%
Surprised 49.5%
Angry 49.5%
Sad 49.6%
Calm 49.8%
Happy 50%
Disgusted 49.5%
Confused 49.5%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.7%
Person 99.2%

Categories

Imagga

events parties 73.9%
people portraits 19.7%
food drinks 5.4%

Captions

Azure OpenAI

Created on 2024-01-27

This is a classic painting depicting multiple figures in a pastoral landscape. To the left, there's a large classical column and a tree dominating the background, with a bright blue sky filled with white clouds above. Several figures are draped in colorful robes of blue, red, orange, and white. The gathered figures appear to be engaged in a group activity near a large bronze bowl situated on a sandy ground. Some of the figures hold items like a laurel wreath and a piece of cloth. The landscape extends into the background, showing serene water, green hills, buildings, and trees, creating a peaceful setting. The architecture and clothing suggest a scene from classical antiquity.

Anthropic Claude

Created on 2024-03-29

The image appears to depict a religious scene with the Virgin Mary surrounded by numerous children in various stages of undress. The Virgin Mary is seated on a stone bench, wearing a blue robe and a red cloak. She is holding several children in her arms, while other children play and interact around her. The background features a landscape with buildings and a tower in the distance. The overall composition and colors create a harmonious and spiritual atmosphere.