Human Generated Data

Title

Holy Family

Date

16th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Mrs. Morton D. Mitchell in memory of her husband, 1918.41

Human Generated Data

Title

Holy Family

People

Artist: Unidentified Artist,

Date

16th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Mrs. Morton D. Mitchell in memory of her husband, 1918.41

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 99.4
Person 99.4
Person 98.8
Person 96.9
Art 95.8
Photo 68.9
Portrait 68.9
Face 68.9
Photography 68.9
People 68.1
Painting 64.6
Female 61.5
Girl 61.5
Child 60.7
Kid 60.7

Clarifai
created on 2020-04-24

people 100
adult 99.2
group 98.5
two 96.8
child 96.4
man 95.8
wear 95.3
woman 94.3
group together 93.5
three 93.2
portrait 93
four 90.8
administration 90.4
furniture 90.3
military 87.6
sit 87.1
royalty 87
leader 86.9
offspring 86
several 84.6

Imagga
created on 2020-04-24

fountain 29.3
adult 23.3
body 23.2
structure 22.4
kin 22.2
person 21.6
man 19.5
sexy 19.3
people 19
fashion 18.8
model 18.7
portrait 17.5
attractive 16.8
one 16.4
lifestyle 15.9
male 15.3
hair 15.1
human 15
world 14.9
sensuality 14.5
black 14.4
child 12.8
face 12.8
wet 12.5
art 12.4
water 12
skin 11.8
old 11.8
statue 11.6
relaxation 10.9
sculpture 10.7
posing 10.7
lady 10.5
muscular 10.5
pretty 10.5
leisure 10
mother 9.9
style 9.6
serene 9.4
smile 9.3
sensual 9.1
sport 9.1
fitness 9
health 9
happy 8.8
women 8.7
men 8.6
city 8.3
slim 8.3
vintage 8.3
dress 8.1
religion 8.1
building 7.9
love 7.9
architecture 7.8
torso 7.8
ancient 7.8
shower 7.8
sitting 7.7
summer 7.7
expression 7.7
youth 7.7
passion 7.5
dark 7.5
training 7.4
historic 7.3
sibling 7.2
history 7.2
happiness 7.1

Google
created on 2020-04-24

Photograph 96.4
People 93.9
Snapshot 85.8
Black-and-white 74.4
Stock photography 73.4
Child 71.2
Photography 67.8
Art 58.1
Family 55.3
Monochrome 54.4
Style 51

Microsoft
created on 2020-04-24

human face 99.4
text 95.3
sitting 95.2
clothing 94
baby 92
person 88.7
smile 87.2
man 82.1
old 68.2
toddler 55.8
posing 35.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Female, 84.6%
Happy 0.8%
Disgusted 29.1%
Angry 1%
Calm 53.1%
Sad 13.1%
Fear 0.4%
Confused 1.4%
Surprised 1%

AWS Rekognition

Age 51-69
Gender Male, 92.8%
Confused 0.9%
Angry 1.3%
Calm 12.4%
Happy 0.1%
Fear 0.2%
Disgusted 0.1%
Sad 85%
Surprised 0.1%

AWS Rekognition

Age 12-22
Gender Female, 54%
Confused 0%
Sad 0.1%
Calm 99.2%
Fear 0%
Happy 0.4%
Disgusted 0%
Angry 0%
Surprised 0.1%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 12
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 64.6%

Categories

Captions

Azure OpenAI

Created on 2024-12-04

The image features a black and white photograph of a classical painting. The painting depicts a scene with at least two figures. One figure appears to be seated and is shown extending an arm, while another figure appears to be a child or baby. The figures in the painting are set against a dark, somewhat indistinct background that may suggest an interior or a night scene. There are notable damages or aged spots visible on the surface of the painting, and it is framed with a simple, dark-toned border. In the foreground, two objects resembling erasers or blocks are placed beneath the painting, likely for support or as part of the photograph's staging. The overall appearance suggests age and wear, lending a sense of history and antiquity to the piece.

Anthropic Claude

Created on 2024-11-27

The image appears to be a black and white photograph of a painting or artwork depicting the Virgin Mary holding the infant Jesus. The woman in the painting has a serene expression and is wearing a draped cloth over her head. The baby Jesus is nestled in her arms, surrounded by a cloudy, ethereal background. The image has a vintage, aged quality with visible cracks and damage to the surface.

Meta Llama

Created on 2024-11-24

The image presents a black-and-white photograph of a painting, which appears to be an old work of art. The painting depicts a scene of a woman, a baby, and a man, likely representing the Holy Family. The woman is positioned on the left side of the image, wearing a head covering and a dark dress with a white shawl draped over her right shoulder. She is holding the baby in her left arm, while the man sits to the right of the baby, facing the viewer. The background of the painting features a dark, stone wall with a faint landscape visible behind the figures. The overall atmosphere of the image suggests that it is a religious or devotional work, possibly created in the Renaissance or Baroque period. The photograph itself appears to be an archival or museum-quality image, given its high level of detail and the presence of a protective glass or acrylic cover over the painting.