Human Generated Data

Title

Saint Roch as a Pilgrim

Date

c. 1730

People

Artist: Giovanni Battista Tiepolo, Italian 1696 - 1770

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.123

Human Generated Data

Title

Saint Roch as a Pilgrim

People

Artist: Giovanni Battista Tiepolo, Italian 1696 - 1770

Date

c. 1730

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.123

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Painting 99.3
Art 99.3
Person 97.2
Human 97.2
Apparel 55.4
Clothing 55.4
Face 55.2

Clarifai
created on 2018-03-16

painting 99.9
people 99.8
adult 99.7
art 99.3
illustration 99.1
one 99.1
wear 98.4
print 97.4
weapon 96.9
furniture 96.3
mammal 96
woman 95.6
lithograph 95.1
veil 94.9
man 94.9
two 94.7
reclining 94.3
seat 94
interaction 93.6
religion 91.8

Imagga
created on 2018-03-16

comic book 55.1
person 31.9
jacket 23.4
fashion 22.6
print media 22
people 21.7
book jacket 21.4
adult 20.2
portrait 18.8
attractive 18.2
man 18.1
male 14.9
face 14.2
weapon 13.8
sexy 13.6
elegance 13.4
style 13.3
gun 13.3
lady 13
stringed instrument 12.8
one 12.7
wrapping 12.7
model 12.4
smoke 12.1
hair 11.9
women 11.1
dress 10.8
lute 10.8
posing 10.7
human 10.5
sitting 10.3
elegant 10.3
expression 10.2
musical instrument 10.2
youth 10.2
covering 10.1
hat 10
dark 10
protection 10
sensuality 10
pretty 9.8
warrior 9.8
outdoors 9.7
body 9.6
costume 9.5
wall 9.4
culture 9.4
outdoor 9.2
studio 9.1
sensual 9.1
old 9.1
performer 9
soldier 8.8
happy 8.8
smile 8.5
dancer 8.5
sorcerer 8.5
black 8.4
fun 8.2
art 8.2
danger 8.2
dance 8.1
blond 8.1
happiness 7.8
military 7.7
war 7.7
arms 7.6
sport 7.4
suit 7.4
make 7.3
sun 7.2
lifestyle 7.2

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

book 93.5
person 91
text 89.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Female, 80.3%
Angry 2.4%
Calm 42.4%
Happy 1%
Disgusted 2.8%
Surprised 0.9%
Sad 48%
Confused 2.5%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.3%
Person 97.2%

Categories

Imagga

events parties 99.9%

Captions

Microsoft
created on 2018-03-16

a person holding a cat 38.4%
a person holding a dog 38.3%
a person holding a dog 38.2%

Azure OpenAI

Created on 2024-01-27

This image depicts a painting of a seated individual dressed in a mix of garments reminiscent of classical attire, such as a draped cloth and leggings. Adjacent to this person is a rifle propped upright, adorned with a feathered plume attached near the barrel. At the individual's feet lies a resting dog with black and white coloring, seemingly asleep. In the background, there's a dramatic landscape featuring towering cliffs and a vibrant sky with an array of blues and warm golden hues, suggesting a setting or rising sun. A castle or built structure is visible in the distance, nestled among the rugged terrain. The painting captures a serene moment, possibly after a hunt or during a moment of reflection in the wilderness.

Anthropic Claude

Created on 2024-03-29

The image depicts a man, likely a religious or historical figure, seated outdoors in a rugged, mountainous landscape. He is wearing a long, flowing cloak and appears to be carrying a staff or walking stick. At his feet lies a dog or other animal. The scene has a dramatic, almost somber quality, with the contrast between the man's pensive expression and the wild, rocky surroundings creating a sense of isolation or introspection.