Human Generated Data

Title

Saint John the Baptist Pointing to Christ in a Landscape

Date

c. 1656

People

Artist: Carlo Maratti, Italian 1625 - 1713

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Darcy Bradbury, '78, MBA '82; Edward A. Friedman, JD '74, and Karen S.W. Friedman; Timothy G. Massad, '78, JD '84; Eric Seiler '78, AM, '82, JD '82; and Neil Westreich, JD '77, 1999.250

Human Generated Data

Title

Saint John the Baptist Pointing to Christ in a Landscape

People

Artist: Carlo Maratti, Italian 1625 - 1713

Date

c. 1656

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Darcy Bradbury, '78, MBA '82; Edward A. Friedman, JD '74, and Karen S.W. Friedman; Timothy G. Massad, '78, JD '84; Eric Seiler '78, AM, '82, JD '82; and Neil Westreich, JD '77, 1999.250

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 99.9
Painting 99.9
Human 96.9
Person 96.9
Person 96.8

Clarifai
created on 2018-03-16

people 99.7
adult 99.4
mammal 99.3
one 99.1
painting 98.3
two 97.8
woman 97.3
child 96.5
man 94.9
group 94.2
dog 92.9
religion 92.7
wear 92.5
hunter 92.3
herder 92.3
canine 91
recreation 89.8
veil 89.6
outdoors 89.4
position 88.4

Imagga
created on 2018-03-16

dog 43.3
hunting dog 36.1
brown 30.2
horse 28.8
hound 27.4
head 22.7
canine 20.2
face 17.8
portrait 17.5
pet 17.4
farm 16.1
domestic animal 15.7
equine 15.1
bloodhound 14
animals 13.9
equestrian 13.7
pointer 13.7
wild 13.1
friend 12.4
cute 12.2
horses 11.7
person 11
black 10.8
stallion 10.8
riding 10.7
ranch 10.7
summer 10.3
happy 10
sporting dog 10
eye 9.8
mare 9.8
outdoors 9.7
people 9.5
boxer 9.3
smile 9.3
wildlife 8.9
hair 8.7
grass 8.7
hat 8.6
close 8.6
outdoor 8.4
sport 8.2
fun 8.2
domestic 8.1
looking 8
rural 7.9
stable 7.9
pony 7.9
skin 7.8
mammals 7.8
ride 7.8
eyes 7.7
breed 7.7
cowboy 7.7
outside 7.7
pasture 7.7
rest 7.7
livestock 7.4
natural 7.4
sun 7.2

Google
created on 2018-03-16

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 85.4%
Sad 22.5%
Surprised 2.8%
Calm 59.1%
Happy 0.9%
Angry 6.1%
Disgusted 5.4%
Confused 3.2%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Happy 45.3%
Angry 45.7%
Disgusted 45.7%
Calm 46.9%
Sad 50.8%
Surprised 45.3%
Confused 45.4%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.9%
Person 96.9%

Categories

Captions

Microsoft
created on 2018-03-16

a person standing next to a dog 58.3%
a person and a dog 52.6%
a person holding a dog 46.3%

Azure OpenAI

Created on 2024-01-27

This image depicts a classic pastoral scene. A figure in the foreground, draped in a flowing red garment, gestures emphatically towards a distant point. They also hold a long cross-like staff. At the figure's side, there is a calm sheep looking upwards. The environment suggests a wilderness setting, with dense foliage, trees, and a serene, mountainous landscape in the background. A second, smaller figure dressed in a blue robe stands atop a hill in the distance, contributing to the serene yet dynamic composition of the piece.