Human Generated Data

Title

Saint Paul

Date

1622-1624

People

Artist: Claude Vignon, French 1593 - 1670

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of an Anonymous Donor, 1994.150

Human Generated Data

Title

Saint Paul

People

Artist: Claude Vignon, French 1593 - 1670

Date

1622-1624

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Art 98
Painting 98
Human 91.8
Person 91.8
Photo 63.2
Face 63.2
Photography 63.2
Portrait 63.2

Clarifai
created on 2018-03-23

people 99.6
one 99.4
painting 99
adult 98.4
facial hair 97.1
sit 96.8
man 95.5
religion 94.6
portrait 94.5
art 94.4
furniture 94.2
indoors 91
book series 87.4
wear 83.2
mustache 82.1
seat 80.1
music 79.7
museum 76.6
lid 74.5
room 74.2

Imagga
created on 2018-03-23

primate 36.8
orangutan 34.5
monkey 31.5
wildlife 30.3
ape 29.1
wild 24.4
chimpanzee 21.4
person 19.5
primates 18.8
cadaver 18.2
animals 17.6
jungle 17.5
portrait 17.5
face 17
monkeys 16.8
orphaned 15.8
orphan 15.8
nursery 15.8
natural 15.4
black 14.5
tree 13.8
mammal 13.8
zoo 13.5
playing 12.8
man 12.8
religion 12.5
trees 12.4
play 12.1
fashion 11.3
religious 11.2
adult 11
endangered 10.8
old 10.4
male 9.9
orangutans 9.9
rehabilitation 9.9
climbing 9.8
holy 9.6
spiritual 9.6
god 9.6
hair 9.5
model 9.3
art 9.1
attractive 9.1
climb 8.8
pray 8.7
faith 8.6
animal 8.6
conservation 8.5
dark 8.3
church 8.3
comic book 8.2
sculpture 8
close 8
life 7.9
swinging 7.9
together 7.9
swing 7.8
eyes 7.7
mother 7.7
prayer 7.7
closeup 7.4
brown 7.4
covering 7.4
lady 7.3
people 7.2
sexy 7.2
statue 7.1

Google
created on 2018-03-23

art 91.1
painting 84.3
portrait 83.4
modern art 64.7
human behavior 63.7

Microsoft
created on 2018-03-23

person 99.1
text 89.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 53.7%
Angry 1.6%
Happy 1%
Surprised 3.8%
Sad 19.9%
Disgusted 2.4%
Confused 54.9%
Calm 16.5%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98%
Person 91.8%

Captions

Microsoft

a person sitting on a book 35.5%
a person holding a book 35.4%
a person sitting next to a book 35.3%