Human Generated Data

Title

Madonna and Child and Saint John

Date

18th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Lawrence Brooks, 1939.150

Human Generated Data

Title

Madonna and Child and Saint John

People

Artist: Unidentified Artist,

Date

18th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Lawrence Brooks, 1939.150

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.7
Human 98.7
Person 96.9
Person 94.7
Art 92
Painting 86.3
Drawing 66.8
Drink 63.7
Beverage 63.7
Alcohol 62.7
Liquor 61.9
Photography 56.5
Portrait 56.5
Face 56.5
Photo 56.5
Sculpture 56.2

Clarifai
created on 2020-04-24

people 99.8
adult 98.1
two 97.6
man 97.3
woman 95.6
soldier 94.4
art 94.3
portrait 93.1
three 91.8
wear 91.4
war 91
one 89.5
military 89.5
weapon 88.9
veil 85.2
retro 83.3
actor 82.6
helmet 82.3
cross 80.9
religion 79.4

Imagga
created on 2020-04-24

call 53.7
art 20.9
telephone 20.8
portrait 20.7
face 20.6
pay-phone 18.8
church 18.5
person 17.4
religion 17
adult 16.8
god 16.3
one 15.7
people 15.6
man 15.5
statue 14.5
human 14.2
electronic equipment 14.2
fashion 13.6
sculpture 12.6
dark 12.5
holy 12.5
black 12.2
hair 11.9
pray 11.6
lady 11.4
old 11.1
culture 11.1
model 10.9
world 10.9
bible 10.8
male 10.6
interior 10.6
religious 10.3
money 10.2
currency 9.9
antique 9.6
faith 9.6
expression 9.4
vintage 9.2
pretty 9.1
attractive 9.1
make 9.1
gold 9
sexy 8.8
closeup 8.8
prayer 8.7
saint 8.7
spiritual 8.6
golden 8.6
mask 8.6
close 8.6
historical 8.5
stone 8.4
dollar 8.3
banking 8.3
cash 8.2
sensual 8.2
posing 8
body 8
business 7.9
architecture 7.8
sacred 7.8
ancient 7.8
catholic 7.8
figure 7.7
equipment 7.7
worship 7.7
wall 7.7
spirituality 7.7
rich 7.4
famous 7.4
symbol 7.4
paint 7.2
device 7.2
icon 7.1
love 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 97.8
drawing 97.3
human face 97.1
painting 93.9
sketch 93.8
man 91.5
clothing 88.2
person 87.6
woman 73.5
black and white 69.3
posing 40.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 95.8%
Happy 1.2%
Fear 4.9%
Disgusted 1.1%
Surprised 2.2%
Sad 44.5%
Confused 4.1%
Calm 39.1%
Angry 3%

AWS Rekognition

Age 26-40
Gender Male, 96.7%
Confused 1%
Fear 1.6%
Calm 13.9%
Disgusted 0.2%
Surprised 0.4%
Happy 0.1%
Sad 81.5%
Angry 1.3%

AWS Rekognition

Age 33-49
Gender Female, 57.3%
Surprised 0.7%
Confused 2%
Disgusted 1.9%
Fear 1.2%
Calm 71%
Happy 0.9%
Angry 3%
Sad 19.3%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 86.3%

Categories

Captions

Microsoft
created on 2020-04-24

a black and white photo of a man 76.6%
an old photo of a man 76.5%
a man holding a book 42.3%

Text analysis

Amazon

DEI
AGN
ECCE

Google

EXCE AGN DEI
EXCE
AGN
DEI