Human Generated Data

Title

La Madonna di San Francesco

Date

19th century

People

Artist: Peter Lutz, German 1799 - 1867

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2456

Human Generated Data

Title

La Madonna di San Francesco

People

Artist: Peter Lutz, German 1799 - 1867

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 99.3
Person 99.3
Person 99.2
Person 98.9
Art 97.1
Painting 97.1
Person 94.1
Person 88.8
Person 87.4
Person 56.8
Archaeology 55.5

Clarifai
created on 2019-11-06

people 99.8
adult 97.9
group 97.5
two 96.2
art 95.6
one 95.3
man 94
woman 92.6
leader 92.5
illustration 92.4
print 92.3
portrait 90.9
wear 88.9
furniture 87.8
child 85.3
painting 83.7
sit 81.3
three 80.8
seat 80
administration 79.7

Imagga
created on 2019-11-06

altar 62.1
statue 53.7
sculpture 53.4
structure 48.2
religion 38.6
art 33.3
architecture 33.1
ancient 29.4
throne 27.9
god 27.8
monument 26.2
old 25.8
temple 25.4
history 24.2
church 24.1
historical 23.5
religious 23.4
building 23.3
stone 22.9
chair of state 22.3
tourism 22.3
historic 22
antique 20.9
culture 20.5
city 20
holy 19.3
travel 19
chair 18.9
prayer 18.4
faith 18.2
famous 17.7
spirituality 17.3
column 17.3
landmark 17.2
catholic 16.6
spiritual 16.3
fountain 16.1
carving 15.7
marble 15.6
pray 15.5
cathedral 14.6
decoration 13.9
figure 13.8
detail 12.9
tourist 12.7
worship 12.6
saint 12.5
gold 12.3
seat 11.9
arch 10.9
vintage 10.8
golden 10.3
catholicism 9.8
sacred 9.7
belief 9.7
interior 9.7
attraction 9.6
statues 8.9
facade 8.8
angel 8.8
symbol 8.8
color 8.3
traditional 8.3
roman 8.2
palace 7.8
artistic 7.8
face 7.8
memorial 7.8
heritage 7.7
meditation 7.7
oriental 7.6
decorative 7.5
design 7.4
mother 7.2
bronze 7.1

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

text 97.4
wall 96.8
person 95.9
clothing 94.2
art 74.5
man 60.9
different 56.9
old 53.6
posing 44.8
several 19.2

Face analysis

Amazon

Google

AWS Rekognition

Age 27-43
Gender Male, 53.4%
Confused 45.3%
Angry 45.3%
Happy 49.2%
Sad 45.2%
Fear 45.2%
Disgusted 45.2%
Calm 48.9%
Surprised 45.7%

AWS Rekognition

Age 22-34
Gender Female, 53.9%
Angry 45.2%
Surprised 45.2%
Fear 45.1%
Disgusted 45.1%
Confused 45.1%
Sad 45.1%
Happy 50.8%
Calm 48.3%

AWS Rekognition

Age 17-29
Gender Female, 53.2%
Fear 45.1%
Surprised 45.1%
Disgusted 45.2%
Sad 45.2%
Calm 47.9%
Happy 49.6%
Angry 46.9%
Confused 45.1%

AWS Rekognition

Age 8-18
Gender Female, 54.3%
Calm 54.7%
Angry 45%
Surprised 45%
Fear 45%
Sad 45.1%
Happy 45.1%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 8-18
Gender Female, 50.4%
Angry 46.1%
Confused 45%
Happy 45.1%
Fear 45.1%
Calm 53.3%
Disgusted 45%
Sad 45.4%
Surprised 45%

AWS Rekognition

Age 3-9
Gender Female, 50%
Fear 45.1%
Sad 45.5%
Angry 51.3%
Happy 45%
Confused 45.1%
Disgusted 45.1%
Surprised 45.1%
Calm 47.9%

AWS Rekognition

Age 1-5
Gender Female, 53.4%
Calm 49.5%
Angry 48.4%
Disgusted 45.1%
Surprised 45.2%
Sad 45.3%
Happy 46.1%
Fear 45.2%
Confused 45.1%

AWS Rekognition

Age 32-48
Gender Female, 50.2%
Sad 49.5%
Surprised 49.5%
Calm 49.5%
Happy 49.5%
Angry 50.4%
Fear 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Happy 49.5%
Sad 49.8%
Disgusted 49.5%
Angry 49.9%
Calm 49.7%
Fear 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 1-5
Gender Female, 51.7%
Confused 45.1%
Sad 46.2%
Disgusted 45.1%
Angry 45.4%
Calm 52.7%
Surprised 45.3%
Fear 45.1%
Happy 45.2%

AWS Rekognition

Age 0-4
Gender Male, 50.4%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Fear 49.5%
Confused 49.5%
Sad 49.6%
Calm 50.3%

AWS Rekognition

Age 10-20
Gender Male, 50%
Disgusted 49.5%
Angry 49.6%
Fear 49.6%
Calm 49.5%
Confused 49.5%
Happy 49.5%
Sad 50.3%
Surprised 49.5%

AWS Rekognition

Age 31-47
Gender Female, 50.9%
Calm 46.1%
Angry 48%
Fear 45.2%
Surprised 45.1%
Happy 46.8%
Sad 48.5%
Confused 45.2%
Disgusted 45.1%

AWS Rekognition

Age 13-23
Gender Male, 51.4%
Fear 45%
Calm 54.1%
Confused 45%
Sad 45.4%
Surprised 45%
Disgusted 45%
Happy 45.3%
Angry 45%

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 97.1%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 79.1%
a vintage photo of a group of people posing for a picture 79%
a group of people posing for a photo 78.9%

Text analysis

Amazon

dh
h
haben dh
h C
haben
C