Human Generated Data

Title

Dossal: The Virgin and Child with Saints Matthew and Hilarion

Date

c. 1310

People

Artist: Deodato Orlandi, Italian 1284 - 1317

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Arthur Sachs, 1938.129

Human Generated Data

Title

Dossal: The Virgin and Child with Saints Matthew and Hilarion

People

Artist: Deodato Orlandi, Italian 1284 - 1317

Date

c. 1310

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Arthur Sachs, 1938.129

Machine Generated Data

Tags

Amazon
created on 2022-05-03

Human 97
Person 97
Person 95.4
Architecture 94.8
Building 94.8
Person 93.8
Art 93
Painting 91.7
Church 85.5
Altar 85.5

Clarifai
created on 2023-10-22

painting 99.6
art 99.4
religion 99.4
people 99.3
book 97.8
church 97.7
aura 96.8
god 95.9
woman 95.6
illustration 95.3
man 95
adult 95
Mary 94.6
saint 94.2
book series 93.9
veil 93.4
gown (clothing) 93.2
baby 89.7
son 88.2
portrait 87.6

Imagga
created on 2022-05-03

chest 62
container 55.8
box 52.5
prayer rug 37.6
rug 31.9
wallet 24.1
floor cover 22.8
furnishing 22.7
art 19.6
old 19.5
case 19.4
covering 17.8
decoration 15.8
pattern 15
ancient 14.7
money 14.4
design 14.4
gold 14
culture 13.7
currency 13.4
vintage 13.2
golden 12.9
travel 12.7
bag 12.3
close 12
texture 11.8
paper 11.8
painting 11.7
religion 11.6
retro 11.5
detail 11.3
antique 11.2
finance 11
cash 11
traditional 10.8
symbol 10.8
painted 10.5
dollar 10.2
jigsaw puzzle 10.1
business 9.7
style 9.6
color 9.4
pay 8.6
ornament 8.6
face 8.5
fashion 8.3
tourism 8.2
wealth 8.1
object 8.1
history 8
puzzle 8
colorful 7.9
banknote 7.8
decorative 7.5
savings 7.5
brown 7.4
yellow 7.3
black 7.2
financial 7.1
interior 7.1
decor 7.1
architecture 7

Google
created on 2022-05-03

Picture frame 92.8
Temple 88.2
Textile 87.8
Art 83.1
Wood 83
Wall 81.4
Painting 79.2
Mural 73
Visual arts 70.6
History 68.8
Drawing 68.4
Illustration 67.8
Event 67.4
Mythology 67.4
Holy places 67.1
Antique 65.2
Religious item 65.1
Room 64.4
Stock photography 63.7
Carving 61.8

Microsoft
created on 2022-05-03

painting 99.2
text 96.2
drawing 95.2
art 93.5
human face 89
person 87.5
clothing 70.7
picture frame 70.4
museum 56.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 91.8%
Confused 37.6%
Calm 34.3%
Sad 8.9%
Angry 8.1%
Surprised 7.9%
Fear 6.6%
Happy 2.7%
Disgusted 2.2%

AWS Rekognition

Age 38-46
Gender Female, 99.8%
Fear 75.5%
Calm 17.8%
Disgusted 11%
Surprised 10.9%
Sad 2.9%
Confused 2.3%
Angry 0.9%
Happy 0.8%

AWS Rekognition

Age 25-35
Gender Male, 92.5%
Calm 77.8%
Fear 9.9%
Surprised 7.1%
Sad 6.1%
Disgusted 2.3%
Confused 0.9%
Angry 0.7%
Happy 0.7%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 96.3%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Angry 1%
Confused 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 98.2%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Painting 91.7%

Captions

Microsoft
created on 2022-05-03

an old photo of a person 39.7%

Text analysis

Amazon

Wild

Google

PRIM
PRIM