Human Generated Data

Title

The Last Judgment
Date

17th century
People

Artist: Unidentified Artist,

Classification

Drawings
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Mrs. John H. Steiner, BR79.1

Human Generated Data

Title

The Last Judgment

People

Artist: Unidentified Artist,

Date

17th century

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Mrs. John H. Steiner, BR79.1

Machine Generated Data

Tags

Amazon
created on 2022-05-05

Painting 99.4
Art 99.4
Person 96
Human 96
Person 92.9
Person 84.9
Person 83.7
Person 73.3
Home Decor 59.1
Person 58
Portrait 57.2
Photography 57.2
Face 57.2
Photo 57.2
Person 52.6
Person 44.7

Clarifai
created on 2023-10-22

art 99.6
religion 99.3
painting 99.2
people 98.8
Renaissance 98.4
saint 97.6
god 96.6
man 95.6
illustration 95.6
baroque 95.5
group 95.3
no person 95.3
nude 93.4
woman 91.7
print 91.6
adult 90.9
spirituality 90.6
church 90.1
ancient 87.2
kneeling 86.8

Imagga
created on 2022-05-05

mosaic 58.6
transducer 37.5
vintage 33.9
old 33.4
texture 33.3
grunge 30.7
art 29.6
paper 29
electrical device 28.1
retro 26.2
antique 23.8
wallpaper 22.2
tray 21.9
aged 21.7
pattern 20.5
brown 18.4
device 18.2
receptacle 17.7
ancient 17.3
floral 17
flower 16.9
design 16.4
border 16.3
dirty 16.3
frame 15
torn 14.5
paint 14.5
container 14.4
parchment 14.4
worn 14.3
backdrop 14
decoration 13.5
decorative 13.4
jigsaw puzzle 13
letter 12.8
rust 12.5
surface 12.3
grungy 12.3
canvas 12.3
page 12.1
rough 11.8
graphic 11.7
rusty 11.4
blank 11.1
wall 11.1
tile 10.7
map 10.7
material 10.7
color 10.6
plant 10.5
puzzle 10.2
colorful 10
collection 9.9
geography 9.6
artistic 9.6
weathered 9.5
instrumentality 9.4
cash 9.1
currency 9
backgrounds 8.9
detail 8.8
decor 8.8
carving 8.8
textured 8.8
stained 8.7
stain 8.6
obsolete 8.6
money 8.5
creation 8.5
close 8
stamp 7.9
holiday 7.9
postage 7.9
flowers 7.8
scratch 7.8
leaf 7.8
burnt 7.8
drawing 7.7
decay 7.7
beige 7.7
mail 7.7
bill 7.6
finance 7.6
sheet 7.5
element 7.4
document 7.4
grain 7.4
historic 7.3
artwork 7.3
yellow 7.3
lines 7.2
sculpture 7.1
colors 7.1
game 7

Google
created on 2022-05-05

Textile 87.2
Art 81.9
Painting 81.5
Religious item 70.7
Visual arts 69.3
Mythology 67
Fictional character 65.8
Holy places 65.3
Stock photography 65.1
History 64.1
Ceiling 63.3
Antique 63
Ancient history 62.4
Landscape 61.7
Illustration 59.9
Artifact 58.5
Artwork 57.7
Collection 55.7
Middle ages 54.7
Modern art 54.6

Microsoft
created on 2022-05-05

painting 99
art 92.5
text 89.6
cartoon 79.4
drawing 73.2
person 59.2
bunch 47
several 10.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 36.5%
Sad 36.4%
Fear 16.4%
Angry 9.9%
Surprised 8.3%
Confused 5.7%
Disgusted 2.6%
Happy 1.8%

AWS Rekognition

Age 24-34
Gender Male, 93.1%
Calm 64.3%
Sad 43.1%
Fear 6.9%
Surprised 6.5%
Confused 3.9%
Disgusted 1.9%
Angry 1.1%
Happy 0.9%

AWS Rekognition

Age 43-51
Gender Male, 79.7%
Calm 55.3%
Surprised 43%
Angry 13.3%
Fear 5.9%
Sad 2.2%
Disgusted 1.3%
Happy 1.2%
Confused 0.4%

AWS Rekognition

Age 22-30
Gender Female, 100%
Confused 66.7%
Calm 14.6%
Surprised 7.8%
Fear 6.6%
Sad 4.8%
Disgusted 3.1%
Happy 2.7%
Angry 2.6%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 80.1%
Surprised 10.3%
Fear 6.4%
Confused 5.5%
Disgusted 2.5%
Sad 2.4%
Happy 2.4%
Angry 1.1%

AWS Rekognition

Age 23-31
Gender Female, 87.2%
Disgusted 66.6%
Fear 12.1%
Calm 11.7%
Surprised 8%
Angry 3%
Sad 2.5%
Happy 1.6%
Confused 1.1%

AWS Rekognition

Age 37-45
Gender Female, 100%
Fear 97.7%
Surprised 6.3%
Sad 2.3%
Calm 1.6%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Male, 90.5%
Calm 99.2%
Surprised 6.3%
Fear 6%
Sad 2.2%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 96.5%
Fear 6.5%
Surprised 6.4%
Sad 2.2%
Happy 0.4%
Disgusted 0.4%
Angry 0.3%
Confused 0.3%

AWS Rekognition

Age 56-64
Gender Female, 83.5%
Happy 76.2%
Disgusted 15.2%
Surprised 6.8%
Fear 6.1%
Calm 4.3%
Sad 2.3%
Angry 1.4%
Confused 0.6%

AWS Rekognition

Age 23-33
Gender Female, 79.7%
Happy 84.5%
Calm 8%
Surprised 7.3%
Fear 6.7%
Sad 2.3%
Disgusted 1.5%
Angry 1%
Confused 0.5%

AWS Rekognition

Age 23-31
Gender Female, 93.7%
Calm 39.8%
Fear 34.1%
Surprised 12.4%
Angry 6.4%
Disgusted 4.5%
Confused 4.2%
Happy 3.3%
Sad 2.6%

AWS Rekognition

Age 22-30
Gender Female, 77.8%
Calm 44.3%
Fear 31.1%
Sad 16.9%
Surprised 7.1%
Disgusted 3.8%
Confused 2.7%
Angry 1.3%
Happy 1.2%

AWS Rekognition

Age 23-31
Gender Female, 95.4%
Calm 79.2%
Disgusted 15%
Surprised 6.9%
Fear 6.2%
Sad 2.8%
Happy 0.7%
Angry 0.6%
Confused 0.5%

AWS Rekognition

Age 40-48
Gender Male, 99.6%
Fear 74.2%
Calm 12.4%
Sad 12.2%
Happy 7.5%
Surprised 7.2%
Disgusted 5.6%
Angry 1.5%
Confused 1.3%

AWS Rekognition

Age 20-28
Gender Female, 61.2%
Happy 32.5%
Fear 29.3%
Surprised 12.7%
Calm 10.2%
Sad 6.9%
Confused 4.2%
Disgusted 3.7%
Angry 3.6%

AWS Rekognition

Age 6-16
Gender Female, 78.6%
Calm 95.5%
Surprised 6.6%
Fear 6%
Sad 2.4%
Disgusted 1.6%
Happy 0.3%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.7%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Happy 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 21-29
Gender Male, 53.7%
Calm 92.6%
Surprised 6.9%
Fear 6.8%
Sad 2.6%
Happy 1.1%
Disgusted 0.6%
Confused 0.5%
Angry 0.4%

AWS Rekognition

Age 7-17
Gender Female, 99.5%
Happy 45.2%
Calm 12.6%
Surprised 11.7%
Disgusted 11.4%
Sad 7.7%
Fear 7.5%
Angry 6.1%
Confused 3.4%

AWS Rekognition

Age 22-30
Gender Male, 90.4%
Calm 98.7%
Surprised 6.3%
Fear 6.1%
Sad 2.2%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 20-28
Gender Male, 93.9%
Calm 64.4%
Fear 17.4%
Surprised 6.8%
Disgusted 5.4%
Happy 4.6%
Sad 3.3%
Angry 1.6%
Confused 1.6%

AWS Rekognition

Age 16-24
Gender Male, 77.1%
Calm 93.3%
Fear 6.9%
Surprised 6.4%
Sad 2.5%
Happy 1.3%
Confused 0.8%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 23-31
Gender Female, 63.9%
Calm 94.6%
Surprised 7.1%
Fear 6.6%
Sad 2.3%
Angry 0.7%
Happy 0.4%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 7-17
Gender Male, 96.5%
Calm 91.3%
Surprised 6.7%
Fear 6.3%
Sad 4%
Confused 0.8%
Angry 0.7%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 30-40
Gender Female, 65.2%
Fear 50%
Disgusted 25.8%
Calm 13.1%
Surprised 8.4%
Confused 6.6%
Angry 3.6%
Sad 3.3%
Happy 2.9%

AWS Rekognition

Age 23-31
Gender Female, 93.9%
Calm 29.9%
Happy 21.2%
Fear 18.6%
Surprised 15.1%
Disgusted 11.4%
Sad 3.1%
Angry 2.6%
Confused 1.7%

AWS Rekognition

Age 34-42
Gender Male, 69.4%
Calm 87.5%
Surprised 6.6%
Fear 6.5%
Disgusted 4.6%
Sad 3.1%
Confused 1.6%
Angry 0.9%
Happy 0.6%

AWS Rekognition

Age 27-37
Gender Female, 99.1%
Sad 69.6%
Calm 53.5%
Surprised 7.4%
Fear 6.7%
Happy 3.2%
Confused 2.7%
Disgusted 2.1%
Angry 1.7%

Feature analysis

Amazon

Painting 99.4%
Person 96%

Categories

Imagga

paintings art 56.9%
food drinks 31.5%
macro flowers 4.1%
nature landscape 3.1%
streetview architecture 1.5%

Captions

Microsoft
created on 2022-05-05

map 40.5%