Human Generated Data

Title

Scene Nine
Date

17th century
People

Artist: Johanna Sibylla Kraus, German 17th-18th centuries
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R15186

Human Generated Data

Title

Scene Nine

People

Artist: Johanna Sibylla Kraus, German 17th-18th centuries

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R15186

Machine Generated Data

Tags

Amazon
created on 2023-10-23

Art 100
Painting 100
Adult 95.7
Bride 95.7
Female 95.7
Person 95.7
Wedding 95.7
Woman 95.7
Person 95.5
Person 95.3
Person 93.7
Person 93.3
Adult 91
Bride 91
Female 91
Person 91
Woman 91
Person 91
Person 89.1
Person 88.6
Person 87.9
Person 87.9
Person 87.6
Person 87.4
Person 87.2
Person 87.1
Person 85.7
Person 85.2
Person 83.9
Person 83.6
Person 81.4
Person 79.3
Head 78.6
Person 78.6
Person 77.8
Person 77
Face 76.7
Person 75.7
Person 75.3
Person 73.1
Person 73.1
Person 70.7
Person 62.8
Accessories 57.4
Ornament 57.4
Tapestry 57.4
Drawing 57.1
Person 56

Clarifai
created on 2019-02-27

people 100
illustration 99.7
print 99.7
man 99.5
group 99.5
art 99.4
adult 99
many 98.5
engraving 98.3
leader 98.1
woodcut 95.7
facial hair 94.4
painting 94.2
administration 93.3
veil 92.7
soldier 91.9
etching 91.9
military 90.7
woman 90.5
weapon 89.3

Imagga
created on 2019-02-27

sketch 78
drawing 65.2
representation 45.7
old 31.3
vintage 30.6
antique 27
art 26.9
grunge 23.8
retro 21.3
design 20.9
decoration 20.7
ancient 19.9
texture 19.4
pattern 15.7
history 15.2
paper 14.9
black 13.8
sepia 13.6
travel 13.4
decorative 13.4
style 13.3
frame 13.3
artistic 13
wallpaper 13
plant 12.6
border 11.8
architecture 11.7
flower 11.5
detail 11.3
floral 11.1
graphic 10.9
atlas 10.9
city 10.8
decor 10.6
textured 10.5
graffito 10.4
aged 9.9
map 9.9
world 9.7
culture 9.4
element 9.1
tourism 9.1
sculpture 9.1
paint 9
dirty 9
states 8.7
geography 8.7
arabesque 8.6
scroll 8.6
temple 8.5
backdrop 8.2
damask 8.2
material 8
close 8
wall 7.9
creative 7.9
color 7.8
leaf 7.8
elegant 7.7
structure 7.6
capital 7.6
grungy 7.6
gold 7.4
artwork 7.3
shape 7.3

Google
created on 2019-02-27

Art 88.8
Painting 80.1
History 73.3
Drawing 67.7
Textile 65.6
Illustration 65.5
Printmaking 60.1
Stock photography 59.4
Artwork 57.4
Mythology 56.1
Visual arts 55
Tapestry 52.7
Middle ages 50.7

Microsoft
created on 2019-02-27

text 98.5
book 97.1
engraving 97.1
woodcut 36.4
illustration 18.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 24-34
Gender Male, 75.1%
Angry 75.4%
Surprised 8.7%
Fear 8.2%
Disgusted 6.7%
Sad 4.7%
Calm 1.4%
Confused 0.9%
Happy 0.7%

AWS Rekognition

Age 20-28
Gender Female, 99.1%
Angry 87.3%
Calm 10.1%
Surprised 6.7%
Fear 5.9%
Sad 2.2%
Happy 0.9%
Confused 0.5%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Female, 97.3%
Fear 74.3%
Sad 45.8%
Surprised 8.8%
Calm 5%
Confused 4.3%
Happy 1.4%
Disgusted 1.2%
Angry 1.1%

AWS Rekognition

Age 22-30
Gender Female, 99.8%
Sad 100%
Fear 6.4%
Surprised 6.3%
Calm 1.4%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Sad 99.4%
Angry 13.7%
Surprised 11.1%
Fear 8.7%
Calm 4.1%
Disgusted 4%
Confused 1.9%
Happy 0.6%

AWS Rekognition

Age 25-35
Gender Female, 77%
Sad 97.9%
Fear 24.9%
Calm 15.8%
Surprised 7%
Angry 2.3%
Disgusted 1.4%
Happy 0.4%
Confused 0.4%

AWS Rekognition

Age 22-30
Gender Female, 65%
Fear 87.7%
Angry 26.6%
Surprised 6.4%
Sad 2.7%
Calm 0.4%
Disgusted 0.3%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 22-30
Gender Female, 65.2%
Happy 87%
Disgusted 7.8%
Surprised 6.5%
Fear 5.9%
Calm 3.1%
Sad 2.2%
Angry 1.2%
Confused 0.1%

AWS Rekognition

Age 26-36
Gender Male, 81.1%
Calm 82.5%
Fear 7.4%
Surprised 6.5%
Angry 6.4%
Sad 3.8%
Happy 1.3%
Disgusted 1.1%
Confused 0.4%

AWS Rekognition

Age 16-24
Gender Female, 99.2%
Calm 78.7%
Surprised 10.8%
Fear 8.3%
Sad 3.2%
Angry 3.1%
Disgusted 1.5%
Confused 0.7%
Happy 0.6%

AWS Rekognition

Age 16-24
Gender Female, 99%
Fear 70.2%
Happy 15.5%
Angry 11.1%
Surprised 9.7%
Calm 5.5%
Sad 3.7%
Disgusted 2.5%
Confused 1.9%

AWS Rekognition

Age 22-30
Gender Female, 62.8%
Calm 32.7%
Fear 16.4%
Happy 16.1%
Disgusted 12.8%
Surprised 9.4%
Sad 8.5%
Angry 4.7%
Confused 1.4%

AWS Rekognition

Age 1-7
Gender Male, 99.1%
Calm 76.2%
Fear 9.6%
Surprised 8.2%
Angry 6.3%
Sad 2.8%
Happy 2%
Confused 1.4%
Disgusted 1%

AWS Rekognition

Age 19-27
Gender Female, 84.8%
Angry 65%
Fear 14.7%
Disgusted 8.6%
Calm 7.6%
Surprised 6.9%
Sad 2.4%
Happy 0.9%
Confused 0.9%

AWS Rekognition

Age 21-29
Gender Female, 64.6%
Angry 49.1%
Fear 30%
Calm 13.7%
Surprised 6.9%
Sad 3.9%
Disgusted 1.5%
Confused 0.9%
Happy 0.7%

AWS Rekognition

Age 20-28
Gender Male, 84%
Angry 87.1%
Fear 10%
Surprised 6.5%
Disgusted 2.9%
Sad 2.3%
Calm 0.6%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Male, 91%
Calm 94.6%
Fear 6.9%
Surprised 6.4%
Sad 2.4%
Angry 0.9%
Happy 0.6%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 44.2%
Disgusted 21.3%
Happy 13.6%
Fear 8.6%
Surprised 7.3%
Angry 5.5%
Sad 4.1%
Confused 2.7%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Happy 30.3%
Surprised 29.2%
Angry 14.5%
Confused 10.4%
Calm 10%
Fear 9.9%
Sad 3.2%
Disgusted 2.4%

AWS Rekognition

Age 23-31
Gender Female, 66.6%
Calm 94.3%
Surprised 6.8%
Fear 6.2%
Confused 3.1%
Sad 2.3%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Female, 87.8%
Fear 96.6%
Surprised 6.5%
Happy 5.3%
Sad 2.2%
Angry 2.2%
Calm 0.2%
Disgusted 0.2%
Confused 0.1%

Feature analysis

Amazon

Adult 95.7%
Bride 95.7%
Female 95.7%
Person 95.7%
Woman 95.7%

Captions

Microsoft
created on 2019-02-27

a close up of a book 45.4%
close up of a book 39.9%
a hand holding a book 39.8%