Human Generated Data

Title

"After the Ball Is Over" (38)
Date

1899
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.98

Human Generated Data

Title

"After the Ball Is Over" (38)

People

Artist: Unidentified Artist,

Date

1899

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.98

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Person 99.1
Art 92.1
Home Decor 67.7
Painting 66.4
Applique 65.2
Tapestry 61.5
Ornament 61.5

Clarifai
created on 2023-10-26

painting 99.6
print 99.5
people 99.2
art 99
family 98.4
woman 97.4
illustration 97.1
dress 96.1
two 95.8
adult 95.5
wear 95
old 94.9
antique 93.8
vintage 93.6
princess 92
child 91.6
lithograph 91.3
group 91.2
house 91.2
religion 90.4

Imagga
created on 2022-01-22

mosaic 55.9
transducer 42.2
jigsaw puzzle 35.3
electrical device 31.7
puzzle 28.8
pillow 25.3
old 23.7
game 20.9
device 20.6
cushion 20.5
decoration 19
art 18.6
vintage 18.2
religion 17.9
colorful 15.8
padding 15.5
culture 14.5
grunge 14.5
temple 14.4
traditional 13.3
texture 13.2
gold 13.2
wall 13.1
antique 13
paper 12.5
religious 12.2
ancient 12.1
church 12
travel 12
currency 11.7
color 11.1
money 11.1
painting 10.8
instrumentality 10.6
god 10.5
card 10.2
graffito 10.1
cash 10.1
retro 9.8
design 9.6
statue 9.5
golden 9.5
oriental 9.4
architecture 9.4
finance 9.3
tradition 9.2
bank 9
pattern 8.9
symbol 8.8
worship 8.7
sculpture 8.6
holiday 8.6
painted 8.6
economy 8.3
frame 8.3
new 8.1
financial 8
building 8
yellow 7.9
postal 7.9
sacred 7.8
mail 7.7
decorative 7.5
envelope 7.5
east 7.5
tourism 7.4
style 7.4
letter 7.3
window 7.3
business 7.3
paint 7.2
home 7.2
market 7.1
decor 7.1

Google
created on 2022-01-22

Rectangle 88.1
Textile 88
Dress 87.8
Art 85.4
Adaptation 79.4
Creative arts 78.6
Pattern 76.7
Vintage clothing 76.1
Painting 75.7
Beauty 75
Chair 72.5
Illustration 72
Advertising 67.7
Visual arts 67.5
Event 67.2
Room 66.1
Fashion design 65.6
Classic 64.7
Stock photography 64.5
History 64.5

Microsoft
created on 2022-01-22

painting 97.8
cartoon 93.4
drawing 90.2
text 83.7
clothing 82.6
child art 78.7
woman 72.3
person 70.1
dress 62.6
illustration 61.5
bedclothes 32.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Female, 99.3%
Calm 77.7%
Happy 9.5%
Sad 9.3%
Confused 1.5%
Angry 0.7%
Disgusted 0.7%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 80%
Sad 8.5%
Happy 6.5%
Confused 1.7%
Angry 1%
Disgusted 0.8%
Surprised 0.8%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 66.4%

Categories

Imagga

paintings art 96.6%
interior objects 2.8%

Captions

Microsoft
created on 2022-01-22

an old photo of a person 42.4%
an old photo of a girl 27%
old photo of a person 26.9%

Text analysis

Amazon

Ball
38.
After
Is
the
After the Ball Is Over.
Over.

Google

38. After the Ball Is Over.
38.
After
the
Ball
Is
Over.