Human Generated Data

Title

"After the Ball Is Over" (38)

Date

1899

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.98

Human Generated Data

Title

"After the Ball Is Over" (38)

People

Artist: Unidentified Artist,

Date

1899

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.4
Person 99.4
Person 99.1
Art 92.1
Home Decor 67.7
Painting 66.4
Applique 65.2
Ornament 61.5
Tapestry 61.5

Imagga
created on 2022-01-22

mosaic 55.9
transducer 42.2
jigsaw puzzle 35.3
electrical device 31.7
puzzle 28.8
pillow 25.3
old 23.7
game 20.9
device 20.6
cushion 20.5
decoration 19
art 18.6
vintage 18.2
religion 17.9
colorful 15.8
padding 15.5
culture 14.5
grunge 14.5
temple 14.4
traditional 13.3
texture 13.2
gold 13.2
wall 13.1
antique 13
paper 12.5
religious 12.2
ancient 12.1
church 12
travel 12
currency 11.7
color 11.1
money 11.1
painting 10.8
instrumentality 10.6
god 10.5
card 10.2
graffito 10.1
cash 10.1
retro 9.8
design 9.6
statue 9.5
golden 9.5
oriental 9.4
architecture 9.4
finance 9.3
tradition 9.2
bank 9
pattern 8.9
symbol 8.8
worship 8.7
sculpture 8.6
holiday 8.6
painted 8.6
economy 8.3
frame 8.3
new 8.1
financial 8
building 8
yellow 7.9
postal 7.9
sacred 7.8
mail 7.7
decorative 7.5
envelope 7.5
east 7.5
tourism 7.4
style 7.4
letter 7.3
window 7.3
business 7.3
paint 7.2
home 7.2
market 7.1
decor 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

painting 97.8
cartoon 93.4
drawing 90.2
text 83.7
clothing 82.6
child art 78.7
woman 72.3
person 70.1
dress 62.6
illustration 61.5
bedclothes 32.8

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Female, 99.3%
Calm 77.7%
Happy 9.5%
Sad 9.3%
Confused 1.5%
Angry 0.7%
Disgusted 0.7%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 80%
Sad 8.5%
Happy 6.5%
Confused 1.7%
Angry 1%
Disgusted 0.8%
Surprised 0.8%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 66.4%

Captions

Microsoft

an old photo of a person 42.4%
an old photo of a girl 27%
old photo of a person 26.9%

Text analysis

Amazon

Ball
38.
After
Is
the
After the Ball Is Over.
Over.

Google

After
Ball
38.
the
Over.
38. After the Ball Is Over.
Is