Using artificial intelligence, the Harvard Art Museums has collected 53,516,727 machine-generated descriptions and tags covering 380,022 images of artworks. Ranging from object recognition to face analysis that predicts gender, age, and emotion, the data reveals how computers interpret paintings, photographs, and sculptures.
is the ability of computers to perform advanced tasks previously only capable by human intelligence
Wikipedia →is a subset of artificial intelligence and is the ability of computers to ‘learn’ from previous errors without human input
Wikipedia →is a field that studies how computers ‘see’ and ‘interpret’ the visual world using machine learning
Wikipedia →Artificial intelligence when united with art advances how humans understand and interact with artworks. Specifically, the Harvard Art Museums is using computer vision to categorize, tag, describe, annotate, and humanize its collections. We start by giving each AI an image of an artwork. We then ask it to describe what it sees. The machine views and describes the museum’s collection with no additional context. It’s as if the machine is walking into an art museum for the first time. Since the computer lacks context or artistic knowledge beyond what is depicted in each image, the machine’s interpretations of the artworks lean closer to reflecting the public rather than experts. By folding in an AI’s perspective, browsing and searching art becomes more accessible and intuitive to non-museumgoers.
Harvard Art Museums is not alone in using AI to promote accessibility in art, other institutions are pursuing similar efforts. MoMA worked with the Google Arts and Culture Lab used artificial intelligence to connect older exhibit photos dating back to 1929 to their online collection, allowing greater public access to their exhibition history. Researchers at Rutgers University used machine learning to uncover previously unnoticed connections of influence between artists. The National Museum of Norway is experimenting with semantic search and multi-modal large language models to enhance their online collections. As art institutions are becoming more aware of artificial intelligence, the scope of its real-world applications continues to expand.
Use the search box to find artworks that depict the term or phrase
