Leveraging the power of AI for European cultural heritage

Share

AI will now be well-versed in cultural heritage due to a new EU-funded project called Saint George on a Bike. Composed of researchers from the Barcelona Supercomputing Center (BSC) and Europeana Foundation, the project has begun training natural language processing and deep learning algorithms in culture, symbols, and historical context with the aim of automatically generating rich metadata for hundreds of thousands of images from various European cultural heritage repositories.

Training AI to be aware of cultural heritage contexts is not as simple as teaching it to identify different objects in a picture. Saint George on a Bike is fine-tuning the algorithms so that it “thinks” in context and according to time parameters.

“The AI we are developing will be able to tell whether a painting shows Saint George on a horse or a bike,” said Maria Cristina Marinescu, senior researcher at BSC and coordinator of the Saint George on a Bike project. “This is not as easy as it sounds because the shapes are similar. By training it in various cultural heritage elements including the first appearance of the objects depicted and the period the painting is from, the AI algorithm would conclude that a 16th century painting of Saint George would logically depict a horse rather than a bike.”

Of course, humans could analyse and add descriptive information to every painting manually. However, the sheer number of images that would need annotations make the size of the task unrealistic. BSC´s MareNostrum 4 supercomputer provides the compute power necessary to process large volumes of AI-created data for the automatic descriptions.

Researchers in digital humanities will be able to benefit from the project´s work by using the rich metadata for statistical and symbolic analyses, among others. It will also be useful for mapping events reflected in cultural artifacts, such as social movements and historical events.

There are also advantages for users of cultural heritage websites like Europeana, which will serve as the initial test-bed for the metadata enrichments generated by the project. Visitors will soon be able to expect a richer browsing and discovery experience when accessing their archives.

About Saint George on a Bike
Co-financed by the Connecting Europe Facility of the European Union, Saint George on a Bike´s main objective is to provide high-performance metadata enrichment capability by using HPC resources in the cultural heritage domain. The project runs from 1 September 2019 to 31 August 2022 with a budget of nearly €1.5M.

For more information
Visit the project website: https://saintgeorgeonabike.eu
Contact Rose Gregorio (BSC): rose.gregorio@bsc.es

 

Leave a Reply


Related Articles

Towards an Automated Art? Learning Machines, Human Creativity and Uncertainty
  International Conference "Towards an Automated Art? Learning Machines, Human Creativity and Uncertainty” is announced. The conference will take place in Lisbon (Portugal) on 24 May, 2024. The event aims to provide a space for interdisciplinary discussion, bringing together different perspectives on the interaction between creative practices and digital technologies, with a particular emphasis on the still uncertain impact of AI on contemporary arts. While images a...
Webinar: Dreaming of AI: Perspectives on AI Use in Cultural Heritage
BPOC - BALBOA PARK ONLINE COLLABORATIVE is facilitating another open discussion on the use of AI in cultural heritage. In this session, we have invited Kerry Kennedy, Public Art Coordinator with the DC Commission on the Arts and Humanities, and Dr. Eve Zucker, Sociocultural Anthropologist, to open up our conversation. Kerry and Eve will talk about their work, AI's role and impact, and ethical considerations in the first part of the webinar. In the second part, audience members will be invited...
Europeana Digital Storytelling Festival 2024
  Join the Digital Storytelling Festival 2024 online on May 21-22, 2024, from 9 AM to 2 PM. Organized annually by the Europeana Initiative, the international event encourages cultural heritage professionals, educators, creatives, and students from Europe and beyond to boost their storytelling skills and tell stories exploring culture. The two-day event of talks, showcases and hands-on workshops aims to inspire participants to create connections between art, culture and hist...
How the EUreka3D project supports 3D in the data space for cultural heritage – a new blog post on Eu...
  3D technologies offer opportunities to broaden access to culture, preserve our shared cultural heritage and spur creativity and innovation. In support of the Twin It! 3D for Europe’s culture campaign, the EUreka3D project tells us how they are supporting cultural heritage institutions to unlock the potential of 3D digitisation for their collections. Discover how with the blog post recently published on Europeana Pro The post offers a very interesting opportunity to explor...