Leveraging the power of AI for European cultural heritage

Share

AI will now be well-versed in cultural heritage due to a new EU-funded project called Saint George on a Bike. Composed of researchers from the Barcelona Supercomputing Center (BSC) and Europeana Foundation, the project has begun training natural language processing and deep learning algorithms in culture, symbols, and historical context with the aim of automatically generating rich metadata for hundreds of thousands of images from various European cultural heritage repositories.

Training AI to be aware of cultural heritage contexts is not as simple as teaching it to identify different objects in a picture. Saint George on a Bike is fine-tuning the algorithms so that it “thinks” in context and according to time parameters.

“The AI we are developing will be able to tell whether a painting shows Saint George on a horse or a bike,” said Maria Cristina Marinescu, senior researcher at BSC and coordinator of the Saint George on a Bike project. “This is not as easy as it sounds because the shapes are similar. By training it in various cultural heritage elements including the first appearance of the objects depicted and the period the painting is from, the AI algorithm would conclude that a 16th century painting of Saint George would logically depict a horse rather than a bike.”

Of course, humans could analyse and add descriptive information to every painting manually. However, the sheer number of images that would need annotations make the size of the task unrealistic. BSC´s MareNostrum 4 supercomputer provides the compute power necessary to process large volumes of AI-created data for the automatic descriptions.

Researchers in digital humanities will be able to benefit from the project´s work by using the rich metadata for statistical and symbolic analyses, among others. It will also be useful for mapping events reflected in cultural artifacts, such as social movements and historical events.

There are also advantages for users of cultural heritage websites like Europeana, which will serve as the initial test-bed for the metadata enrichments generated by the project. Visitors will soon be able to expect a richer browsing and discovery experience when accessing their archives.

About Saint George on a Bike
Co-financed by the Connecting Europe Facility of the European Union, Saint George on a Bike´s main objective is to provide high-performance metadata enrichment capability by using HPC resources in the cultural heritage domain. The project runs from 1 September 2019 to 31 August 2022 with a budget of nearly €1.5M.

For more information
Visit the project website: https://saintgeorgeonabike.eu
Contact Rose Gregorio (BSC): rose.gregorio@bsc.es

 

Leave a Reply


Related Articles

[Webinar] Art, AI and Everything Else
For over two decades, Art Center Nabi in Seoul has been committed to exploring the role of the arts and new technologies to gain new insight in human possibilities and addressing social problems. Nabi has invited artists to develop projects that use technology to overcome social divisions, counter to racial violence, debunk stereotypes, as well as nurture emotional connectedness, cultural engagement, political participation. In general, it has promoted the role of the arts in enhancing socia...
Digital Transformation for User Engagement in Cultural Heritage
This unique webinar organized by Photoconsortium in collaboration with Europeana and the Cyprus University of Technology was proposed in the contex of the EUROMED 2020 webconference. A capacity building workshop dedicated to Cultural Heritage Institutions looking at new opportunities offered by Digital Heritage collections and technological tools for getting closer to their existing network and for engaging with new audiences. Digital Transformation for User Engagement in Cultural Heritag...
GIF IT UP 2020
Throughout October, GIF-makers, history nuts, culture enthusiasts, and Internet fans are invited to take part in GIF IT UP 2020, the latest edition of the annual contest hosted by Europeana that challenges people to create animated cultural heritage images and share them online. GIF IT UP is a great and fun way to demonstrate how digital tools can foster culture and creativity. This year, it’s more relevant than ever as we all spend so much more of our lives online. The internet is where we now ...
Europeana 2020: Crisis, Change and Culture
2020 is not the year we thought it was going to be. A global pandemic has changed our day-to-day lives. The Covid crisis has brought home how connected our lives are across the globe, while the injustices and societal inequalities that exist between them have been thrown into sharp relief. This demands a response from us. Above all, this year has shown us that we need to build more coherent, coordinated and effective approaches to dealing with the challenges facing society, whether it is a short...