Leveraging the power of AI for European cultural heritage

Share

AI will now be well-versed in cultural heritage due to a new EU-funded project called Saint George on a Bike. Composed of researchers from the Barcelona Supercomputing Center (BSC) and Europeana Foundation, the project has begun training natural language processing and deep learning algorithms in culture, symbols, and historical context with the aim of automatically generating rich metadata for hundreds of thousands of images from various European cultural heritage repositories.

Training AI to be aware of cultural heritage contexts is not as simple as teaching it to identify different objects in a picture. Saint George on a Bike is fine-tuning the algorithms so that it “thinks” in context and according to time parameters.

“The AI we are developing will be able to tell whether a painting shows Saint George on a horse or a bike,” said Maria Cristina Marinescu, senior researcher at BSC and coordinator of the Saint George on a Bike project. “This is not as easy as it sounds because the shapes are similar. By training it in various cultural heritage elements including the first appearance of the objects depicted and the period the painting is from, the AI algorithm would conclude that a 16th century painting of Saint George would logically depict a horse rather than a bike.”

Of course, humans could analyse and add descriptive information to every painting manually. However, the sheer number of images that would need annotations make the size of the task unrealistic. BSC´s MareNostrum 4 supercomputer provides the compute power necessary to process large volumes of AI-created data for the automatic descriptions.

Researchers in digital humanities will be able to benefit from the project´s work by using the rich metadata for statistical and symbolic analyses, among others. It will also be useful for mapping events reflected in cultural artifacts, such as social movements and historical events.

There are also advantages for users of cultural heritage websites like Europeana, which will serve as the initial test-bed for the metadata enrichments generated by the project. Visitors will soon be able to expect a richer browsing and discovery experience when accessing their archives.

About Saint George on a Bike
Co-financed by the Connecting Europe Facility of the European Union, Saint George on a Bike´s main objective is to provide high-performance metadata enrichment capability by using HPC resources in the cultural heritage domain. The project runs from 1 September 2019 to 31 August 2022 with a budget of nearly €1.5M.

For more information
Visit the project website: https://saintgeorgeonabike.eu
Contact Rose Gregorio (BSC): rose.gregorio@bsc.es

 

Leave a Reply


Related Articles

Europeana Copyright Office Hours
Copyright and policy office hours are informal online sessions that seek to bring cultural heritage professionals together in discussing and addressing common challenges. On September 16th, 15-16:00 CET, professionals will talk about various examples of cultural heritage organisations measuring risk, and some tools available. As cultural heritage institutions need to comply with copyright law, among other areas, they are faced with a lot of legal uncertainty. Just like any other area of law...
EUreka3D-XR pilot scenario in Girona moving forward into production
EUreka3D-XR partner Swing:IT Software Engineering Italia S.r.l. team met CRDI Ajuntament de Girona for two fruitful days of work, planning and progressing on the virtual visualisation of the Girona historical walls, one of the three XR scenarios developed in the project. The pilot is about using archival materials to reconstruct in 3D the medieval walls of the city of Girona (Catalonia, Spain); and to reuse such reconstruction for an AR walking tour using a mobile device. The walls we...
EUreka3D-XR Advisory Board meets online
EUreka3D-XR engages with renowned international experts on 3D, cultural heritage documentation, storytelling and visitor experience in AR and XR. This Advisory Board is regularly consulted on project progress, and during the plenary meeting held online on 7-8 July 2025 a dedicated session was organized, to present the early achievements of the pilot scenarios and XR tools that the project is developing. After an opening overview by project coordinator Antonella Fresa (Photoconsortium), joint ...
Food and Fairytale - creative writing workshop
Organized by Europeana, this creative writing  workshop will use illustrations and imagery from the collections available on Europeana.eu to explore the relationship between fairy tales and food. Anyone can participate, and no previous experience is required. After some warm up exercises you will able to write your story with no obligation to share it. Regiter  and find more information here.