Leveraging the power of AI for European cultural heritage

Share

AI will now be well-versed in cultural heritage due to a new EU-funded project called Saint George on a Bike. Composed of researchers from the Barcelona Supercomputing Center (BSC) and Europeana Foundation, the project has begun training natural language processing and deep learning algorithms in culture, symbols, and historical context with the aim of automatically generating rich metadata for hundreds of thousands of images from various European cultural heritage repositories.

Training AI to be aware of cultural heritage contexts is not as simple as teaching it to identify different objects in a picture. Saint George on a Bike is fine-tuning the algorithms so that it “thinks” in context and according to time parameters.

“The AI we are developing will be able to tell whether a painting shows Saint George on a horse or a bike,” said Maria Cristina Marinescu, senior researcher at BSC and coordinator of the Saint George on a Bike project. “This is not as easy as it sounds because the shapes are similar. By training it in various cultural heritage elements including the first appearance of the objects depicted and the period the painting is from, the AI algorithm would conclude that a 16th century painting of Saint George would logically depict a horse rather than a bike.”

Of course, humans could analyse and add descriptive information to every painting manually. However, the sheer number of images that would need annotations make the size of the task unrealistic. BSC´s MareNostrum 4 supercomputer provides the compute power necessary to process large volumes of AI-created data for the automatic descriptions.

Researchers in digital humanities will be able to benefit from the project´s work by using the rich metadata for statistical and symbolic analyses, among others. It will also be useful for mapping events reflected in cultural artifacts, such as social movements and historical events.

There are also advantages for users of cultural heritage websites like Europeana, which will serve as the initial test-bed for the metadata enrichments generated by the project. Visitors will soon be able to expect a richer browsing and discovery experience when accessing their archives.

About Saint George on a Bike
Co-financed by the Connecting Europe Facility of the European Union, Saint George on a Bike´s main objective is to provide high-performance metadata enrichment capability by using HPC resources in the cultural heritage domain. The project runs from 1 September 2019 to 31 August 2022 with a budget of nearly €1.5M.

For more information
Visit the project website: https://saintgeorgeonabike.eu
Contact Rose Gregorio (BSC): rose.gregorio@bsc.es

 

Leave a Reply


Related Articles

Europena 2022: Making digital culture count
From 28 to 30 September the annual Europeana conference will take place in a hybrid format: online and on-site at the KB, National Library of the Netherlands in The Hague. It will be a three-day event to learn, explore and deepen various aspects of digital cultural heritage: Wednesday 28 September, Making digital culture count: perspectives and provocations on the data space for digital cultural heritage: to explore the data space in practice. Thursday 29 September, Making digital cul...
Consultation on “Youth for the Future of Cultural Heritage in Europe” by Europa Nostra and its youth...
Europa Nostra and its partner organisations working with youth in cultural heritage are launching a wide consultation on “Youth for the Future of Cultural Heritage in Europe” as a contribution to the European Year of Youth 2022. The consultation is developed in collaboration with the European Students’ Association for Cultural Heritage (ESACH), the Erasmus Student Network (ESN), the European Heritage Tribune (EHT), The Future is Heritage, Europeana Initiative Diversity & Inclusion...
Meet WEAVE Team: Europeana Foundation
Europeana is Europe’s platform for digital cultural heritage, empowering cultural heritage institutions to share their collections with the world.  Through the Europeana website, millions of cultural heritage items from around 4,000 institutions across Europe are available online. We work to share and promote this heritage so that it can be used and enjoyed by people across the world.  Our work contributes to an open, knowledgeable and creative society.  The Europeana Foundation is the organi...
Meet WEAVE Team: ThinkCode
ThinkCode is a start-up company which designs and develops custom intelligent solutions and high-end software products by adopting and applying cutting-edge technology in the area of Artificial Intelligence into real- word applications. Consisting of people with strong research and industrial background, ThinkCode provides AI-enabled services that span a great range of applications such as Image Annotation, Sentiment Analysis, and Metadata Enrichment. In addition, by implementing the groundbreak...