Image-based similarity search in bavarikon:
https://www.bavarikon.de/imagesimilarity

For the new image-based similarity search the MDZ trained a system based on artificial intelligence (AI) by means of selected examples. The AI system can transfer this acquired "knowledge" to new examples that it has not yet seen. In the case of bavarikon, the system was trained to recognise and classify individual depictions and image sections within the voluminous stock of images and books. Relevant image segments are recognised by the trained neural network – an artificial brain, so to speak – and are categorized on the basis of the training, for example as an illustration, a miniature, a coat of arms or a person.

For the training of the AI, the Bayerische Staatsbibliothek set up a new ultra-high-performance technical infrastructure. It is capable of executing the computing-intensive processes for the more than three million images contained in bavarikon within an adequate amount of time.

The new search tool makes searching images an inspiring experience, for it complements the classic text search and goes far beyond at the same time. There are three search options available: searching for images that are similar to an image uploaded by the user, searching for images that are similar to a given bavarikon object and various curated search examples, which lead into the depths of the bavarikon contents.

Subsequently, various filters can be used to refine the search result. Thus, it is possible to also locate such images or image details which cannot be found at first glance among the over 450,000 digital cultural objects in bavarikon.

The next step will be particularly exciting: The Bayerische Staatsbibliothek will shortly let the new image-based similarity search loose on its Digital Collections, which comprise four million digitized items. These contain over 60 million (!) image elements, which are then checked for similarities in a matter of seconds.

Director General Klaus Ceynowa:

The newly developed, AI-based image similarity search in bavarikon is second to none of the online services of German cultural institutions, and is hence unique for a regional portal in Germany. At the same time, it is a good practise example for a sensible use of AI in the cultural area in particular.

Press release for download  (PDF, 116 MB)  (in German)

Contact

Dr. Markus Brantl
Bayerische Staatsbibliothek
Digital Library and Bavarica
Ludwigstrasse 16, 80539 Munich
Phone  +49 89 28638-2394
markus.brantl@bsb-muenchen.de

Ulrike Rehusch
D/Communication
Phone  +49 89 28638-2057
presse@bsb-muenchen.de