For the new image-based similarity search the MDZ trained a system based on artificial intelligence (AI) by means of selected examples. The AI system can transfer this acquired "knowledge" to new examples that it has not yet seen. In the case of bavarikon, the system was trained to recognise and classify individual depictions and image sections within the voluminous stock of images and books. Relevant image segments are recognised by the trained neural network – an artificial brain, so to speak – and are categorized on the basis of the training, for example as an illustration, a miniature, a coat of arms or a person.
For the training of the AI, the Bayerische Staatsbibliothek set up a new ultra-high-performance technical infrastructure. It is capable of executing the computing-intensive processes for the more than three million images contained in bavarikon within an adequate amount of time.
The new search tool makes searching images an inspiring experience, for it complements the classic text search and goes far beyond at the same time. There are three search options available: searching for images that are similar to an image uploaded by the user, searching for images that are similar to a given bavarikon object and various curated search examples, which lead into the depths of the bavarikon contents.
Subsequently, various filters can be used to refine the search result. Thus, it is possible to also locate such images or image details which cannot be found at first glance among the over 450,000 digital cultural objects in bavarikon.
The next step will be particularly exciting: The Bayerische Staatsbibliothek will shortly let the new image-based similarity search loose on its Digital Collections, which comprise four million digitized items. These contain over 60 million (!) image elements, which are then checked for similarities in a matter of seconds.
Director General Klaus Ceynowa: "The newly developed, AI-based image similarity search in bavarikon is second to none of the online services of German cultural institutions, and is hence unique for a regional portal in Germany. At the same time, it is a good practise example for a sensible use of AI in the cultural area in particular."
Image-based similarity search in bavarikon:
https://www.bavarikon.de/imagesimilarity
Image material
Image material available at
https://syncandshare.lrz.de/getlink/fi4RbBFy6akQso81PrUR24/
Picture credits: Bayerische Staatsbibliothek, Munich
Press release for download
Press release (PDF, 116 MB) (in German)
Contact
Dr. Markus Brantl
Bayerische Staatsbibliothek
Digital Library and Bavarica
Ludwigstrasse 16, 80539 Munich
Phone +49 89 28638-2394
markus.brantl@bsb-muenchen.de
Ulrike Rehusch
D/Communication
Phone +49 89 28638-2057
presse@bsb-muenchen.de
About the Bayerische Staatsbibliothek
Founded in 1558 by Duke Albrecht V, the Bayerische Staatsbibliothek, which holds 37 million media units, is the largest scholarly universal library in Germany and one of the most important heritage institutions worldwide. With over four million digitized works, the Bayerische Staatsbibliothek holds the largest digital data stock of all German libraries. The library offers a broad variety of services in the field of innovative digital use scenarios. In addition, it acts as the technical and editorial operator of the Bavarian state's cultural portal bavarikon and of the Literaturportal Bayern, as well as the technical operator of the official announcement platform of the Free State of Bavaria.