{"id":1621,"date":"2025-03-31T11:28:25","date_gmt":"2025-03-31T09:28:25","guid":{"rendered":"https:\/\/hermann.lewetz.at\/?page_id=1621"},"modified":"2025-05-09T12:52:47","modified_gmt":"2025-05-09T10:52:47","slug":"digitale-langzeitarchivierung","status":"publish","type":"page","link":"https:\/\/hermann.lewetz.at\/en\/digitale-langzeitarchivierung\/","title":{"rendered":"digital longterm archiving"},"content":{"rendered":"
<\/div>\n\n\n\n

digital longterm archiving<\/h2>\n\n\n\n
\n

Our desire for infinitely durable carriers and formats for our archive holdings will not be fulfilled now or in the foreseeable future. The only option for preserving our audiovisual holdings is therefore the concept of \"eternal migration\". This means that the recordings must be migrated an infinite number of times, from carrier to carrier, from format to format, in order to preserve them forever.
This can only work if these migrations get carried out absolutely loss-free. Even with the slightest loss during these processes, the recordings lose more and more quality with the number of migrations. Images, sounds and data disappear. Our collections ultimately get lost.
The task of digital long-term archiving is to create the necessary conditions to ensure that this does not happen.<\/p>\n\n\n\n

In the 20 years that I have been working at the Austrian Mediathek, together with Peter Bubestinger I have developed a system for managing video digitisation workflows (DVA-Profession, see below) , which has been successfully in use there since 2010. As a further innovation, we designed and implemented the hardware and software-optimised storage system for archiving purposes (DLP, see below).<\/p>\n\n\n\n

<\/div>\n<\/div>\n\n\n\n
<\/div><\/span>
\n

DVA-Profession<\/p>\n<\/div><\/div>\n\n\n\n

\n
\n
\n
\"\"<\/figure>\n\n\n\n

In 2009, I had the opportunity to finally start digitising video as part of a project in which the Austrian Mediathek was to put 1000 video recordings on the web and digitise them as a prerequisite. I began to research the technical possibilities. At that time, there was only one format on everyone's lips in the international circle of AV archives for archiving video besides the uncompressed option: MXF<\/a> (container) with Motion JPEG 2000<\/a> (codec)<\/p>\n\n\n\n

The only system I knew of at the time that managed a digitisation workflow (metadata, checksum, analysis, packaging for the archive, etc.) and wrote such a format was \"SAMMA Solo\".
I had therefore included the purchase of such a device in the calculation for the project.<\/p>\n\n\n\n

After the project had actually been approved, more detailed tests with original files from the Samma-Solo of the Austrian Phonogrammarchiv made me realise that I could only play back or convert these files on the original device.<\/p>\n\n\n\n

This is a \"no go\" for any idea of long-term archiving.<\/p>\n\n\n\n

Auf der Suche nach Alternativen erwies sich der Open Source Codec FFV1<\/a> als sinnvolle L\u00f6sung.
As this codec was not supported by any digitisation system, Peter Bubestinger and I developed our own system called \"DVA-Profession\".<\/p>\n\n\n\n

DVA-Profession is a system that defines, executes and documents the entire digitisation workflow through to correct storage in the archive repository. The process is broken down into individual steps, some of which are automated and some of which wait for manual input (e.g. final check). Automation serves not only to make work easier, but above all to standardise as many work steps as possible.<\/p>\n\n\n\n

Urspr\u00fcnglich als Testerin stie\u00df Marion Jaks in das Team und bereicherte von da an das Konzept mit bodenst\u00e4ndigen Vorschl\u00e4gen f\u00fcr einfacher nachvollziehbare Bedienungsfunktionen.<\/p>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n

<\/div>\n\n\n\n
<\/div><\/span>
\n

DLP-Storage<\/p>\n<\/div><\/div>\n\n\n\n

\n

The question of storage costs plays an existential role for the budget of an archive, especially when archiving digital video assets.
These costs are divided into hardware costs for physical storage and costs for the software that manages the data. Many solutions offered on the market are only available as a package of both areas.
At the same time, data management is often sold with volume-based licences.
Providers also primarily serve the market sector where large budgets are available (banks, insurance companies, broadcasters). Here, high availability is an important criterion. This cost-driving characteristic is less important for average audiovisual archives. A temporary outage is easier to cope with there. Any measure that ensures that the data is available again completely and unchanged after a restart is more important.<\/p>\n\n\n\n

In order to reduce the costs to the features that are important for the archive, Peter Bubestinger and I developed the configuration for a cost-effective yet stable hardware solution for the Austrian Mediathek in collaboration with the companies Linforge<\/a>, Anyfer<\/a> and 45Drives<\/a>. For the administration, we developed a concept that took into account all known requirements for digital long-term archiving - including the option of replacing it with a future system.<\/p>\n\n\n\n

Die Kosten haben sich dadurch extrem reduziert. Vorher war es in der \u00d6sterreichischen Mediathek aus Budgetgr\u00fcnden nicht realistisch, an ein Petabyte auch nur zu denken.<\/p>\n<\/div>","protected":false},"excerpt":{"rendered":"

Digitale Langzeitarchivierung Unser Wunsch nach unendlich haltbaren Tr\u00e4gern und Formaten f\u00fcr unsere Archivbest\u00e4nde wird weder jetzt noch in absehbarer Zukunft in Erf\u00fcllung gehen. F\u00fcr die Erhaltung unserer audiovisuellen Best\u00e4nde bleibt daher nur das Konzept der „ewigen Migration“. Das bedeutet, dass die Aufnahmen unendlich oft, von Tr\u00e4ger zu Tr\u00e4ger, von Format zu Format, migriert werden m\u00fcssen, […]<\/p>","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1621","page","type-page","status-publish","hentry"],"blocksy_meta":[],"_links":{"self":[{"href":"https:\/\/hermann.lewetz.at\/en\/wp-json\/wp\/v2\/pages\/1621","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hermann.lewetz.at\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/hermann.lewetz.at\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/hermann.lewetz.at\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hermann.lewetz.at\/en\/wp-json\/wp\/v2\/comments?post=1621"}],"version-history":[{"count":17,"href":"https:\/\/hermann.lewetz.at\/en\/wp-json\/wp\/v2\/pages\/1621\/revisions"}],"predecessor-version":[{"id":2204,"href":"https:\/\/hermann.lewetz.at\/en\/wp-json\/wp\/v2\/pages\/1621\/revisions\/2204"}],"wp:attachment":[{"href":"https:\/\/hermann.lewetz.at\/en\/wp-json\/wp\/v2\/media?parent=1621"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}