Digital dark age

Digital dark age is a possible future situation where it will be difficult or impossible to read historical documents, because they have been stored in an obsolete digital format. The name derives from the term "Dark Ages" in the sense that there would then be a relative lack of written record.

About

An early mention of the term was at a conference of the International Federation of Library Associations and Institutions (IFLA) in 1997.^[1] The term was also mentioned in 1998 at the Time and Bits conference,^[2][3] which was co-sponsored by the Long Now Foundation and the Getty Conservation Institute.

The problem is not limited to text documents, but applies equally to photos, video, audio and other kinds of electronic documents. The concern leading to the use of the term is that documents are stored on physical media which require special hardware in order to be read and that this hardware will not be available in a few decades from the time the document was created. For example, it is already the case that disk drives capable of reading 5¼-inch floppy disks are not readily available.^{[citation needed]}

The Digital Dark Age also applies to the problems which arise due to obsolete file formats. In this case it is the lack of the necessary software which causes problems when retrieving stored documents.^{[citation needed]} This is especially problematic when proprietary formats are used, in which case it might be impossible to write appropriate software to read the file.

A famous real example is with NASA, whose early space records were suffering from a Dark Age issue: for over a decade, magnetic tapes from the 1976 Viking Mars landing were unprocessed. When later analyzed, the data was unreadable as it was in an unknown format and the original programmers had either died or left NASA. The images were eventually extracted following many months of puzzling through the data and examining how the recording machines functioned.^[4]

Another example is the BBC Domesday Project in which a survey of the nation was compiled 900 years after the Domesday Book was published. While the information in the Domesday Book is still accessible today, there were great fears that the discs of the Domesday Project would become unreadable as computers capable of reading the format had become rare and drives capable of accessing the discs even rarer. However the system was emulated in 2002 using a system called DomesEm by the CAMiLEON project. This allows the information on the discs to be accessed on modern computers.^[5]

Encrypted data may also prove to be an issue, as the process needed to decode the data is intentionally made as obscure as possible. Historically encrypted data is quite rare but even the very simple means available throughout history have provided many examples of documents that can only be read with great effort. For example, it took the capacity of a distributed computing project to break the mechanically generated code of a single brief World War II submarine tactical message.^[6] Modern encryption is being used in many more documents and media due to publishers wanting the promised protections of DRM. This very widespread use of encryption closes down several of the routes (e.g.: Forgotten in the attic) by which the last few copies of documents and media that are later deemed to be historically significant can be recovered.^{[citation needed]}

Prevention

In 2007, Microsoft created a partnership with The National Archives of the United States of America to prevent the digital dark age and "unlock millions of unreadable stored computer files". This involves moving files from their old proprietary formats to their open format Open XML.^[7][8][9]

The Internet Archive has stated that one of their goals is to prevent the digital dark age.^[10]

One approach is open source, where the source code for reading and writing a file format is open. In 2007 the chief information officer of the UK's National Archives stated "We welcome open-source software because it makes our lives easier".^[11]

See also

• Digital Continuity
• Digital obsolescence
• Digital preservation

References

1. ^ Kuny, Terry (September 1997). "A Digital Dark Ages? Challenges in the Preservation of Electronic Information" (PDF). 63RD IFLA (International Federation of Library Associations and Institutions) Council and General Conference. http://archive.ifla.org/IV/ifla63/63kuny1.pdf. Retrieved 2011-11-07. 
2. ^ MacLean (1999). MacLean, Margaret & Davis, Ben. ed. Time and Bits, Managing Digital Continuity. Getty. ISBN 978-0-89236-583-8. 
3. ^ Brand, Stewart (1 February 1999). "Escaping The Digital Dark Age". Library Journal 124 (2): 46–49. ISSN 0363-0277. Archived from the original on 23 September 2005. http://web.archive.org/web/20050923024519/http://library.colstate.edu/libr1105/kramer/cadeau/deadm2.html. 
   
4. ^ Sandra Blakeslee: Lost on Earth: Wealth of Data Found in Space, New York Times, March 20, 1990
5. ^ McKie, Robin; Thorpe, Vanessa (3 March 2002). "Digital Domesday Book lasts 15 years not 1000". The Observer. http://www.guardian.co.uk/uk/2002/mar/03/research.elearning. 
6. ^ Wearden, Graeme (27 February 2006). "Distributed computing cracks Enigma code". CNET News. Archived from the original on December 19, 2010. http://www.webcitation.org/5v6Esfshc. 
7. ^ Kennedy, Maev (Wednesday 4 July 2007). "National Archive project to avert digital dark age". News:Technology (The Guardian). http://www.guardian.co.uk/technology/2007/jul/04/news.uknews. Retrieved 2009-10-07. 
8. ^ Ferguson, Tim (5 July 2007). "Microsoft Helps Archives Save the Past". Technology. Business Week. http://www.businessweek.com/globalbiz/content/jul2007/gb2007075_877434.htm. Retrieved 2009-10-07. 
9. ^ Colvile, Robert (5 July 2007). "How to stave off a digital 'dark age'". Telegraph. http://www.telegraph.co.uk/technology/3353826/How-to-stave-off-a-digital-dark-age.html. Retrieved 2009-10-07. 
10. ^ About the Internet Archive
11. ^ Donoghue, Andrew (19 July 2007). "Defending against the digital dark age". ZDNet. http://www.zdnet.co.uk/news/it-strategy/2007/07/19/defending-against-the-digital-dark-age-39288099/. 

External links

• Digital Dark Ages article at LISWiki, a Library science wiki
• Coming Soon A Digital Dark Age - CBS News
• How huge quantities of data are rapidly falling into a black hole - Guardian Unlimited
• The digital Dark Age - The Sydney Morning Herald
• A Digital Dark Ages? Challenges in the Preservation of Electronic Information (PDF)