Will We Ever Solve the Problem of Losing Data?
hubie writes:
More and more, our data-private photos, work documents, confidential information, and so on-are migrating to digital clouds and platforms. In a more recent and perhaps controversial turn of events, some gaming firms are pushing for digital downloads in lieu of physical CDs.
One recurring argument against digital options has been that it's not as "permanent" as their physical counterparts. After all, aren't physical storage systems safer from the whims of a tech firm wiping your cloud storage-or, even worse, forcing you to choose a subscription plan?
But CDs break. Books burn. USBs go defunct. Personally, I-a stickler for physical media-have a very bad track record of breaking my game chips and scratching my movie discs. There are real challenges in dealing with physical storage systems, too, and big players like Microsoft are investing significant resources to overcome the inevitable decay caused by, well, the passage of time.
[...] The following responses may have been lightly edited for length and clarity.
Mohiuddin Ahmed, Computer scientist, Adelaide University, Australia.
Data storage is a contextual matter. Given the transient nature of everything around us, permanent data storage is some sort of a myth at this stage. That said, multiple copies of data and moving them to a new storage every couple of years can be thought of as a practical solution toward permanent data storage.
Francesca Musiani, Research director, Center for Internet and Society at the National Center for Scientific Research, France.
I find the idea of "permanent" data storage quite elusive, not only in our digital "era." Every medium we have ever invented eventually fails, from stone inscriptions that erode to paper burning, CDs' "disc rot" and solid-state drives that gradually lose stored charge. Further, even if a storage medium could survive for centuries, the devices and software needed to read it may not; a perfectly preserved floppy disk is of little use if no one can build or maintain a compatible drive. In this sense, data loss is a techno-historical problem, I would say: preserving information requires preserving the means of interpreting it.
[...]
Jack Cushman, Director, Library Innovation Lab at Harvard Law School; creator of the Public Data Project.
I know of one data storage form that can be permanent: a library. Or rather, a world full of libraries. Libraries aren't perfect storage devices (nothing is), but they are fiercely committed to self-repair. A good library is a collection of people, technologies, and practices that pass an obligation-to remember the things we must remember-from the last generation to the next.
Libraries, rather than better hard drives, are what solve correlated failure, cataloged in the LOCKSS (Lots Of Copies Keep Stuff Safe) threat model. A correlated failure is when you make really great, durable copies of the data you care about, and then they all get hit by an asteroid. Shouldn't have had them all in one physical location. Or a hacker marks them all for deletion (they were all behind one sysadmin), or a government orders them all destroyed (all in one regulatory regime), or they all rot at the same time (all from one flawed batch), or the money to store them dries up (all on one funding source).
On a long enough timeline any copy will break. You need multiple copies with different vulnerabilities so they don't all break at the same time. Then you need to repair the broken ones. A worldwide network of libraries does the repair work, whether the objects are 30 medieval Magna Carta manuscripts or 300,000 government datasets.
[...]
Read more of this story at SoylentNews.