HACKER Q&A
📣 datahoarder423

What is your solution for long term data preservation?


What is your current solution for secure long-term storage (>10 years) of rarely accessed data? It is about project and experimental data.

I've checked out NAS solutions with mirroring via RAID, but found too many reports of complete data loss (due to failing box, controller) online to consider them secure. Given all the media center apps they come with I'm also questioning whether I'm even in their target market. Also there is the theoretical problem of ransomware wiping the thing.

Is tape manageable for private use, and are there any go-to solutions?

What about cloud storage with too-big-to-fail companies (S3 buckets)? It sounds good to have access from everywhere without carrying some box around. It is not needed to keep the data private but I'd prefer it.


  👤 PaulHoule Accepted Answer ✓
Most people think Amazon S3 is a bit pricey but you can't get anything more durable at any price. If you only need to get at the data occasionally and can wait a while to get at it,

https://aws.amazon.com/s3/storage-classes/glacier/

helps with the pricing (about $1 per TBĂ—month The one problem you have is that you have to make sure the bill gets paid.

Another option is optical disks. A blu-ray drive is about $60. See

https://www.networkworld.com/article/3638116/why-aren-t-opti...

and

https://en.wikipedia.org/wiki/Optical_media_preservation

I've recently read CDs I burned in the 1990s and DVDs in the early 2000s. I've seen discs other people burn (particularly Chinese) sometimes get "rot" (dark spots) within months but I haven't had it happen to discs I burn.

LTO tape has taken over

https://en.wikipedia.org/wiki/Linear_Tape-Open

the drives for the newest standard are always crazy expensive, but you can get drives for an old version of LTO for less on Ebay. Tapes are available and affordable in terms of $/TB so long as there isn't a patent war between tape manufacturers.


👤 sysadm1n
I have backup data stored on two MDISCS[0]. I keep them away from sunlight and store them in airtight Tupperware to avoid oxygen damage. Apparently they're supposed to last 1000 years.

[0] https://en.wikipedia.org/wiki/M-DISC


👤 aborsy
Two ZFS pools on geographically separate machines should do the trick.

👤 Helmut10001
Self-hosted ZFS pool with Raid z2 (and regular scrubs and offline backups)