So I humbly ask the hivemind:
- what are good solutions for storing personal backup on-site (other than a bunch of external hard drives)?
- What are some caveats that I should avoid?
- Can I trust the 'standard' companies (Synology, QNAP, Seagate, ...) to keep my data sufficiently safe?
Strong opinions, war stories, and all other suggestions are highly welcome!
The NAS gurus always say "RAID is not a backup", and it is true you should have additional backups. But no backup solution is perfect, none get updated every day, especially if you plan on keeping the backup off-site. For most users, the NAS is the backup. All I'm saying is that when a disk fails on your NAS, you'll be in panic mode and will want the easiest, most direct path to data recovery, and there is no RAID option in this scenario preferable than RAID-1.
I would make your first / boot drive a SSD, and put WD Reds in the rest, 2 drive redundancy if you want to be super safe.
In addition, I recommend using the built-in cloud backup software to backup high-value data to Blackblaze B2.
Happy to answer any other questions.
Yeah, it's slow, long in the tooth, and maybe I should replace it this year. But I'll replace it with another Synology.
Upgraded it to a Synology 918+ and haven't regretted it even once. Added an SSD for read caching, upgraded memory to 12GB a year ago. The SSD cache has a hit rate of 88%, reducing the need to hit the spinning drives as often.
The Synology Hybrid Raid (SHR) was one of the main reasons I got a Synology NAS, I started with a random assortment of drives of different sizes and it just made a volume with those. Every time I run out of space, I upgrade the smallest one and tell the NAS to expand the volume. It just works.
Running a dozen or so Docker containers on it + native Plex package. It can even transcode video with hardware.
The only way I can realistically upgrade from that setup is to build an actual PC with Unraid or something similar and that'll be a noisy power hog unless I spend mucho $$ on it.
Without knowing anything else, for a small and power-efficient setup I can recommend the Odroid HC4 with Armbian (manually upgraded to Bullseye; Bullseye builds are currently broken but building Buster and then upgrading works fine) and a ZFS mirror of whatever SATA drives you choose. I use one as a backup sink.
https://www.hardkernel.com/shop/odroid-hc4/
As for drives, I've been committing myself for Toshiba recently. They have a good reputation for reliability/durability and reasonable cost-performance.
If you're going for SSDs, that market segment is in a bit of constant flux.
For something beefier and way more extendable I've been writing about my experiences with ASROCK RACK's X570 boards here: https://news.ycombinator.com/item?id=28302303
Though, from what I understand you may get lower idle power consumption from the right Intel CPU/chipset combo than AMD Ryzens as of now. This is just something I gathered from others' remarks and not something I researched or benchmarked properly myself so take that with a grain of salt.
I never used a prebuilt QNAP/Synology but I'm curious what it is that takes time for you these days that you hope to cut down on? A DIY can be pretty much as fire-and-forget once you have it set up and on the flip side you still have plenty of room for tinkering with containers and whatnot on Synology et al... Like, is there ongoing maintenance you have to do on your FreeNAS box just to keep things in place or is it more a personal tendency to keep changing things that makes it never ending?
> What are some caveats that I should avoid?
Be very careful about SATA connectors: they're among the worst piece of junk ever designed and have an extremely low guaranteed life (literally dozens of operations, not thousands), therefore, don't think of drive bays and especially desktop "toasters" as something in which drives can be inserted and pulled every day; that would be a solution for defective contacts and data loss. Been there, done that. Twice.
> Can I trust the 'standard' companies (Synology, QNAP, Seagate, ...) to keep my data sufficiently safe?
I guess so, although sometimes there are stories about newly discovered vulnerabilities. It's also possible malicious hackers would rather direct their attack on well known products than home built systems, but that doesn't mean nobody is attempting to target our NASes. I don't have any experience with those brands, however.
As for the rest, I was also following the Helios64 project which seemed really intriguing, albeit it meant moving from *BSD to Linux (actually I am a Linux user, although I like more BSD solutions for NAS servers and firewalling). Unfortunately the project died. It's FOSS, though, hardware and software so hopefully someone will take over development and production. https://kobol.io/
As for trust, you can trust anybody for anything. Should you is a different question. I rest easy knowing there will never be an article about a product I critically rely on deciding to sell me out. And needing to navigate least-worst commercial options seems like a much larger maintenance burden.
You have carefully omitted your budget. Your budget will likely ultimately determine your options.
Otherwise I'll tell you to get a 10Gb switch and build a five node CEPH cluster. :-)
I've thrown tens of thousands of photos at it, and my only complaint there is the background processing to generate thumbnails is very slow, especially with "Live Photos" from iPhones (which are essentially photos with short videos attached). If I upload a couple thousand of those, the NAS might not finish generating the thumbnails for over day, so if you browse using the apps Synology provides for photos, you just see lots of placeholders for a while.
I did have a (SeaGate IronWolf) disk fail on me already, and the NAS did it's thing correctly - it made audible beeping alerts (which were definitely attention getting as the NAS had never played a sound prior to that). When I swapped in a new disk I was easily able to instruct the NAS to add it to the RAID array and recover, and everything was back to healthy pretty quickly.
If I were to shop for a replacement I'd be tempted to look for something with a beefier CPU as the thumbnail generation thing is occasionally annoying. But honestly the CPU is mostly idle most of the time, so if I did get a more powerful NAS the CPU would probably be idle 99.9% of the time instead of 99% of the time.
1. Intel NUC + Internal 2TB NVME SSD (24/7)
- Encrypted with LUKS
- All-Day-Data like personal Photos, Music, Audiobooks shared via SFTP / SMB
- Low Power consumption + good performance
2. Dell T20 + 32GB ECC RAM with encrypted ZFS 10TB RAID 1 (wake on lan / on demand) - FreeNAS
- Backup Server for NUC and all other clients
- ZFS Snapshots for Ransomware protection
3. Alix APU 4GB with ZFS (24/7, off site at my fathers home) - disaster backup for my most important data
- sync via zfs send with one specific dataset from machine 2
Its pretty low power, but also low on storage - it took a while to find out that the data for my all day use is < 2TB. This is often not enough for most people...I can recommend to use an cheap old machine as NAS with ECC RAM (a must) and ZFS, like a
- Dell T20
- HP N54L
- HP gen8.
OS can be FreeNAS/TrueNAS, napp-it or another reliable one. I never had problems with these and once configured, there is hardly any effort to maintain them.What I don't recommend is:
- Raspberry PI based (not reliable, slow)
- Custom build (expensive, much effort)
Soho NAS like Synology are ok-ish, but I don't like them - Bad things happend to me. Broken filesystems, damaged files, non-working backups, slow performance and so on. But that was a while ago, maybe now they are better :-)
I wanted to have a backup of my Dropbox on my NAS, so I used Synology's CloudSync service to back up to an encrypted folder. Unfortunately Synology's encryption actually encrypts each file individually, which Dropbox happily syncs to all of the computers that use that Dropbox, making all of those files unusable!
In the end, I had to write a script that detected which files were encrypted (files start with `__CLOUDSYNC_ENC__`), then use a WINDOWS ONLY decryption utility provided by Synology to decrypt and finally get back to a clean state. Then I wrote another script to move the decrypted files back into the proper path in Dropbox while correcting the newly decrypted files with the original metadata (creation date) from the encrypted bad files. What a pain!!
I'm still not sure of a good way to achieve my original goal of backing up Dropbox while still protecting my data with encryption. Let me know if anyone has a solution!
At this point i have installed it and i stopped looking around for other solutions. It works for Windows, it works for Mac, i did not try Linux, but i don't really backup my Linux data, its all in Github anyway.
Is your data safe? Definitely as safe as 2 NAS-type drives can be. Did not experience data loss, but don't trust a comment on the internet, look for some research and statistics if you can find.
RAID apparently requires drives of matching capacity. Can't create a storage pool from a heterogeneous set of drives and can't expand capacity over time by buying new drives.
Btrfs almost supports this. Their RAID5/6 parity implementation still has problems.
We bought a Synology 1813+ many years ago. I run whatever Synology’s custom RAID 6(?) solution is. We have 2 disks of redundancy, and haven’t filled all the bays. (We’re at 6/8 at 8TB total)
I’m very happy with it. We use it for local backups. I’ve swapped a few failed drives (it was easy) I run a Plex server and a photo management server on it.
I used to worry about drive portability because of the proprietary RAID. I put that aside and I’ve been happy ever since. The Portability issue hasn’t ever been a thing because I haven’t ever needed to go anywhere.
My use-cases: primary storage device for home lab, computer/phone backup server for myself and extended family, media server, self-hosted web archive, general self-hosted services.
My preferences: I don't like the direction that Synology is trending in (i.e. the same direction as Ubiquiti) / I don't like that it's proprietary. I really like the idea of using ZFS. I don't want to spend a ton of time designing building and debugging a custom system.
That leads me to the IX Systems Mini X [0], a 5+2-bay integrated system with FreeBSD-based TrueNAS OS (successor/rename of FreeNAS). One of the X+ models comes with dual 10GbE which is pretty nice for future-proofing. So my current homelab plan is:
Mini X+: 8 core, 64 GB, 2x10GbE - $1600
5x 6TB WD Red Plus (in zfs-raidz1 for 24TB net capacity) - $650
1x 480GB Kingston DC1000B M.2 PCIE-3.0 enterprise SSD
with power loss protection (PLP) as a SLOG/write-cache - $130
MikroTik RB5009UG+S+IN router-switch [1] with 1x10Gb SFP+, 1x2.5GbE, 7x1GbE - $185
Encrypted backup from NAS to rsync.net using Borg [2][3], maybe raw ZFS snapshots for certain workloads (databases).
Total: $2565
Monthly: internet - $70 (1GB) - $100 (2GB), remote backup: $10 (initial) - $80 (half capacity)
That's my current plan anyways. Feedback welcome.[0]: https://www.truenas.com/truenas-mini/
[1]: https://mikrotik.com/product/rb5009ug_s_in#fndtn-gallery
Ideally you want to follow 3-2-1 (3 total copies, 2 local, 1 offsite) for backup, so I'd recommend the following setup:
A small FreeNAS box. Like, 3 hot data drives at most, small. If you really want to save on power and are willing to take a hit on performance, you can use something as small as a raspberry pi. (again, if you don't want freenas, then swap this for anything with 2 drives that can RAID 1 and can automatically sync with backblaze or similar).
On the local PCs pick a specific folder to back-up instead of everything, since you'll only have a small backup.
Personally, I would stay away from anything that isn't ZFS backed, but i've heard good things about synology. I wouldn't trust any solution from an HDD mfg, because i don't think their code is that good for that sort of thing (eg https://www.theverge.com/2021/7/2/22561140/wd-cloud-os-3-sec...)
I always comeback to FreeNAS, which I have had configured various ways. I recently updated all my core hardware to mac mini so it has power/sleep modes that save that energy consumption...however payback is a lot longer than a PC..
In the end it will always be a challenge of performance vs. energy consumption.
- Whatever crazy tunneling and so forth that they do so that I can access the admin interface over the internet regardless of how brain-dead my home ISP router is. Synology is very good at this.
- Mobile apps that make it fairly easy to do stuff like "sync any photos after I take them to the NAS, but only when the phone is on WiFi, and optionally delete it from the phone after the sync is confirmed.".
Also worth looking at with Synology is their support for really cheap offsite backup, like Backblaze B2. I was able to set something up to protect against say, a house fire, and be selective about what I was sending, and it's something like $1/month for that peace of mind.
[1] For example, it's fairly easy to mostly brick them and the recovery process is having to send hand-crafted/altered ICMP packets to it during boot and hope that coaxes it into a BOOTP mode. They are also quite underpowered and just go unresponsive for minutes at a time. The WD products are awful all around.
My friend however wanted a no hassle solution, he brought Synology and it just works, he's never had to mess with it. To quote him: "if Apple made a NAS"
I run my own custom built ZFS for Linux server but the QNAP TS-473A interested me as officially supports ZFS and is practically a small Ryzen server in a cute form factor.
I use ZFS striped mirror (Raid 10). 4 drives, 2 mirrors in stripe mode. This gives a reasonable level of safety and performance.
This is a different NAS model, in that each hard drive has its own micro server attached. Which I like, because it means that I won't be constrained by a NAS chassis, and it mitigates a lot of single points of failure. Plus it will scale in both performance and capacity as I add drives.
The HC2 costs about 50 bucks each, so it's the cost of a drive, +$50 and some maintenance overhead to keep the small cluster running. Starting off with 2 or 4 drives it's cheaper than most comparable synology or similar traditional NAS and for my use case is far more robust and flexible.
For the hardware I use MiniITX motherboards with low power 6W TDP CPU.
Disks are 2.5 4TB or 5TB in mirror on not depending in the needs.
- https://vermaden.wordpress.com/2019/04/03/silent-fanless-fre...
- https://vermaden.wordpress.com/2018/08/28/silent-fanless-fre...
Regards.
If you want something simple and standalone that just works, buy a MacMini and a DAS.
If you need a cold storage backup server that you only boot once a month, build that.
If you want something that you can assign to a Windows domain and scale, maybe some Intel NUCs would work.
A netbooted, POE-enabled Raspberry Pi 4 or two can do quite a lot, depending on your needs.
I've use several proprietary consumer NAS products over the years, and mostly I've found they make great gifts to friends after a year or two.
That keeps the fussing with the hardware and installation issues down to an acceptable level but means that in a panic I can slam the drives onto commodity hardware and recover the data and its not locked into a proprietary format. The cost is a bit, but i figure it'll get amortized over another 10+ years.
If you want more of a "set it and forget it" simple approach, the big players you listed (Synology and others) can work amazingly well.
Today I would probably buy NAS with 4 slots to run Nextcloud.
I use Synology with one box having 4 disks in RAID5 and the second having one large disk with the most important data replicated over.
One thing that surprised me was RAID - I am not very experienced with home servers and such and was really disheartened by how much of my disk got eaten up by RAID. I was using the Synology Hybrid RAID which I think is similar to RAID 5.
TL;DR Synology is pricey but full featured and very pleasant, understand your RAID configuration before you purchase disks.
EDIT: Another thing I will say is that docker compose is not supported IIUC, so just watch out for that if your configuration depends on that (like mine initially did).