A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
Just remember if the data is important, raid is not backup. Have the media in another place. I have like 40-50 1tb drives I’ve copied stuff too in case everything goes belly up. Restoring won’t be fun but it will be possible.
If it were me personally, I’d get two more 16 tb drives and Raid 6 the whole thing. But that’s only because you’ve got the NAS already. If I just had the drives I’d set up a JBOD and either use TrieNAS, Unraid, or maybe OpenMediaVault.
I use raid5 on an HP server, and am dealing with 2 drive failures, because HP's qc is garbage. Raid6 would have saved me here, but it's not really likely to have 2 drives fail simultaneously, so... yeah.
I recommend looking into 321 backup, too. Raid isn't a backup solution, but it seems you already understand that and are trying to do that.
In the last 25 years working with approximately 700 servers that used RAID 5 I saw two of them lose an entire volume. Once was due to a malfunctioning HP RAID controller, and the other was due to a second disk dying while the rebuild from the first failure was still ongoing. There turned out to be a systemic problem with that drive model’s firmware which almost certainly contributed.
So in my experience it’s rare but it definitely does happen.
It can get worse. About 20 years ago the company I was at had an EMC tech yank the wrong power supply from a Symmetrix rack, where the other supply had earlier in the day caught fire! We lost that entire rack’s data (customer’s personal email accounts) due to data corruption. It was probably around 300 10k SCSI disks in that rack, a multimillion dollar expense at the time, and we had to restore all of it from tape over many, many days. Really, really sucked.
Odds are strongly against a 2 drive failure at your scale, though it does happen. I set my NAS up about 8 years ago, with 6 drives with raid-6 (well zfs's version) and in that time two drives have failed years apart. When you get two hundreds of drives total in your operation you will see a dual drive failure.
Though you still really should have backups of everything you care about. Even though odds are in your favor someone reading this will lose data in their life on their NAS system.
Use zfs, raid 10 the big drives, toss the 8tb, and use the ssd as a write cache.
Interesting take. I have them setup in BTRFS and use 2 m2 nvmes as read write cache in RAID 1.
This is the way to go. Way more flexible than hardware raid and getting better all the time.
In ZFS-speak, instead of RAID 10 you’ll be doing “mirrored vdevs”
Personally I'm more on the paranoid side, so I went with raid 6 and a hot spare. So in case of failure I can rebuild one disk immediately and not having to buy one first. But so far I've never had a disk failure.
In addition I was thinking of having the 8TB HDD as a standalone to backup the documents and maybe the photos and the docker setups.
That is a very good idea. I also can't quite afford to backup my main storage of movies/shows, but at least all the important personal documents (and my music) is properly backed up.
Personally I use RAID5, with regular backups for documents and projects. Not too worried if my movies and tv library get lost…that takes up most of the space though.
I'm fine with RAID5. Though I've seen the case where one drive failed and another one had several bad sectors and maybe was at the brink of failure, too. We were able to rebuild the RAID and replace both drives succesively but lost a few files. I think chances are slim, though. And even with RAID6, chances are your house burns down or lightning hits the neighborhood or a thief breaks in and takes the entire server. Or you or someone deletes stuff. So it doesn't really replace a backup in any case. I'd say RAID5 is fine for home use. Take backups of your most important files.