this post was submitted on 09 Feb 2025
63 points (95.7% liked)
Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ
56828 readers
418 users here now
⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.
Rules • Full Version
1. Posts must be related to the discussion of digital piracy
2. Don't request invites, trade, sell, or self-promote
3. Don't request or link to specific pirated titles, including DMs
4. Don't submit low-quality posts, be entitled, or harass others
Loot, Pillage, & Plunder
📜 c/Piracy Wiki (Community Edition):
🏴☠️ Other communities
Torrenting:
Gaming:
💰 Please help cover server costs.
 |
 |
|---|---|
| Ko-fi | Liberapay |
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I personally have dedicated machines per task.
8x SSD machine: runs services for Arr stack, temporary download and work destination.
4-5x misc 16x Bay boxes: raw storage boxes. NFS shared. ZFS underlying drive config. Changes on a whim for what's on them, but usually it's 1x for movies, 2x for TV, etc. Categories can be spread to multiple places.
2-3x 8x bay boxes: critical storage. Different drive geometric config, higher resilience. Hypervisors. I run a mix of Xen and proxmox depending on need.
All get 10gb interconnect, with critical stuff (nothing Arr for sure) like personal vids and photos pushed to small encrypted storage like BackBlaze.
The NFS shared stores, once you get everything mapped, allow some smooth automation to migrate things pretty smoothly around to allow maintenance and such.
Mostly it's all 10 year old or older gear. Fiber 10gb cards can be had off eBay for a few bucks, just watch out for compatibility and the cost for the transceivers.
8 port SAS controllers can be gotten same way new off eBay from a few vendors, just explicitly look for "IT mode" so you don't get a raid controller by accident.
SuperMicro makes quality gear for this... Used can be affordable and I've had excellent luck. Most have a great ipmi controller for simple diagnostic needs too. Some of the best SAS drive planes are made by them.
Check BackBlaze disk stats from their blog for drive suggestions!
Heat becomes a huge factor, and the drives are particularly sensitive to it... Running hot shortens lifespan. Plan accordingly.
It's going to be noisy.
Filter your air in the room.
The rsync command is a good friend in a pinch for data evacuation.
Your servers are cattle, not pets... If one is ill, sometimes it's best to put it down (wipe and reload). If you suspect hardware, get it out of the mix quick, test and or replace before risking your data again.
You are always closer to dataloss than you realize. Be paranoid.
Don't trust SMART. Learn how to read the full report. Pending-Sectors above 0 is always failure... Remove that disk!
Keep 2 thumb drives with your installer handy.
Keep a repo somewhere with your basics of network configs... Ideally sorted by machine.
Leave yourself a back door network... Most machines will have a 1gb port. Might be handy when you least expect. Setting up LAGG with those 1gb ports as fallback for the higher speed fiber can save headaches later too...
Your setup is closer to "statistic" than "anecdote," so curious how many drive failures you've had?
What is the primary OS you run to manage all of the components?
Most of my drives are in the 3tb/4tb range... Something about that timeframe made some reliable disks. Newer disks have had more issues really. A few boxes run some 8tb or 12tb, and I keep some external 8tb for evacuation purposes, but I don't think I trust most options lately.
HGST / Toshiba seems to have done good by me overall, but that's subjective certainly.
I have 2 Seagate I need to pull from one of the older boxes right now, but they are 2tb and well past their due:
root@Mizuho:~# smartctl -a /dev/sdc|grep "Vendor|Product|Capacity|minutes" Vendor: SEAGATE Product: ST2000NM0021 User Capacity: 2,000,398,934,016 bytes [2.00 TB] Accumulated power on time, hours:minutes 41427:43
root@Mizuho:~# smartctl -a /dev/sdh|grep "Vendor|Product|Capacity|minutes" Vendor: SEAGATE Product: ST2000NM0021 User Capacity: 2,000,398,934,016 bytes [2.00 TB] Accumulated power on time, hours:minutes 23477:56
Typically I'm a Debian/Ubuntu guy. Easiest multi tool for my needs.
I usually use OpenMediaVault for my simple NAS needs.
Proxmox and XCP-NG for hypervisor. I was involved in the initial development of OpenStack, and have much love for classic Xen itself (screw Citrix and their mistreatment of xenserver).
My dockers are either via DockGE or the compose plugins under OMV, leaning more toward DockGE lately for simplicity and eye candy.
Overall, I've had my share of disk failures. Usually from being sloppy. I only trust software RAID, as I have better shot at recovery if I'm stupid enough to store something critical on less that N+2.
I usually buy drives only on previous generation, and at that only when price absolutely craters. The former due to being bitten by new models crapping out early, and latter due to being too poor to support my bad habits.
Nearly all of my SATA disks came from externals, but that's become tenuous lately... SMR disks are getting stuck into these more and more, and manufacturers sneakier about hiding shit design.
Used SAS from a place with solid warranty seems to be most reliable. About half my fleet was bought used and I've only lost about 1/4 of those with less than 5+ years active run time.