After several of my favorite songs disappeared from Spotify, I've adopted a different approach to music.
If I see on on a band show merch stand, I buy a cassette. It's more of a novelty item and a way to slightly support the band. While I do have a portable tape player, I only rarely take it out. I switched from LPs to tapes because of the costs and huge effort associated with playing or storing them (that is, if you do it right are are not OK with fucking up your LPs), but tapes are cool and don't have that many storage or playing problems.
Other than that, I've stopped paying for any kind of streaming services, and save the 10$ per month to just buy one or two (new or old) albums from my favourite artists on Bandcamp, that I've spend the last month listening to the most. The albums I buy I add to my NAS library, which usually replaces stolen copies of said albums that I've previously got from Redacted.
This allows me to keep a pretty expansive library, by just stealing what I need, but with a promise that I'll eventually buy the album (using the money I saved on streaming services), if it's something that I've listened to extensively. I'm also not at mercy of streaming services, that can take away my music whenever they decide to.
So far I've been doing this for a few years, and even increased my budget for just buying albums if I can't immediately find them on Redacted.