Banned is maybe too far, but why should we as a country allow people to have petty power over meaningless things their neighbors do? Could we ban HOAs from being included in house sales, and every time it's sold the new owners have to opt in?
For the most part, I'm wondering about this in the context of single family homes since for homes like condos, you could make the case that HOAs are useful for shared things like roofs and whatnot. Maybe limit mandatory HOA involvement to things like what's truly necessary and shared and not how tall your grass is?
The primary remedy for ~~coming into people's houses~~ home invasion is called "Castle Doctrine", which falls well outside the HOA's jurisdiction.
That is highly location specific, and even then it's gonna be a tough row to hoe unless you happen to possess a burner gun and can sprinkle a little crack on his corpse.