Hold on, I feel like there should be two or three paragraphs of context that are missing?
It sounds like you're saying that when you walk around, they complain? What does retaliating mean? What happens when you have conversations with them, or what do you think is most likely to happen if you were to try to have a conversation? And do you have a landlord you can talk to?
It may be frustrating for you to go into those details, and maybe you need to obscure some details, but it makes it easier to know what you're dealing with.
I would want to know first of all what the possibility is of trying to talk to them or reason with them directly. Secondly I might ask your landlord or fill them in on the situation and tell them you're doing the best you can and that you don't appreciate being complained about and having to tiptoe and slippers just to stop complaints from a neighbor.