Ok so it looks like Lemmy comms appear in the search interface, and you can use the mini follow button in the result list to follow the comm.
If you view the comm, and then use the follow button there, it will submit a follow request which presumably will never be answered.