It's absolutely fine to navigate the galaxy map in VR _if_ you set up your controls for it and get used to it. Lots of good tips here in this thread. Its gonna feel clunky at first, but once you get used to it its really fast and easy.
I never need to take my rift of while playing, i have my keyboard placed right behind behind my hotas, and i'm very thankful i learned to touch type back in the day, the few times i need to enter any text.
Lastly, if your controller has too few buttons, you can set up a "shift button" to alter what the other keys do. (You basically leave that button it self unbound, and bind functions by pressing that key together with a the button you want)