Rift user here but don't play in VR often.
The low res turns me off a bit and the fact that I heavily rely on third-party apps during my standard gameplay (exploration - I make notes etc). I need to play around more with pinning windows and Voice Attack to see if I can get something working for me.
When I'm running missions though VR is brilliant. Still want more res/clarity.
EDIT:
PS. I only bought the Rift for Elite, have barely tried anything else in VR.
I agree with various points above that ED could do with some game-related improvements (eg, Galaxy Map) but on the whole it really is an awesome experience.
I would suggest Elite does not show off current VR to it's full potential - the main issue is the low resolution is suited for less intricate detailing and more defined shapes. Gorn, an arena fighting game, is a far better example of how VR can look, it's an excellent game, and the graphical design shines because it's not as detailed - no writing to read while cracking skulls...
Flight sims are currently less fun than they should be, purely because reading dials and button labels is not easy unless you lean in for a closer look, but the sense of flying is unparalleled.
When the Pimax HMD's are out, assuming they live up to their promising early reviews, then I think VR could truly take off - Oculus and other hardware developers will HAVE to take notice and bring something out, otherwise the Rift and similar will look like old relics compared to the image quality of the new units.