Too many people get motion sickness from VR (not me, but my kids do). The Gen1 and Gen2 headsets are too bulky, too hot, too low resolution. If VR is to become mainstream, the headsets need to be wireless, smaller, lighter, cooler (temperature), cooler (not so nerdy), much better resolution, and lower hardware demands. Currently the technology is half baked.
It's just not practical for me. The graphics are poor compared to my mid-tier monitor, too hot to wear for any period of time, too heavy and hurts my face after about an hour, steams up, lenses are too close to my eyes. My eyelashes always muck up the lenses and it's horribly annoying to have your eyelashes constantly brushing against something. I can't move lenses farther away as there is no adjustment for that. When I rigged it to be farther away, it falls out of focus. No, I am not going to trim my eyelashes.
After the wow factor of being in the game wears off (and it does) there is really no compelling reason for me to put that monstrosity on my head unless I am doing combat. I admit, for that one case, VR is supremely superior and much more enjoyable. High risk, fast paced danger overrides my ability to notice the annoyances for a while.
I have a rift that I bought in 2017 and use it for less than 5% of my play in Elite. I don't play ANY other VR games. None. They are all gimmicky or poorly executed. "Look at our sucky, non-compelling game, but VR!"
That is a sample of one, but for me it is still definitely niche.