Most people aren't that bothered with the 3D abilities of their tellies. It's just an extra that every telly has nowadays. When I replaced my telly a few years back I was interested in the 3D performance. Back in those days there used to be shops in the high streets where you could buy things. I had the chance to try out side by side the different technologies; the LCD shutter glasses as you've described, and the Passive Polaroid glasses. It was very easy for me to see which system produced the more convincing 3D effect.
When I got my DK2 my computer was pretty old. I was running the headset at 60fps. I was curious to see what difference the framerate made so I turned every graphic setting in Elite down to its lowest value and turned the Rift up to 75fps. It was a pretty ugly view, but what I experienced was enough to convince me to buy a GTX980. A high framerate is very important in VR.
I'm not saying that VR is impossible with the XBox One. John Carmack caused a bit of a stink a couple of years ago when he said that the XBox One and the PlayStation Four were pretty much the same. What he meant was that they were both powerful enough for VR. Of course the consoles will be able to run at the framerates needed for VR, as long as the geometry has been simplified enough. The amount they've got to simplify will really highlight any power differences in these consoles. It is quite interesting that Sony are quite far ahead with their own VR kit while Microsoft have decided to concentrate on augmented reality glasses where the size of the computer image overlay is quite small.
It is true that most people are not bothered about 3D tv. Most peoples experience of 3D tv though is movies, which is nothing more than a novelty that wares off pretty quick. Most peoples experience of 3D gaming is with the Nintendo 3DS. Whilst initially impressive... it has its short comings in that, 1) it is a small screen and, 2) if you don't keep the little console still, it looses picture quality to the point that it hurts your eyes as you try to keep focus. Most people have not experienced proper 3D gaming through a TV set or monitor. Mostly because they haven't had access to the technology, nor have many games supported it. In recent years I know of only 2 games that gave an option for 3D TV Avatar and the Batman Arkham series. There may have been others I don't know. It was around 12-15 yrs ago when got to play games in 3D. I had a modest PC then (I can't remember the specs), but it certainly was not cutting edge. I threw all sorts of games at it expecting a noticeable loss of frame rate, but I did not notice any. I tried Quake 3 arena, Unreal Tournament, Jedi Knight 2, X2 the Threat and many others. They all ran beautifully at 1280 by 1024, which was the maximum resolution of the CRT monitor I had at the time. Gaming in 3D is a whole different experience than watching movies. Being able to properly judge distance makes a huge difference whilst playing FPS. In FPS games you can do away with the target reticule all together, being able to judge distance and gaps properly to jump etc. It added a whole new dimension (the 3rd) to the experience. Once I returned the 3D glasses that my brother had loaned to me.... I really missed it.
Sony's project Morpheus VR was designed for PS4 gaming. The MS Hololens was not designed solely for Xbox augmented reality gaming. It was designed for a whole multitude of various industry applications. It will come to Xbox, but that was not its primary reason for being created. MS invested heavily into Kinect for Xbox, and its potential as a gaming peripheral never really amounted to much of anything. However Kinect has had more success elsewhere. MS does not want to invest heavily into creating its own VR headset. I don't think that its a case of them being unsure of whether VR will take off or not. Or that its going to be just another short lived fad, like motion controlled gaming was. Nor is it some fear that it will show everyone that the PS4 is so much more capable than the Xbox. Its quite simply there is no need to. They have partnered with Oculus and whilst right now they don't have any plans of creating VR games for Xbox. You can bet that if it really takes off on PS4, MS will jump in too. I do think however it is a bit of a mistake to wait and see how it all pans out before jumping in late to the party.
As for VR I have yet to try it. Even if we don't get the best in cutting edge graphics, it is still something that I believe I would enjoy very much.