I wonder... "Mouse and Keyboard Tracking"

amadeus1171

amadeus1171
I wonder if it's possible to use the HTC Vive's front facing camera to track the mouse, keyboard (and possibly hotas too) and integrate them into the virtual world...
 

BillD

BillD
You really need stereo cameras for 3d tracking. The vive only has a single camera so it is hard or impossible even to work out the depth
 

Captain N

C
If you just want them visible in the cockpit so you can type and mouse easier, it can be done! And I have done it:

[video=youtube;oB9HCasvffc]https://www.youtube.com/watch?v=oB9HCasvffc[/video]

You need a separate webcam set up over your desk, though, the Vive's front camera won't do. And it's not truly 3D, since it's just a video flattened into a plane floating in your cockpit, but can still be surprisingly immersive. And probably helpful if you find touch typing hard.

Actually 3D tracked mice and keyboards might become a thing as Lighthouse accessories now that Valve is opening up the ecosystem.
 

xondk

X
amadeus1171 said:
I wonder if it's possible to use the HTC Vive's front facing camera to track the mouse, keyboard (and possibly hotas too) and integrate them into the virtual world...
Click to expand...

I can't remember where, but I saw someone using discrete markers, to get the vive sensors to see mouse/keyboard, and then used pictures of them to make them at least 'seem' to be there? and allow typing fairly easily?
 

Captain N

C
Jonathan E said:
How'd you do that N? looks very useful...
Click to expand...

You need the OpenVRDesktopDisplayPortal program from here: https://github.com/Hotrian/OpenVRDesktopDisplayPortal

Then you set up a camera directly overhead the keyboard pointed downwards.

Select the webcam software (Logitech Webcam Software etc.) window as the input source. You now have a keyboard in your cockpit!

You may have to tweak some coordinates to get the rectangle in the right place.

I don't really use this much because it's a bit of a pain to set up and I can touch type anyway.
 

Jonathan E

Jonathan E
Captain N, just got round to trying this and it works great! I have the virtual screen down in my virtual lap, but I also have scaled down and then it expands when I look directly at it.
 
You must log in or register to reply here.
Back
Top Bottom