The Avatar already pulls the trigger when you fire a weapon or scanner, it also responds to other functions like retracting/deploying hardpoints. The most freaky part is the avatar actually breathes when you look you down at it's body.
As far as pulling circuits or pushing buttons, I can't see how that would work in any of the ships, the side panels are floating 42" Holograms, full arms length away in most ships, none of the panels that have buttons are reachable from a sitting position (Even the Eagle)
To give you an example, I am in a Cobra right now in VR, the only additional panels with buttons are on the overhead panel, I have to physically get out of my seat and stand up to reach them. Those same buttons are on the Control panel next to the stick and throttle, I really wouldn't my Avatar getting up and moving around to push buttons, especially not in VR.
Once you try VR you'll understand.