You can remove the Elite Dangerous Horizons folder since Horizons was merged into the original Elite Dangerous entry on Steam. That folder is no longer used.
I recommend moving it first, however (to your desktop would work fine) in case there is some funky dependency Lunchmoney or I haven't experienced. You can just move it back if you are having trouble running the game after removing it.