This correct, the Points of Interest are destinations, of which there can be hundreds in a system. You could slow boat between them, but only a realistic speeds, so it would takes years to travel across the solar system. We're currently looking into how we can allow faster travel without breaking the current system and adding a huge cost to the development and still being fun.
Ask yourself how fast do you need to travel to travel from Earth to Neptune in a few minutes?
And now ask how easy is it to miss even a star sized object at that speed?
Michael