Having to use the panel to enable it is slow if you are not already viewing the destination in the panel. For instance if you are following a route from one system to a station in another, upon entering the system the target station will be selected in the HUD, but you will need to scroll through the panel and find it before you can enable S/C Assist.