As the game uses P2P, your upload speed is also important. 60mbit download isn't going to help much if the upload is only 512k. Plus if you have one peer whos in some far off land, or has a poor connection, the whole session lags to hell for everyone no matter what.
P2P just isn't good for gaming on, I don't think they will ever fully "fix" the issues.