I don't think that's the hard part: the medium ships are so much more responsive that they're a lot more fun to fly.
That's the hard part, at least for me. I first flew a Corvettte for four or five days straight in CZ's, and then decided to take a break by hopping into my Cobra and trawling Emission Sources. I hopped in, all right, but the Cobra was so much more maneuverable that I immediately did too much of everything. I actually bounced through the mail slot and the toast rack on my way out of the station. It was the funniest and most embarrassing launch I've ever made.
My Challeger does that to me as well. I nearly ping-pong off the walls with it if I've been driving the Annie for a while.