This was the only serious non-instance-transition stutter I couldn't resolve on my 5800X...though moving to a 5800X3D mostly eliminated it. Once the CPU is fast enough, the game becomes very sensitive to memory subsystem performance. Even with very fast main memory, the extra cache of the X3D part helped considerably.
Intel setups have the potential for lower latency main memory (due to a monolithic topology where the memory controllers are still on the same die as the cores). It can take some work, but that's what I'd look into tuning on your setup, if you're looking to make CZs as smooth as possible.
Sounds like it would be something that could be remedied by a coder more than it sounds like something I can fix on my current hardware then.