Your first part of the fence needs to be a straight bit.
After that, angle snap to 90*. Decide length of barrier, and make circle.
The same technique works with paths.
Main important thing is to keep the angle locked at the same degree, and make sure all sections have the same length.
You still need to add a habitat door at some point, which will destroy your perfect circle anyways.