So, I'm pretty sure I've seen population fluctuate without any new facilities. I could be wrong... but it seems like colonies might have variable population outside of just building them out?
That's quite possible! According to my architect weekly score went up by 5 points - from 3 to 8.