I see the same effect, mainly when a dark planet is nearby and I look around; the overall starfield intensity tends to rise and fall.
I think the effect is tied to the brightness of nearby stars or planets perhaps.
It does seem to get a bit confused as siimply looking around in your cockpit shouldn't affect the ambient brightness. And in a station, well that should be pretty stable brightness wise.