I wonder if it's being affected by frame rate which might be forced to change with varying lighting.
If you can adjust frame rate lower bitrate might go up.
Less than 10fps would probably still be acceptable.