Re: High priority tasks break SMP balancer?

[Kyle Moffett <mrmacman_g4@mac.com>]

First of all, since Ingo Molnar seems to be one of the head scheduler  
gurus, you might CC him on this.  Also added a couple other useful  
CCs for regression reports.

On Nov 09, 2007, at 19:11:03, Micah Dowty wrote:
> As I said, YMMV. I haven't been able to find a single set of  
> parameters for the demo program which cause the problem to occur  
> 100% of the time on all systems.
>
> In general, boosting the MAINTHREAD_PRIORITY even more and  
> increasing the WAKE_HZ should exaggerate the problem. These  
> parameters reproduce the problem very reliably on my system:
>
> #define NUM_BUSY_THREADS            2
> #define MAINTHREAD_PRIORITY       -20
> #define MAINTHREAD_WAKE_HZ       1024
> #define MAINTHREAD_LOAD_PERCENT     5
> #define MAINTHREAD_LOAD_CYCLES      2

Well from these statistics; if you are requesting wakeups that often  
then it is probably *not* correct to try to move another thread to  
that CPU in the mean-time.  Essentially the migration cost will  
likely far outweigh the advantage of letting it run a little bit of  
extra time, and in addition it will dump out cache from the high- 
priority thread.  As per the description I think that an increased a  
priority and increased WAKE_HZ will certainly cause the "problem" to  
occur more, simply because it reduces the time between wakeups of the  
high-priority process and makes it less helpful to migrate another  
process over to that CPU during the sleep periods.  This will also  
depend on your hardware and possibly other configuration parameters.

I'm not really that much of an expert in this particular area,  
though, so it's entirely possible that one of the above-mentioned  
scheduler head-honchos will poke holes in my argument and give a  
better explanation or a possible patch.

Cheers,
Kyle Moffett