mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
* [PATCH] sched: Count loadavg under rq::lock in calc_load_nohz_start()
@ 2017-07-07 17:06 Kirill Tkhai
  0 siblings, 0 replies; only message in thread
From: Kirill Tkhai @ 2017-07-07 17:06 UTC (permalink / raw)
  To: peterz, fweisbec, linux-kernel, mingo, tglx, ktkhai

Since calc_load_fold_active() reads two variables (nr_running
and nr_uninterruptible) it may race with parallel try_to_wake_up().
Thus, it must be called under rq::lock to prevent that. Also
put calc_load_migrate() under the lock for uniformity.

I observed machine with negative calc_load_tasks on kernel 3.10,
and this seems to be the reason.

Signed-off-by: Kirill Tkhai <ktkhai@virtuozzo.com>
---
 kernel/sched/core.c    |    2 +-
 kernel/sched/loadavg.c |    3 +++
 2 files changed, 4 insertions(+), 1 deletion(-)

diff --git a/kernel/sched/core.c b/kernel/sched/core.c
index d3d39a283beb..92b3512bdcfc 100644
--- a/kernel/sched/core.c
+++ b/kernel/sched/core.c
@@ -5657,9 +5657,9 @@ int sched_cpu_dying(unsigned int cpu)
 	}
 	migrate_tasks(rq, &rf);
 	BUG_ON(rq->nr_running != 1);
+	calc_load_migrate(rq);
 	rq_unlock_irqrestore(rq, &rf);
 
-	calc_load_migrate(rq);
 	update_max_interval();
 	nohz_balance_exit_idle(cpu);
 	hrtick_clear(rq);
diff --git a/kernel/sched/loadavg.c b/kernel/sched/loadavg.c
index f14716a3522f..723349844990 100644
--- a/kernel/sched/loadavg.c
+++ b/kernel/sched/loadavg.c
@@ -183,13 +183,16 @@ static inline int calc_load_read_idx(void)
 void calc_load_nohz_start(void)
 {
 	struct rq *this_rq = this_rq();
+	struct rq_flags rf;
 	long delta;
 
 	/*
 	 * We're going into NO_HZ mode, if there's any pending delta, fold it
 	 * into the pending NO_HZ delta.
 	 */
+	rq_lock(this_rq, &rf);
 	delta = calc_load_fold_active(this_rq, 0);
+	rq_unlock(this_rq, &rf);
 	if (delta) {
 		int idx = calc_load_write_idx();
 

^ permalink raw reply	[flat|nested] only message in thread

only message in thread, other threads:[~2017-07-07 17:07 UTC | newest]

Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-07-07 17:06 [PATCH] sched: Count loadavg under rq::lock in calc_load_nohz_start() Kirill Tkhai

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®