From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754231AbbCBMpt (ORCPT ); Mon, 2 Mar 2015 07:45:49 -0500 Received: from mail-we0-f178.google.com ([74.125.82.178]:43271 "EHLO mail-we0-f178.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754158AbbCBMoy (ORCPT ); Mon, 2 Mar 2015 07:44:54 -0500 Message-ID: <1425300290.5863.17.camel@gmail.com> Subject: Re: [PATCH v4 2/2] cpusets,isolcpus: add file to show isolated cpus in cpuset From: Mike Galbraith To: Peter Zijlstra Cc: Rik van Riel , Zefan Li , linux-kernel@vger.kernel.org, Clark Williams , Ingo Molnar , Luiz Capitulino , David Rientjes , cgroups@vger.kernel.org Date: Mon, 02 Mar 2015 13:44:50 +0100 In-Reply-To: <20150302090933.GH21418@twins.programming.kicks-ass.net> References: <1424882288-2910-1-git-send-email-riel@redhat.com> <1424882288-2910-3-git-send-email-riel@redhat.com> <54EEFE15.3010005@huawei.com> <20150226121231.6fcba7e8@annuminas.surriel.com> <20150302090933.GH21418@twins.programming.kicks-ass.net> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.12.11 Mime-Version: 1.0 Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, 2015-03-02 at 10:09 +0100, Peter Zijlstra wrote: > On Thu, Feb 26, 2015 at 12:12:31PM -0500, Rik van Riel wrote: > > Subject: cpusets,isolcpus: add file to show isolated cpus in cpuset > > > > The previous patch makes it so the code skips over isolcpus when > > building scheduler load balancing domains. This makes it hard to > > see for a user which of the CPUs in a cpuset are participating in > > load balancing, and which ones are isolated cpus. > > > > Add a cpuset.isolcpus file with info on which cpus in a cpuset are > > isolated CPUs. > > > > This file is read-only for now. In the future we could extend things > > so isolcpus can be changed at run time, for the root (system wide) > > cpuset only. > > > > Acked-by: David Rientjes > > Cc: Peter Zijlstra > > Cc: Clark Williams > > Cc: Li Zefan > > Cc: Ingo Molnar > > Cc: Luiz Capitulino > > Cc: David Rientjes > > Cc: Mike Galbraith > > Cc: cgroups@vger.kernel.org > > Signed-off-by: Rik van Riel > > So let me start off by saying I hate isolcpus ;-) > > Let me further state that I had hopes we could extend cpusets to > natively provide the functionality isolcpus has, and kill isolcpus. +1 That's where nohz_full goop belongs too. > The 'normal' way would be to create 2 cgroups with disjoint cpus, > disable sched_load_balance on root and one of the siblings, while moving > everything into the other group. That's what cset shield does, works fine. > The 'problem' is that we cannot move everything that is affected by > isolcpus, workqueues have grown a horrible 'new' interface outside of > the regular task interfaces and things like kthreadd are non-movable for > mostly good reasons. > > Furthermore it appears that software like system-disease and libvirt > hard assume they're lord and master of the cgroup hierarchy and do not > expect things like this. > > So while I mostly hate all of this it might be the best we can do :-( Hm, I'm now all system-disease-ified now (still hate the bloody thing), and have no problem isolating cpus via cpusets, modulo workqueues wanting a bat upside the head. -Mike