From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_PASS, URIBL_BLOCKED,USER_AGENT_MUTT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 28D75C43387 for ; Mon, 14 Jan 2019 19:42:35 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id DFBF020659 for ; Mon, 14 Jan 2019 19:42:34 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=cmpxchg-org.20150623.gappssmtp.com header.i=@cmpxchg-org.20150623.gappssmtp.com header.b="VimXsB5B" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727001AbfANTmd (ORCPT ); Mon, 14 Jan 2019 14:42:33 -0500 Received: from mail-yw1-f66.google.com ([209.85.161.66]:33482 "EHLO mail-yw1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726968AbfANTm0 (ORCPT ); Mon, 14 Jan 2019 14:42:26 -0500 Received: by mail-yw1-f66.google.com with SMTP id p65so112134ywe.0 for ; Mon, 14 Jan 2019 11:42:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cmpxchg-org.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=Vxx1+n0dG+RiooC4y8IuxHl2RJx3sXAQ3iRxtXUSYJw=; b=VimXsB5Bji4G5E3m6BJlIWSPt85AOFLkP1v+k/QGhVAykmva0/UfbP6tHt5YV5oPzN eqoji+PE9pQJepErH4vBW8A7eECvIlUzj36fXW4+dFethsxPbmiSssTKBz2PioG+vdRZ FsxMhlsP5lwUc1DanGrfvBCKnGDVX+fA1d1TrIN1cUej2Z4IbEo/s/WlHELeZ4kc0Qqn rQAhyaxaistuVM61IZSjZhQwvq5FgweC14sMQa4p9vxHwjNRPDBAKPizfjgemmrWFmEW lhnTVDGNjyCO7q2YEZbxxkX62M8fKt9lvGGrA21CBuPo6xGoXTFaCxiu5zKjo3WzVkJM qzow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=Vxx1+n0dG+RiooC4y8IuxHl2RJx3sXAQ3iRxtXUSYJw=; b=cvywrLN05y6Sp9S44S9KCaqPPx9J/xkn67MTgCHpR6H5BPPIKK1ZAuquvjng5ifDYO eJDSBRTfEUUwnwIRxKbRuHbwBgZoi8bpMmId4CWP7GQvDvasvpu82RQdk+OaOl4WDd9I xP4QI0JEVkBl2wWEHwbVRLpTUdZfNAaRIkGWYc5xuGkaURb1ygjVTgONwKDuOkX9CgJ0 T2mymbUz+iw/TZRWpQ62tx60yMq9ax3IZ+7lLy2fNaaQGxsZmfT3lmHvJ8UBM9uEOahe GkcXTltEE9oLmqX2rKe6jHnhQ1VwNcqrrFHTYqoQcqk7PCDawfn6OfBIN7U0x/r78A2P uuKw== X-Gm-Message-State: AJcUukc4tJllLm7WhF77dmCuKEV61s/Aa6malY/mcLBeZYR9PXTbhMmQ aLRAVSBI0Z6igyWzIeSq9u23jg== X-Google-Smtp-Source: ALg8bN6zGmg+woRn1esk845CjmTyehNKkMXh4UG/4myIHlx0GqSAHcKhQodAo4r1QZnhIm5nHc9SAg== X-Received: by 2002:a81:ee07:: with SMTP id l7mr39996ywm.489.1547494945102; Mon, 14 Jan 2019 11:42:25 -0800 (PST) Received: from localhost ([2620:10d:c091:200::6:de12]) by smtp.gmail.com with ESMTPSA id 141sm411779yws.47.2019.01.14.11.42.23 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Mon, 14 Jan 2019 11:42:23 -0800 (PST) Date: Mon, 14 Jan 2019 14:42:22 -0500 From: Johannes Weiner To: Suren Baghdasaryan Cc: Peter Zijlstra , Greg Kroah-Hartman , Tejun Heo , lizefan@huawei.com, axboe@kernel.dk, dennis@kernel.org, Dennis Zhou , Ingo Molnar , Andrew Morton , Jonathan Corbet , cgroups@vger.kernel.org, linux-mm , linux-doc@vger.kernel.org, LKML , kernel-team@android.com Subject: Re: [PATCH v2 5/5] psi: introduce psi monitor Message-ID: <20190114194222.GA10571@cmpxchg.org> References: <20190110220718.261134-1-surenb@google.com> <20190110220718.261134-6-surenb@google.com> <20190114102137.GB14054@worktop.programming.kicks-ass.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.2 (2019-01-07) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jan 14, 2019 at 11:30:12AM -0800, Suren Baghdasaryan wrote: > On Mon, Jan 14, 2019 at 2:22 AM Peter Zijlstra wrote: > > > > On Thu, Jan 10, 2019 at 02:07:18PM -0800, Suren Baghdasaryan wrote: > > > +/* > > > + * psi_update_work represents slowpath accounting part while > > > + * psi_group_change represents hotpath part. > > > + * There are two potential races between these path: > > > + * 1. Changes to group->polling when slowpath checks for new stall, then > > > + * hotpath records new stall and then slowpath resets group->polling > > > + * flag. This leads to the exit from the polling mode while monitored > > > + * states are still changing. > > > + * 2. Slowpath overwriting an immediate update scheduled from the hotpath > > > + * with a regular update further in the future and missing the > > > + * immediate update. > > > + * Both races are handled with a retry cycle in the slowpath: > > > + * > > > + * HOTPATH: | SLOWPATH: > > > + * | > > > + * A) times[cpu] += delta | E) delta = times[*] > > > + * B) start_poll = (delta[poll_mask] &&| if delta[poll_mask]: > > > + * cmpxchg(g->polling, 0, 1) == 0)| F) polling_until = now + > > > + * | grace_period > > > + * | if now > polling_until: > > > + * if start_poll: | if g->polling: > > > + * C) mod_delayed_work(1) | G) g->polling = polling = 0 > > > + * else if !delayed_work_pending(): | H) goto SLOWPATH > > > + * D) schedule_delayed_work(PSI_FREQ)| else: > > > + * | if !g->polling: > > > + * | I) g->polling = polling = 1 > > > + * | J) if delta && first_pass: > > > + * | next_avg = calculate_averages() > > > + * | if polling: > > > + * | next_poll = poll_triggers() > > > + * | if (delta && first_pass) || polling: > > > + * | K) mod_delayed_work( > > > + * | min(next_avg, next_poll)) > > > + * | if !polling: > > > + * | first_pass = false > > > + * | L) goto SLOWPATH > > > + * > > > + * Race #1 is represented by (EABGD) sequence in which case slowpath > > > + * deactivates polling mode because it misses new monitored stall and hotpath > > > + * doesn't activate it because at (B) g->polling is not yet reset by slowpath > > > + * in (G). This race is handled by the (H) retry, which in the race described > > > + * above results in the new sequence of (EABGDHEIK) that reactivates polling > > > + * mode. > > > + * > > > + * Race #2 is represented by polling==false && (JABCK) sequence which > > > + * overwrites immediate update scheduled at (C) with a later (next_avg) update > > > + * scheduled at (K). This race is handled by the (L) retry which results in the > > > + * new sequence of polling==false && (JABCKLEIK) that reactivates polling mode > > > + * and reschedules next polling update (next_poll). > > > + * > > > + * Note that retries can't result in an infinite loop because retry #1 happens > > > + * only during polling reactivation and retry #2 happens only on the first > > > + * pass. Constant reactivations are impossible because polling will stay active > > > + * for at least grace_period. Worst case scenario involves two retries (HEJKLE) > > > + */ > > > > I'm having a fairly hard time with this. There's a distinct lack of > > memory ordering, and a suspicious mixing of atomic ops (cmpxchg) and > > regular loads and stores (without READ_ONCE/WRITE_ONCE even). > > > > Please clarify. > > Thanks for the feedback. > I do mix atomic and regular loads with g->polling only because the > slowpath is the only one that resets it back to 0, so > cmpxchg(g->polling, 1, 0) == 1 at (G) would always return 1. > Setting g->polling back to 1 at (I) indeed needs an atomic operation > but at that point it does not matter whether hotpath or slowpath sets > it. In either case we will schedule a polling update. > Am I missing anything? > > For memory ordering (which Johannes also pointed out) the critical point is: > > times[cpu] += delta | if g->polling: > smp_wmb() | g->polling = polling = 0 > cmpxchg(g->polling, 0, 1) | smp_rmb() > | delta = times[*] (through goto SLOWPATH) > > So that hotpath writes to times[] then g->polling and slowpath reads > g->polling then times[]. cmpxchg() implies a full barrier, so we can > drop smp_wmb(). Something like this: > > times[cpu] += delta | if g->polling: > cmpxchg(g->polling, 0, 1) | g->polling = polling = 0 > | smp_rmb() > | delta = times[*] (through goto SLOWPATH) delta = times[*] is get_recent_times(), which uses a seqcount and so implies the smp_rmb() already as well. So we shouldn't need another explicit one. But the comment should point out all the barriers.