From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 85DA5C3279B for ; Wed, 4 Jul 2018 15:30:49 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 4938C2416E for ; Wed, 4 Jul 2018 15:30:49 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 4938C2416E Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=arm.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752755AbeGDPaq (ORCPT ); Wed, 4 Jul 2018 11:30:46 -0400 Received: from foss.arm.com ([217.140.101.70]:39396 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752399AbeGDPap (ORCPT ); Wed, 4 Jul 2018 11:30:45 -0400 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id E04D518A; Wed, 4 Jul 2018 08:30:44 -0700 (PDT) Received: from [10.1.206.75] (usa-sjc-imap-foss1.foss.arm.com [10.72.51.249]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 1D8EF3F5AD; Wed, 4 Jul 2018 08:30:41 -0700 (PDT) Subject: Re: [linux-sunxi] Re: [PATCH 0/2] Allwinner A64 timer workaround To: Andre Przywara Cc: Thomas Gleixner , Daniel Lezcano , Samuel Holland , Maxime Ripard , Chen-Yu Tsai , Catalin Marinas , Will Deacon , linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, linux-sunxi@googlegroups.com, Mark Rutland References: <20180511022751.9096-1-samuel@sholland.org> <2c16d5ab-38f7-8f3e-875c-19e8032f440a@arm.com> <5283f98e-6443-db7a-fe51-6379ed19002c@arm.com> <24b78819-5e3f-431f-3987-f7409742ef07@linaro.org> <1d75c538-9166-5eec-a08c-b168f9770bd1@arm.com> <1a36f63c-0259-bdcd-bb96-d5230c2564ea@arm.com> <55fc9e48-6329-df75-3a12-60cc42d91a31@arm.com> <861scjyrio.wl-marc.zyngier@arm.com> <46a2a2b9-27af-4850-8b8b-f95be7394643@arm.com> From: Marc Zyngier Organization: ARM Ltd Message-ID: Date: Wed, 4 Jul 2018 16:30:40 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: <46a2a2b9-27af-4850-8b8b-f95be7394643@arm.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 04/07/18 16:15, Andre Przywara wrote: > Hi, > > On 04/07/18 16:01, Marc Zyngier wrote: >> On Wed, 04 Jul 2018 15:44:36 +0100, >> Andre Przywara wrote: >>> >>> Hi, >>> >>> On 04/07/18 15:31, Thomas Gleixner wrote: >>>> On Wed, 4 Jul 2018, Andre Przywara wrote: >>>>> On 04/07/18 11:00, Thomas Gleixner wrote: >>>>>> On Wed, 4 Jul 2018, Marc Zyngier wrote: >>>>>>> On 04/07/18 09:23, Daniel Lezcano wrote: >>>>>>>> >>>>>>>> If the patches fix a bug which already exist, it makes sense to >>>>>>>> propagated the fix back to the stable versions. >>>>>>> >>>>>>> That's your call, but I'm not supportive of that decision, specially as >>>>>>> we have information from the person developing the workaround that this >>>>>>> doesn't fully address the issue. >>>>>> >>>>>> The patches should not be applied at all. Simply because they don't fix the >>>>>> issue completely. >>>>>> >>>>>> From a quick glance at various links and information about this, this very >>>>>> much smells like the FSL_ERRATUM_A008585. >>>>>> Has that been tried? It looks way more robust than the magic 11 bit >>>>>> crystal ball logic. >>>>> >>>>> The Freescale erratum is similar, but not identical [1]. >>>>> It seems like the A64 is less variable, so we can use a cheaper >>>>> workaround, which gets away with normally just one sysreg read. But then >>>>> again the newer error reports may actually suggest otherwise ... >>>>> >>>>> And as it currently stands, the Freescale erratum has the drawback of >>>>> relying on the CPU running much faster than the timer. The A64 can run >>>>> at 24 MHz (for power savings, or possibly during DVFS transitions), >>>>> which is the timer frequency. So subsequent counter reads will never >>>>> return the same value and the workaround times out. >>>> >>>> If that's the case then you need to find a different functional timer for >>>> time keeping. Having an erratic behaving timer for time keeping is not an >>>> option at all. >>> >>> That's not an option on arm64. There are other usable time sources in >>> the SoC, but the arch timer is somewhat mandatory for all practical >>> purposes on arm64. We rely on it in some many places that it's not >>> feasible to run without it. That's why we call it "architected" timer >>> after all ;-) >>> But I am quite confident that we can find a correct workaround. Maybe >>> it's really the TVAL (the downcounter) write which is the culprit here, >>> since the hardware actually writes "now() + TVAL" into the CVAL >>> (upcounter) register. This internal counter access may be flawed as well. >> >> You got it backward: CVAL is not a counter at all. It is a >> Comparator. And TVAL has an implicit read from the counter, as it is >> defined as "CVAL - CNT" (i.e. the number of ticks until the timer >> expires). > > Yes, that's what I meant actually, sorry for the lousy wording. > > What I am actually more concerned about than reading (do we actually > read TVAL?), is writing TVAL. The original BSP errata hack hints at this > being a problem: > https://github.com/longsleep/linux-pine64/blob/5b10a45ae8b0/drivers/clocksource/arm_arch_timer.c#L231-L244 Right, and they only address the comparator, ignoring the counter. Braindead. I specially enjoy the "we should try to fix this" comment. >> So it might be worth trying to handle TVAL entirely in SW. Given the above, I think the above makes sense: - write TVAL: read CNT until stable, add the delta, write CVAL instead - read TVAL: read CNT until stable, substract CVAL, return the delta The low frequency problem remains. If it can't be solved, drop the arch timer from the DT (it is dead), and use a separate timer/counter. Simply not fit for purpose. M. -- Jazz is not dead. It just smells funny...