From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.0 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING,SPF_PASS,URIBL_BLOCKED, USER_AGENT_NEOMUTT autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id CD342C4360F for ; Thu, 28 Feb 2019 09:35:22 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id A58602171F for ; Thu, 28 Feb 2019 09:35:22 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732170AbfB1JfV (ORCPT ); Thu, 28 Feb 2019 04:35:21 -0500 Received: from relay9-d.mail.gandi.net ([217.70.183.199]:34815 "EHLO relay9-d.mail.gandi.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725896AbfB1JfV (ORCPT ); Thu, 28 Feb 2019 04:35:21 -0500 X-Originating-IP: 90.88.147.150 Received: from localhost (aaubervilliers-681-1-27-150.w90-88.abo.wanadoo.fr [90.88.147.150]) (Authenticated sender: maxime.ripard@bootlin.com) by relay9-d.mail.gandi.net (Postfix) with ESMTPSA id E43B7FF810; Thu, 28 Feb 2019 09:35:16 +0000 (UTC) Date: Thu, 28 Feb 2019 10:35:16 +0100 From: Maxime Ripard To: Gerhard Wiesinger Cc: arm@lists.fedoraproject.org, Chen-Yu Tsai , LKML , linux-mm@kvack.org, Florian Fainelli , filbar@centrum.cz Subject: Re: Banana Pi-R1 stabil Message-ID: <20190228093516.abual3564dkvx6un@flea> References: <7b20af72-76ea-a7b1-9939-ca378dc0ed83@wiesinger.com> <20190227092023.nvr34byfjranujfm@flea> <5f63a2c6-abcb-736f-d382-18e8cea31b65@wiesinger.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="y46btgmwon2ggfsd" Content-Disposition: inline In-Reply-To: <5f63a2c6-abcb-736f-d382-18e8cea31b65@wiesinger.com> User-Agent: NeoMutt/20180716 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org --y46btgmwon2ggfsd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Feb 27, 2019 at 07:58:14PM +0100, Gerhard Wiesinger wrote: > On 27.02.2019 10:20, Maxime Ripard wrote: > > On Sun, Feb 24, 2019 at 09:04:57AM +0100, Gerhard Wiesinger wrote: > > > Hello, > > >=20 > > > I've 3 Banana Pi R1, one running with self compiled kernel > > > 4.7.4-200.BPiR1.fc24.armv7hl and old Fedora 25 which is VERY STABLE, = the 2 > > > others are running with Fedora 29 latest, kernel 4.20.10-200.fc29.arm= v7hl. I > > > tried a lot of kernels between of around 4.11 > > > (kernel-4.11.10-200.fc25.armv7hl) until 4.20.10 but all had crashes w= ithout > > > any output on the serial console or kernel panics after a short time = of > > > period (minutes, hours, max. days) > > >=20 > > > Latest known working and stable self compiled kernel: kernel > > > 4.7.4-200.BPiR1.fc24.armv7hl: > > >=20 > > > https://www.wiesinger.com/opensource/fedora/kernel/BananaPi-R1/ > > >=20 > > > With 4.8.x the DSA b53 switch infrastructure has been introduced which > > > didn't work (until ca8931948344c485569b04821d1f6bcebccd376b and kernel > > > 4.18.x): > > >=20 > > > https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/tree= /drivers/net/dsa/b53?h=3Dv4.20.12 > > >=20 > > > https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/log/= drivers/net/dsa/b53?h=3Dv4.20.12 > > >=20 > > > https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/comm= it/drivers/net/dsa/b53?h=3Dv4.20.12&id=3Dca8931948344c485569b04821d1f6bcebc= cd376b > > >=20 > > > I has been fixed with kernel 4.18.x: > > >=20 > > > https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/log/= drivers/net/dsa/b53?h=3Dlinux-4.18.y > > >=20 > > >=20 > > > So current status is, that kernel crashes regularly, see some samples= below. > > > It is typically a "Unable to handle kernel paging request at virtual = addres" > > >=20 > > > Another interesting thing: A Banana Pro works well (which has also an > > > Allwinner A20 in the same revision) running same Fedora 29 and latest > > > kernels (e.g. kernel 4.20.10-200.fc29.armv7hl.). > > >=20 > > > Since it happens on 2 different devices and with different power supp= lies > > > (all with enough power) and also the same type which works well on the > > > working old kernel) a hardware issue is very unlikely. > > >=20 > > > I guess it has something to do with virtual memory. > > >=20 > > > Any ideas? > > > [47322.960193] Unable to handle kernel paging request at virtual addr= es 5675d0 > > That line is a bit suspicious > >=20 > > Anyway, cpufreq is known to cause those kind of errors when the > > voltage / frequency association is not correct. > >=20 > > Given the stack trace and that the BananaPro doesn't have cpufreq > > enabled, my first guess would be that it's what's happening. Could you > > try using the performance governor and see if it's more stable? > >=20 > > If it is, then using this: > > https://github.com/ssvb/cpuburn-arm/blob/master/cpufreq-ljt-stress-test > >=20 > > will help you find the offending voltage-frequency couple. > > For me it looks like they have all the same config regarding cpu governor > (Banana Pro, old kernel stable one, new kernel unstable ones) The Banana Pro doesn't have a regulator set up, so it will only change the frequency, not the voltage. > They all have the ondemand governor set: >=20 > I set on the 2 unstable "new kernel Banana Pi R1": >=20 > # Set to max performance > echo "performance" > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor > echo "performance" > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor What are the results? > Running some stress tests are ok (I did that already in the past, but > without setting maximum performance governor). Which stress tests have you been running? Maxime --=20 Maxime Ripard, Bootlin Embedded Linux and Kernel engineering https://bootlin.com --y46btgmwon2ggfsd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEABYIAB0WIQRcEzekXsqa64kGDp7j7w1vZxhRxQUCXHerVAAKCRDj7w1vZxhR xRwDAQCGdTiXZQdCkQJEFPhFXYILEbJ90fTxJZTyeqNeGi1PigEA4VqTGGg8x+U1 8jWECOpya2M6Za6558+iRGJQTIVx8wA= =cnxS -----END PGP SIGNATURE----- --y46btgmwon2ggfsd--