From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-wm1-f48.google.com (mail-wm1-f48.google.com [209.85.128.48]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8761C45516F for ; Fri, 14 Aug 2026 11:08:41 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.128.48 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786705725; cv=none; b=rmQx2SyIMxEB+CahcotJIx8Eh6T8ITvs4R0mEQjkRXl8KT/RPt8Eu1DTIY3u4taOFsziPsADKs3uZDTQ+mCsVOW3zsFRXk+szWiiVnCY9ZFlJqaPcCaQ5YWUMv6nCtuy99gYe41N+Zip5FAb0RnwOb3WCYKf2JLzkbJ1ODqh+dY= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786705725; c=relaxed/simple; bh=dsxvBEh3Q+6dUdvw2xn9QkezJfOgFIX5eXbdEvkGZbw=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=ceu5APC1ESez/LtxG8M0DMftxNZEVGusv/sPsalszEitJg2jOj1fMtwYelbPU4ghZjyQPc3NLFYBW5ZexYLHmhDe4nmIEQGDqKF1JuLRaBvtv6ccgwuZCXKpLrzKWtviD51PTD2FysueJUOo/P2Go4sUUPue0lYKIgZeBZfL30U= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=iZb6voCj; arc=none smtp.client-ip=209.85.128.48 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="iZb6voCj" Received: by mail-wm1-f48.google.com with SMTP id 5b1f17b1804b1-4954c08a7c8so372825e9.3 for ; Fri, 14 Aug 2026 04:08:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1786705717; x=1787310517; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to:content-type; bh=7S7sFuRCjatzs09JKRbH4HGwrINbYlULF/Unkzu0baA=; b=iZb6voCj3BrLVTU1/Vm+4UfRJZWKTNrPA23xWo+j/Va6k7wCUp4TcJq0qMxJb0oGzv vWQ+0WYfSNKBa9eteY+5PJSc6+n60lU4E6rh/eaHH7lHsWCwI1DzB08AOltxc9HMWNpV dtufo3bbSLQy7kjlVdRNgkIe9y7CawNKQIrn2dpVsxU6RcQqr8sPnINzm56BtSb/MERI 5Q0NuHIY5jYIZdhLXsBsvlIOkD7HJGi1cmQPDXxmkKLr49TW6r2k7uqY4Uo6PIJE5whW /WZvLnOHryL+kZtZiT8nO+LumbMkYMTn+x7YkXgzawf4WcaHIZKrXe0J/xxjJDdYFuXf 6oPw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1786705717; x=1787310517; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to:content-type; bh=7S7sFuRCjatzs09JKRbH4HGwrINbYlULF/Unkzu0baA=; b=HR/8Qm0Dp2mPe1Cq/fCgxYPdp3LkcqXiqio7JQYP4miD5+xU+wZqWSOHh0HVx77MnY DedtP6Xm5Xu9+TsE3Oih2BooE6rEGBV2URMdaf3ggOsaLsdmnjqvoFzrc1//SfsVidaj xHyLlXpXECpxQs9U8rwrzPx6HEnfJOHNfLteXW222rpe8z3t7JRmUlru39a122GxAoGi USM1YriQV0rtn8UlW0OffYFmb7RFp24EZeOE2mXwJQ46aSrpyjzfeJl9Lh1YSS5RuBJZ r7yiiY1gFVF7WKKf0CZQbaHi9rrcTB98k/mR3tOiLFYotLBRRTdt01A9p0IEDZsj2EVg s3DA== X-Forwarded-Encrypted: i=1; AHgh+RrvF8CNii+r6Tjd01UIaCLopnPVM2bBmaxJ9hi6SWYD+vdMgyuUFvXDYlWBnAS8Hr4/IWUGTmHjdgvg24o=@vger.kernel.org X-Gm-Message-State: AOJu0Yz+wbxd1kEsEdCPiDick5LOhlweiO6Jnty2BNGlzlB1BLfdPupJ 781vIQ/oJ6huLY8mzfXTSkmQdQ/CQH/PgycNvw5awYKKBXY7o1mIzD6I X-Gm-Gg: AR+sD10ZYoi/IWxLZ6VDZCsVLEhzX5vVy7pDzcnK41xJ11d3Q926bd1uT0L3As4raG9 wwQ0YmtVnjIvR01J6CJEsw/SdLoc8FtDUkDRlz1HKt2c4uTsjOuUervLorQ9RyqH8KypPalgEPW 6igkBw+4wg/3aXY8G5KtMLgpgHjFD+dIvdLEGm6QEpHpHXwaUuBq+XiItKe24eg/15e0wYQpzY9 OSQdmYPaUw64yAuXJjBj5xQ/JzTIo1DTivK5bsS4KszXMLYelGIXGbJR1KxUJEUMbJSlUvK5aYV p/fl9cGAsDTosGxIFTecnxs2ONRlrMO3P5DAyPA+MmnKG1PtweVKjP+Vjr92k54NqKhys//c3Eo ZlvSPZPsmr3VEKNCoQic2wfb4xM83TAnQh25g9G23jckwy+FzusEoLW/gGDv9h4tg3qGXQ3Lwqe FrQMZVV4x+7Fh9p3GfBx1gHSxRtT8BrEu4rhit0O5HNlqMijBHM9M6uP5r7usKmMcWKwji0Hflc lPQSSdWCSJXp5L8uTd8mBkXSu707EwbqSo0SBCeVV/5TrLPJjw7u/WJ4rc2d4WLd4cTxg== X-Received: by 2002:a05:600c:1395:b0:499:77de:78ba with SMTP id 5b1f17b1804b1-499879826b2mr34045235e9.2.1786705717053; Fri, 14 Aug 2026 04:08:37 -0700 (PDT) Received: from OrangePi5-Plus.BB-HOME (20014C4E1B8D33002713106A8ABE6E8B.dsl.pool.telekom.hu. [2001:4c4e:1b8d:3300:2713:106a:8abe:6e8b]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-499877d7974sm37724265e9.1.2026.08.14.04.08.35 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 14 Aug 2026 04:08:35 -0700 (PDT) From: Igor Paunovic To: Jiaxing Hu Cc: Igor Paunovic , Tomeu Vizoso , =?UTF-8?q?Heiko=20St=C3=BCbner?= , Chaoyi Chen , alchark@flipper.net, dri-devel@lists.freedesktop.org, linux-rockchip@lists.infradead.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH v7 08/10] accel/rocket: add RK3576 NPU (RKNN) support Date: Fri, 14 Aug 2026 13:08:21 +0200 Message-ID: <20260814110825.14893-1-royalnet026@gmail.com> X-Mailer: git-send-email 2.53.0 In-Reply-To: <20260814082652.3852617-1-gahing@gahingwoo.com> References: <20260812094106.1391698-1-gahing@gahingwoo.com> <20260812094106.1391698-9-gahing@gahingwoo.com> <20260813095718.9747-1-royalnet026@gmail.com> <20260814082652.3852617-1-gahing@gahingwoo.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Hi Jiaxing, Here is the RK3588 column, all 27 operators, ROCKET_SEED=7, scored the way perch.py scores: a channel is good when its maxdiff (md below) against max(cpu, output zero point) is at most 1. Setup: Orange Pi 5 Plus (RK3588), kernel 7.2.0-rc6, the rocket driver from this kernel's tree rebuilt with my clocks-by-name and devfreq patches on top, Mesa at bf70ab68a21, teflon delegate, model mobilenet_v1_1_224_quant.tflite from the Mesa test suite (md5 4f348b87dca3315d2b3646cf5a3b31cf), per-operator models generated with the four byte output patch you described. The "correct hw" column is your chainmodel.py against the same model file. One difference to flag up front: against this model file chainmodel prints 36/256 for operator 8 where your table has 34/256, so our model files are not byte-identical, and the columns below should be read against each other rather than against your FINDINGS numbers. op kind correct hw RK3588 0 conv 32/32 md 1 32/32 md 1 1 depthwise 28/32 md 3 28/32 md 3 2 1x1 22/64 md 6 22/64 md 6 3 depthwise 21/64 md 13 21/64 md 13 4 1x1 18/128 md 14 8/128 md 15 5 depthwise 9/128 md 13 3/128 md 15 6 1x1 4/128 md 23 1/128 md 24 7 depthwise 7/128 md 10 3/128 md 12 8 1x1 36/256 md 7 20/256 md 17 9 depthwise 32/256 md 11 22/256 md 13 10 1x1 29/256 md 9 28/256 md 10 11 depthwise 53/256 md 8 48/256 md 11 12 1x1 166/512 md 11 121/512 md 13 13 depthwise 142/512 md 9 137/512 md 12 14 1x1 82/512 md 7 72/512 md 10 15 depthwise 154/512 md 10 115/512 md 15 16 1x1 82/512 md 7 71/512 md 10 17 depthwise 156/512 md 14 141/512 md 21 18 1x1 92/512 md 7 77/512 md 10 19 depthwise 170/512 md 7 152/512 md 12 20 1x1 102/512 md 8 84/512 md 10 21 depthwise 166/512 md 13 150/512 md 12 22 1x1 174/512 md 6 161/512 md 7 23 depthwise 293/512 md 5 261/512 md 7 24 1x1 671/1024 md 6 636/1024 md 5 25 depthwise 718/1024 md 9 684/1024 md 8 26 1x1 572/1024 md 25 574/1024 md 23 Three things stand out from here. Operators 0 through 3 score identically to your chain simulation -- same good-channel counts, same maxdiff -- including operator 3, the stride 2 depthwise with the asymmetric padding you suspect for the first RK3576 divergence. They are not byte-identical to the simulated hardware: diffing the raw tensors against the requant_hw chain shows a few hundred elements per surface already off by 1-4 at operators 0-3. That looks like the same small extra rounding difference that pushes the scores below your column from operator 4 on; through operator 3 it just stays under the maxdiff <= 1 scoring threshold. There is no md 255 anywhere. From operator 4 on, RK3588 sits somewhat below the simulation (8 vs 18 at op 4, 1 vs 4 at op 6), but the maxdiff never exceeds 24 across all 27 operators and the deep layers track the simulation closely (574 vs 572 at op 26). A control run with ROCKET_SEED=11 keeps the same character: operator 0 still 32/32, no saturated maxdiff anywhere, worst case md 35 at operator 6. So from the RK3588 side your read looks right: the deep-layer compounding is the reference artifact, and the RK3576 collapse from operator 4 with maxdiff 255 has no counterpart here. Igor