From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail.kapsi.fi (mail-auth.kapsi.fi [91.232.154.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4DB8623B616; Tue, 17 Jun 2025 04:42:28 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=91.232.154.24 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1750135351; cv=none; b=ajihhFGNUEzLKZRTBXhk6fMDkBtNIW2/NZ17rmgxjCFdSrjFr/kSZbRVCAFQ0kwUT/sKyHEP0FTRIwP/sTt0CPyUlVs4a0EYiwVG0soQAPRbpNtrHLY32asFVdED0nw/WsyE/ClxYq3TCtbXP8mDp+KyP+3ZbYJGmYeNRqjvU+Q= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1750135351; c=relaxed/simple; bh=/12dp0EMafULqSp0CwOygIFXCfc49tCDLM+NaaeFG8A=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=NU8yXkhFZ9g2M3h+1y2ZSpTHJwAksDt1Smnq+vo6mrKEq/Qxb6+OIyLM3OSFqKkXEVDxiRY2yFrwTWD5taoqxHgH/Ojh4x7nPOhAvBE5vGnEeFNWmdmu0IM98S3gEmHwlixJmCm/a4o5UTVwvhVQUsWxtOrdyzHrLDZL6aD6woc= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=kapsi.fi; spf=pass smtp.mailfrom=kapsi.fi; dkim=pass (2048-bit key) header.d=kapsi.fi header.i=@kapsi.fi header.b=v3VMrW66; arc=none smtp.client-ip=91.232.154.24 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=kapsi.fi Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=kapsi.fi Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kapsi.fi header.i=@kapsi.fi header.b="v3VMrW66" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=kapsi.fi; s=20161220; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:From: References:Cc:To:Subject:MIME-Version:Date:Message-ID:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=rh2mMoWjRh3SX7xDrdHlN7lmH4Pg4ttIlXMfnsFnqbM=; b=v3VMrW66asQhxK0ZFFdodkXKFl RL+S3qmnNHDm+Awh8KGeOYZXNe8VivE8BrK485Y2PgaQnBqoQdU2KjaI0ImvyEVWptXQxvYa7lxuP MUgXN6wAgSa15GQerKq1nbmNjuxAed9+yYpzNhxkCF4pwobf36mXHfJb3qo/Id4f4mBlHrFU40XG0 cv1lw+s0oaztXaFbl5HXsVyyaa/aQ1q6zp4C6lu9EKoiOTFlP5z51W2ksvoRYct/fjwkU1MijQvS3 GkqTzgN93/qHBQcgfQcFOxtWO1S7JbRlPcjNh984wcvcrH07R49SPIsEoWKFLzH1k/ZlrND49M5Yo K2Y7osEQ==; Received: from [2404:7a80:b960:1a00:5eaa:b33c:a197:a90f] by mail.kapsi.fi with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1uRO9I-00ASil-3C; Tue, 17 Jun 2025 07:42:17 +0300 Message-ID: <36898d74-d9f7-4c5a-b6f2-d9652c674b84@kapsi.fi> Date: Tue, 17 Jun 2025 13:40:58 +0900 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH 0/3] NVIDIA Tegra210 NVJPG support To: Diogo Ivo , Thierry Reding Cc: Mikko Perttunen , David Airlie , Simona Vetter , Jonathan Hunter , Philipp Zabel , Rob Herring , Krzysztof Kozlowski , Conor Dooley , linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org, linux-tegra@vger.kernel.org, devicetree@vger.kernel.org References: <20250606-diogo-nvjpg-v1-0-5f2c36feeb39@tecnico.ulisboa.pt> <621a9459-f2dd-4b19-a083-0e62f1a42f50@kapsi.fi> <96b721cd-7223-4b28-a3fd-a4d92c9d5142@tecnico.ulisboa.pt> <4cibh66elviiatataa45lsfcyeovkqyxe4fjvfh7uqddhsbe6z@svt2dgeafrdh> <78cc8814-c89f-4a5f-9a70-08ed69580c3f@tecnico.ulisboa.pt> Content-Language: en-US From: Mikko Perttunen In-Reply-To: <78cc8814-c89f-4a5f-9a70-08ed69580c3f@tecnico.ulisboa.pt> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-SA-Exim-Connect-IP: 2404:7a80:b960:1a00:5eaa:b33c:a197:a90f X-SA-Exim-Mail-From: cyndis@kapsi.fi X-SA-Exim-Scanned: No (on mail.kapsi.fi); SAEximRunCond expanded to false On 6/16/25 7:21 PM, Diogo Ivo wrote: > > > On 6/11/25 4:06 PM, Thierry Reding wrote: >> On Wed, Jun 11, 2025 at 01:05:40PM +0100, Diogo Ivo wrote: >>> >>> >>> On 6/10/25 10:52 AM, Mikko Perttunen wrote: >>>> On 6/10/25 6:05 PM, Thierry Reding wrote: >>>>> On Fri, Jun 06, 2025 at 11:45:33AM +0100, Diogo Ivo wrote: >>>>>> Hello, >>>>>> >>>>>> This series adds support for the NVJPG hardware accelerator found >>>>>> in the >>>>>> Tegra210 SoC. >>>>>> >>>>>> The kernel driver is essentially a copy of the NVDEC driver as both >>>>>> engines are Falcon-based. >>>>>> >>>>>> For the userspace part I have written a Mesa Gallium backend [1] >>>>>> that, >>>>>> while still very much experimental, works in decoding images >>>>>> with VA- API. >>>>>> >>>>>> I have been using ffmpeg to call VA-API with the following command: >>>>>> >>>>>> ffmpeg -v verbose -hwaccel vaapi -hwaccel_device >>>>>> /dev/dri/renderD129 -i -pix_fmt bgra -f fbdev >>>>>> /dev/fb0 >>>>>> >>>>>> which decodes and shows the result in the framebuffer. >>>>>> >>>>>> The firmware for the engine can be obtained from a Linux for Tegra >>>>>> distribution. >>>>> >>>>> By the way, have you tried running this on anything newer than >>>>> Tegra210? >>>>> Given your progress on this, we can probably start thinking about >>>>> submitting the binaries to linux-firmware. >>>> >>>> FWIW, the impression I have is that NVJPG is basically unchanged all >>>> the >>>> way to Tegra234. So if we add stream ID support and the firmwares, >>>> it'll >>>> probably just work. Tegra234 has the quirk that it has two instances of >>>> NVJPG -- these have to be distinguished by their different class IDs. >>>> But we should go ahead with the T210 support first. >>> >>> I have a question here, what exactly are the stream IDs? While working >>> on the driver this came up and I didn't manage to figure it out. >> >> Stream IDs are a way to identify memory transactions as belonging to a >> certain device. This comes into play when working with the IOMMU (which >> is a Tegra SMMU on Tegra210 and earlier, and an ARM SMMU on Tegra) and >> is used to isolate DMA capable devices. Basically for every stream ID >> you get a separate I/O address space. NVJPG will have its own address >> space, and so will VIC. Each device can only access whatever has been >> mapped to it's I/O address space. That means NVJPG can't interfere with >> VIC and vice-versa. And neither can any of these engines read from or >> write to random system memory if badly programmed. > > So if I understand this correctly a Stream ID corresponds to an IOMMU > domain right? Technically not necessarily, but in practice that's the case, as the IOMMU driver creates IOMMU domains for each stream ID in the device tree. They are similar to the SWGROUPs on Tegra210. > >> For Tegra SMMU there's no such thing as programmable stream IDs, so the >> stream ID is fixed for the given device. >> >> On newer chips (Tegra186 and later, or maybe it wasn't until Tegra194), >> certain IP blocks have special registers that can be used to override >> the stream ID. There's also a way to set the stream ID via command >> streams, which means that you can have different I/O address spaces (I >> think we call them memory context) per engine, which means that you can >> isolate different processes using the same engine from each other. >> >> Again, for Tegra210 that's nothing we need to worry about. For newer >> chips it's probably just a matter of adding .get_streamid_offset() and >> .can_use_memory_ctx() implementations. > > Ok, then in that case I'll keep the driver in its current state without > these implementations if that's ok. Connected with this I wanted to know > your thoughts on the best way to upstream this, is it better to wait for > testing on different platforms first and then if things work merge a > driver that works for all of them or go with Tegra210 first and then add > more platforms later on? Personally, I'd say to go for Tegra210 first. > > Thanks, > Diogo > Cheers Mikko