From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.remote-ip=204.191.154.188 ARC-Seal: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; cv=none; t=1794934357; b=v3pP3AVwqhjdBQQKHut0t4E5O81L74rv0UVRyqGOZ/B/Vr9F5I7tGlXE/Xm14F333ai4 nxh/WBd5TAueJ3DVKeCZjIJC3oKLK+LwrwljsY+scdqKo6VRrqsSFtxcyyaRavfKftbVS 3uzxb2LuXsCdTTVmHzGpl343HDM7LnfbDlFPfepRkaeTRHxwgPtRo/RkoGD4U82QhCAOk oTPnyGtq8irVlAI8k9IYz29u+SHaHNa715aXPqoIVBdV1DhvIQw74c4R0HcqJnL5pLzac dAkqiwcH+3W8TC1jmdn6PAXNN8xLpQqOE0P75lXZoXjB1FuIX+hkfU1MAz18BRczuVQ== ARC-Message-Signature: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; c=relaxed/relaxed; t=1794934357; h=DMARC-Filter:DKIM-Signature:Received:Received:From:To:Cc:Date: Message-ID:X-Mailer:In-Reply-To:References:MIME-Version: Content-Transfer-Encoding:X-SA-Exim-Connect-IP:X-SA-Exim-Rcpt-To: X-SA-Exim-Mail-From:X-Spam-Checker-Version:X-Spam-Level:X-Spam-Status: Subject:X-SA-Exim-Version:X-SA-Exim-Scanned; bh=KvzrpU/GOXaMFs9bwL8cs17RD3ZQDpf1woCUd9WRUPQ=; b=I8mIT4O8SV460MKiqFPtMoh8keY3lSUcv0C0IKFChnTcciHNUDzhEs2RfS4o/6/a64YP DTTG++6JvD5yAXdAwZUGhlBqcoT7Gew76UZlvqv22d0ki6lCHTwpn/S4qv6m2suieI/uY A0vRX+ABdVzfeCKY4TUWSkhM6zeP6LwVXWTv3eILVzPm6OVcDqVmtzgD/W5KwTnFsy9Sq du5CRC8nBN7pB8GTiZ3wv+ABb9R0jZmRKter6tHmiguB5/b/h5bUuNF3okjpRRuB9Yk+F T+uns0aSIc9LzF2Ubtxpf2iLMM6DBrbjis82IZYKIln2b+IwUQdHfj1f41AgS1r08CQ== ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass header.from=deltatee.com; spf=pass smtp.mailfrom=deltatee.com; dkim=pass header.d=deltatee.com header.i=@deltatee.com header.a=rsa-sha256 header.s=20200525 header.b=cX9L4kn5; arc=none smtp.remote-ip=204.191.154.188 Received: from ale.deltatee.com (ale.deltatee.com [204.191.154.188]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id A58F0606A897; Tue, 17 Nov 2026 16:52:36 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.2 smtp.subspace.kernel.org A58F0606A897 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=deltatee.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=deltatee.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=deltatee.com header.i=@deltatee.com header.a=rsa-sha256 header.s=20200525 header.b=cX9L4kn5 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=deltatee.com; s=20200525; h=Subject:MIME-Version:References:In-Reply-To: Message-ID:Date:Cc:To:From:content-disposition; bh=KvzrpU/GOXaMFs9bwL8cs17RD3ZQDpf1woCUd9WRUPQ=; b=cX9L4kn5Yfckvmo2E0YXZQq5QC gX+V3KP+sqKMqVmS6gUphEk7fcw2tnXKVXIvmseNMb5oMWKP7LQNeWxcZxhmCXBAy+HFVUH1LNmN4 xXx/uYmnJPm54AFYMxiSiF7m50WK8Hmx6MDLvEMH+dHoFsBBfumxfzuB80H4AYAZiv0bWWBOBZdlj IHBetnnTPJpnUrsfB/klILtgjSmCaCmaBaC9CMeHw2OE9LES7gZpVzM87vpWWHkBPj6rtYLrFxqsV K2qoNq9YKWILWjyHRFKZKnQbzccu1/75wnwh7VzdeMU+74zOn8CFWVgvTDKm6De/yxyg3ve/oG19C 7f3efYug==; Received: from donard.priv.deltatee.com ([172.16.1.31]) by ale.deltatee.com with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.98.2) (envelope-from ) id 1xTMQ6-00000001RAY-2qdA; Tue, 17 Nov 2026 10:52:35 -0600 Received: from logang by donard.priv.deltatee.com with local (Exim 4.98.2) (envelope-from ) id 1xTMPC-0000000388k-0PGZ; Tue, 17 Nov 2026 10:51:38 -0600 From: Logan Gunthorpe To: dmaengine@vger.kernel.org, linux-kernel@vger.kernel.org, Vinod Koul Cc: Frank Li , Logan Gunthorpe , Sashiko Date: Tue, 17 Nov 2026 10:51:35 -0600 Message-ID: <20261117165135.746241-7-logang@deltatee.com> X-Mailer: git-send-email 2.47.3 In-Reply-To: <20261117165135.746241-1-logang@deltatee.com> References: <20261117165135.746241-1-logang@deltatee.com> X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SA-Exim-Connect-IP: 172.16.1.31 X-SA-Exim-Rcpt-To: dmaengine@vger.kernel.org, linux-kernel@vger.kernel.org, Frank.li@nxp.com, logang@deltatee.com, vkoul@kernel.org, sashiko-bot@kernel.org X-SA-Exim-Mail-From: logang@deltatee.com X-Spam-Level: Subject: [PATCH v3 6/6] dmaengine: plx_dma: don't invoke client callbacks with ring_lock held X-SA-Exim-Version: 4.2.1 (built Sun, 23 Feb 2025 07:57:16 +0000) X-SA-Exim-Scanned: Yes (on ale.deltatee.com) plx_dma_process_desc() and plx_dma_abort_desc() invoke the client's completion callback with ring_lock held. A callback that submits a new transfer, which is common, deadlocks taking the same lock in plx_dma_prep_memcpy(). Copy and clear the callback and advance tail under ring_lock, then drop it to invoke the callback. To keep callbacks in order and ensure plx_dma_free_chan_resources() can't return while one is still running from plx_dma_remove(), serialize completion with a new complete_lock held across the whole loop. plx_dma_tx_status() only trylocks it, so a callback that polls the channel won't deadlock. Fixes: 4d3df16840a2 ("dmaengine: plx-dma: Implement descriptor submission") Reported-by: Sashiko Link: https://lore.kernel.org/dmaengine/20260717223217.B6FBF1F000E9@smtp.kernel.org Signed-off-by: Logan Gunthorpe --- drivers/dma/plx_dma.c | 45 ++++++++++++++++++++++++++++++++++++------- 1 file changed, 38 insertions(+), 7 deletions(-) diff --git a/drivers/dma/plx_dma.c b/drivers/dma/plx_dma.c index 725df770d5de..09dc44dc8f61 100644 --- a/drivers/dma/plx_dma.c +++ b/drivers/dma/plx_dma.c @@ -108,6 +108,8 @@ struct plx_dma_dev { void __iomem *bar; struct tasklet_struct desc_task; + /* serializes descriptor completion and callback invocation */ + spinlock_t complete_lock; spinlock_t ring_lock; bool ring_active; int head; @@ -132,12 +134,15 @@ static struct plx_dma_desc *plx_dma_get_desc(struct plx_dma_dev *plxdev, int i) return plxdev->desc_ring[i & (PLX_DMA_RING_COUNT - 1)]; } -static void plx_dma_process_desc(struct plx_dma_dev *plxdev) +static void plx_dma_process_desc_unlocked(struct plx_dma_dev *plxdev) { + struct dmaengine_desc_callback cb; struct dmaengine_result res; struct plx_dma_desc *desc; u32 flags; + lockdep_assert_held(&plxdev->complete_lock); + spin_lock_bh(&plxdev->ring_lock); while (plxdev->tail != plxdev->head) { @@ -166,22 +171,35 @@ static void plx_dma_process_desc(struct plx_dma_dev *plxdev) dma_cookie_complete(&desc->txd); dma_descriptor_unmap(&desc->txd); - dmaengine_desc_get_callback_invoke(&desc->txd, &res); + dmaengine_desc_get_callback(&desc->txd, &cb); desc->txd.callback = NULL; desc->txd.callback_result = NULL; - plxdev->tail++; + + spin_unlock_bh(&plxdev->ring_lock); + dmaengine_desc_callback_invoke(&cb, &res); + spin_lock_bh(&plxdev->ring_lock); } spin_unlock_bh(&plxdev->ring_lock); } +static void plx_dma_process_desc(struct plx_dma_dev *plxdev) +{ + spin_lock_bh(&plxdev->complete_lock); + plx_dma_process_desc_unlocked(plxdev); + spin_unlock_bh(&plxdev->complete_lock); +} + static void plx_dma_abort_desc(struct plx_dma_dev *plxdev) { + struct dmaengine_desc_callback cb; struct dmaengine_result res; struct plx_dma_desc *desc; - plx_dma_process_desc(plxdev); + spin_lock_bh(&plxdev->complete_lock); + + plx_dma_process_desc_unlocked(plxdev); spin_lock_bh(&plxdev->ring_lock); @@ -193,14 +211,18 @@ static void plx_dma_abort_desc(struct plx_dma_dev *plxdev) dma_cookie_complete(&desc->txd); dma_descriptor_unmap(&desc->txd); - dmaengine_desc_get_callback_invoke(&desc->txd, &res); + dmaengine_desc_get_callback(&desc->txd, &cb); desc->txd.callback = NULL; desc->txd.callback_result = NULL; - plxdev->tail++; + + spin_unlock_bh(&plxdev->ring_lock); + dmaengine_desc_callback_invoke(&cb, &res); + spin_lock_bh(&plxdev->ring_lock); } spin_unlock_bh(&plxdev->ring_lock); + spin_unlock_bh(&plxdev->complete_lock); } static void __plx_dma_stop(struct plx_dma_dev *plxdev) @@ -337,7 +359,15 @@ static enum dma_status plx_dma_tx_status(struct dma_chan *chan, if (ret == DMA_COMPLETE) return ret; - plx_dma_process_desc(plxdev); + /* + * If another context is already completing descriptors (possibly + * a callback on this CPU that is polling the channel), let it + * finish rather than waiting on it. + */ + if (spin_trylock_bh(&plxdev->complete_lock)) { + plx_dma_process_desc_unlocked(plxdev); + spin_unlock_bh(&plxdev->complete_lock); + } return dma_cookie_status(chan, cookie, txstate); } @@ -516,6 +546,7 @@ static int plx_dma_create(struct pci_dev *pdev) if (!plxdev) return -ENOMEM; + spin_lock_init(&plxdev->complete_lock); spin_lock_init(&plxdev->ring_lock); tasklet_setup(&plxdev->desc_task, plx_dma_desc_task); -- 2.47.3