From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from dggsgout12.his.huawei.com (dggsgout12.his.huawei.com [45.249.212.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 9610F23C9; Sat, 16 Nov 2024 03:34:35 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=45.249.212.56 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1731728078; cv=none; b=mKDz6y5MTo/sIPTDqY2UnuMkLR7PPPpW2jkuXpbLwHZaySS2VfIOx9xhQ4KlL1IAse0fTTpE4Jyp6VmfTfP8qZV5ltxvlyA+e6W6GdoryFyO3jP7xx4oi/XxcgeEsGcltt/l51EQ07qVU+edUDUszr8CvakBpY8f/LPY4/p5wkg= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1731728078; c=relaxed/simple; bh=PtOYchu4e5B5zOpId7IMSziVstVUvgwKYqocnbhESk0=; h=Subject:To:Cc:References:From:Message-ID:Date:MIME-Version: In-Reply-To:Content-Type; b=jdlqlmH7Nl3sCATEc/pWUmQ5vLFMVtncMtr8JIq3k84nZuw8LaBSfaV0nuA67RVz2A0Ku6rCiU06+07IQAl+XGuZAH2r1C9lW4b/NvLTMSjp/LwaUH9cofLOIsSlxCbe0wtdhVdQ3rujR1XLwpUDDt3dTxr7hZnbcCgsdTteH7A= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=huaweicloud.com; spf=pass smtp.mailfrom=huaweicloud.com; arc=none smtp.client-ip=45.249.212.56 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=huaweicloud.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=huaweicloud.com Received: from mail.maildlp.com (unknown [172.19.93.142]) by dggsgout12.his.huawei.com (SkyGuard) with ESMTP id 4XqzyY4Yzsz4f3jXt; Sat, 16 Nov 2024 11:34:13 +0800 (CST) Received: from mail02.huawei.com (unknown [10.116.40.128]) by mail.maildlp.com (Postfix) with ESMTP id 012051A018D; Sat, 16 Nov 2024 11:34:31 +0800 (CST) Received: from [10.174.176.73] (unknown [10.174.176.73]) by APP4 (Coremail) with SMTP id gCh0CgBHIobGEjhnAwuqBw--.47705S3; Sat, 16 Nov 2024 11:34:31 +0800 (CST) Subject: Re: md-raid 6.11.8 page fault oops To: Song Liu , Genes Lists , dm-devel@lists.linux.dev, Alasdair Kergon , Mike Snitzer , Mikulas Patocka Cc: linux-raid@vger.kernel.org, linux-kernel@vger.kernel.org, linux@leemhuis.info, "yukuai (C)" References: <0b579808e848171fc64e04f0629e24735d034d32.camel@sapience.com> From: Yu Kuai Message-ID: <058cd646-2d2a-202d-5f99-6e635a95fead@huaweicloud.com> Date: Sat, 16 Nov 2024 11:34:30 +0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-CM-TRANSID:gCh0CgBHIobGEjhnAwuqBw--.47705S3 X-Coremail-Antispam: 1UD129KBjvJXoWxWr47CF1xuF4rGrWkCF1UAwb_yoWrur4kpF 15tF1kCr4vqry8tFyfXr4jvF1qqr4vyF1UJFs5Krn3JF1jgrn8Zr4UGrWjywnrAr47ury3 A34DJrWrKF1rXaUanT9S1TB71UUUUU7qnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDU0xBIdaVrnRJUUU9Fb4IE77IF4wAFF20E14v26r4j6ryUM7CY07I20VC2zVCF04k2 6cxKx2IYs7xG6rWj6s0DM7CIcVAFz4kK6r1j6r18M28lY4IEw2IIxxk0rwA2F7IY1VAKz4 vEj48ve4kI8wA2z4x0Y4vE2Ix0cI8IcVAFwI0_Gr0_Xr1l84ACjcxK6xIIjxv20xvEc7Cj xVAFwI0_Gr0_Cr1l84ACjcxK6I8E87Iv67AKxVW0oVCq3wA2z4x0Y4vEx4A2jsIEc7CjxV AFwI0_GcCE3s1le2I262IYc4CY6c8Ij28IcVAaY2xG8wAqx4xG64xvF2IEw4CE5I8CrVC2 j2WlYx0E2Ix0cI8IcVAFwI0_Jr0_Jr4lYx0Ex4A2jsIE14v26r1j6r4UMcvjeVCFs4IE7x kEbVWUJVW8JwACjcxG0xvEwIxGrwACI402YVCY1x02628vn2kIc2xKxwCYjI0SjxkI62AI 1cAE67vIY487MxkF7I0En4kS14v26r1q6r43MxAIw28IcxkI7VAKI48JMxC20s026xCaFV Cjc4AY6r1j6r4UMI8I3I0E5I8CrVAFwI0_Jr0_Jr4lx2IqxVCjr7xvwVAFwI0_JrI_JrWl x4CE17CEb7AF67AKxVWUtVW8ZwCIc40Y0x0EwIxGrwCI42IY6xIIjxv20xvE14v26r1j6r 1xMIIF0xvE2Ix0cI8IcVCY1x0267AKxVWUJVW8JwCI42IY6xAIw20EY4v20xvaj40_Jr0_ JF4lIxAIcVC2z280aVAFwI0_Jr0_Gr1lIxAIcVC2z280aVCY1x0267AKxVW8JVW8JrUvcS sGvfC2KfnxnUUI43ZEXa7IU17KsUUUUUU== X-CM-SenderInfo: 51xn3trlr6x35dzhxuhorxvhhfrp/ Hi, 在 2024/11/16 1:55, Song Liu 写道: > + dm folks > > It appears the crash happens in dm.c:clone_endio. Commit > aaa53168cbcc486ca1927faac00bd99e81d4ff04 made some > changes to clone_endio, but I haven't looked into it. > > Thanks, > Song > > On Fri, Nov 15, 2024 at 4:12 AM Genes Lists wrote: >> >> md-raid crashed with kernel NULL pointer deref on stable 6.11.8. >> >> Happened with raid6 while rsync was writing (data was pulled over >> network). >> >> This rsync happens twice every day without a problem. This was the >> second run after booting 6.11.8, so will see if/when it happens again - >> and if frequent enough to make a bisect possible. >> >> Nonetheless, reporting now in case it's helpful. >> >> Full dmesg attached but the interesting part is: >> >> [33827.216164] BUG: kernel NULL pointer dereference, address: >> 0000000000000050 >> [33827.216183] #PF: supervisor read access in kernel mode >> [33827.216193] #PF: error_code(0x0000) - not-present page >> [33827.216203] PGD 0 P4D 0 >> [33827.216211] Oops: Oops: 0000 [#1] PREEMPT SMP PTI >> [33827.216221] CPU: 4 UID: 0 PID: 793 Comm: md127_raid6 Not tainted >> 6.11.8-stable-1 #21 1400000003000000474e5500ae13c727d476f9ab >> [33827.216240] Hardware name: To Be Filled By O.E.M. To Be Filled By >> O.E.M./Z370 Extreme4, BIOS P4.20 10/31/2019 >> [33827.216254] RIP: 0010:clone_endio+0x43/0x1f0 [dm_mod] While reporting bugs, it'll be much helpful if you can provide addr2line here, fo example: gdb dm_mod.ko list *(clone_endio+0x43) Thanks, Kuai >> [33827.216279] Code: 4c 8b 77 e8 65 48 8b 1c 25 28 00 00 00 48 89 5c 24 >> 08 48 89 fb 88 44 24 07 4d 85 f6 0f 84 11 01 00 00 49 8b 56 08 4c 8b 6b >> e0 <48> 8b 6a 50 4d 8b 65 38 3c 05 0f 84 0b 01 00 00 66 90 48 85 ed 74 >> [33827.216304] RSP: 0018:ffffb9610101bb40 EFLAGS: 00010282 >> [33827.216315] RAX: 0000000000000000 RBX: ffff9b15b8c5c598 RCX: >> 000000000015000c >> [33827.216326] RDX: 0000000000000000 RSI: ffffec17e1944200 RDI: >> ffff9b15b8c5c598 >> [33827.216338] RBP: 0000000000000000 R08: ffff9b1825108c00 R09: >> 000000000015000c >> [33827.216349] R10: 000000000015000c R11: 00000000ffffffff R12: >> ffff9b10da026000 >> [33827.216360] R13: ffff9b15b8c5c520 R14: ffff9b10ca024440 R15: >> ffff9b1474cb33c0 >> [33827.216372] FS: 0000000000000000(0000) GS:ffff9b185ee00000(0000) >> knlGS:0000000000000000 >> [33827.216385] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >> [33827.216394] CR2: 0000000000000050 CR3: 00000001f4e22005 CR4: >> 00000000003706f0 >> [33827.216406] DR0: 0000000000000000 DR1: 0000000000000000 DR2: >> 0000000000000000 >> [33827.216417] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: >> 0000000000000400 >> [33827.216429] Call Trace: >> [33827.216435] >> [33827.216442] ? __die_body.cold+0x19/0x27 >> [33827.216453] ? page_fault_oops+0x15a/0x2d0 >> [33827.216465] ? exc_page_fault+0x7e/0x180 >> [33827.216475] ? asm_exc_page_fault+0x26/0x30 >> [33827.216486] ? clone_endio+0x43/0x1f0 [dm_mod >> 1400000003000000474e5500e90ca42f094c5280] >> [33827.216510] clone_endio+0x120/0x1f0 [dm_mod >> 1400000003000000474e5500e90ca42f094c5280] >> [33827.216533] md_end_clone_io+0x42/0xa0 [md_mod >> 1400000003000000474e55004ac7ec7b1ac1c22c] >> [33827.216559] handle_stripe_clean_event+0x1e6/0x430 [raid456 >> 1400000003000000474e550080acde909728c7a9] >> [33827.216583] handle_stripe+0x9a3/0x1c00 [raid456 >> 1400000003000000474e550080acde909728c7a9] >> [33827.216606] handle_active_stripes.isra.0+0x381/0x5b0 [raid456 >> 1400000003000000474e550080acde909728c7a9] >> [33827.216625] ? psi_task_switch+0xb7/0x200 >> [33827.216637] raid5d+0x450/0x670 [raid456 >> 1400000003000000474e550080acde909728c7a9] >> [33827.216655] ? lock_timer_base+0x76/0xa0 >> [33827.216666] md_thread+0xa2/0x190 [md_mod >> 1400000003000000474e55004ac7ec7b1ac1c22c] >> [33827.216689] ? __pfx_autoremove_wake_function+0x10/0x10 >> [33827.216701] ? __pfx_md_thread+0x10/0x10 [md_mod >> 1400000003000000474e55004ac7ec7b1ac1c22c] >> [33827.216723] kthread+0xcf/0x100 >> [33827.216731] ? __pfx_kthread+0x10/0x10 >> [33827.216740] ret_from_fork+0x31/0x50 >> [33827.216749] ? __pfx_kthread+0x10/0x10 >> [33827.216757] ret_from_fork_asm+0x1a/0x30 >> [33827.216769] >> >> -- >> Gene >> > . >