* Linux 6.1.52 regression: Intel QAT kernel panic (memory corruption)
@ 2023-09-15 5:27 Kyle Sanderson
2023-09-15 5:55 ` Giovanni Cabiddu
0 siblings, 1 reply; 3+ messages in thread
From: Kyle Sanderson @ 2023-09-15 5:27 UTC (permalink / raw)
To: Linux-Kernal, qat-linux
Cc: Greg KH, Linus Torvalds, Linux Crypto Mailing List, Giovanni Cabiddu
Hello Intel QAT Maintainers,
It looks like QAT has regressed again. The present symptom is just
straight up memory corruption. I was running Canonical 6.1.0-1017-oem
and it doesn't happen, with 6.1.0-1020-oem and 6.1.0-1021-oem it does.
I don't know what these map to upstream, however with NixOS installed
the same corruption failure occurs on 6.1.52. The stack traces give
illegal instructions and all kinds of badness across all modules when
the device is simply present on the system, resulting in a hung
system, or a multitude of processes crashing and the system failing to
start. Disabling the device in the system BIOS results in a working
system, and no extreme corruption. kmem_cache_alloc_node is the common
fixture in the traces (I don't have a serial line), but I suspect
that's not where the problem is. The corruption this time happens
without block crypto being involved, and simply booting the installer
from a USB stick.
I genuinely do not understand how this keeps breaking in these
critical contexts completely hosing the machine. I was under the
impression it was disabled on this box the entire time since the last
run-in with this, but it must have gotten flipped back on when I did a
firmware update back in December 2022.
Kyle.
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: Linux 6.1.52 regression: Intel QAT kernel panic (memory corruption)
2023-09-15 5:27 Linux 6.1.52 regression: Intel QAT kernel panic (memory corruption) Kyle Sanderson
@ 2023-09-15 5:55 ` Giovanni Cabiddu
2023-10-05 3:55 ` Kyle Sanderson
0 siblings, 1 reply; 3+ messages in thread
From: Giovanni Cabiddu @ 2023-09-15 5:55 UTC (permalink / raw)
To: Kyle Sanderson
Cc: Linux-Kernal, qat-linux, Greg KH, Linus Torvalds,
Linux Crypto Mailing List
On Thu, Sep 14, 2023 at 10:27:22PM -0700, Kyle Sanderson wrote:
> Hello Intel QAT Maintainers,
>
> It looks like QAT has regressed again. The present symptom is just
> straight up memory corruption. I was running Canonical 6.1.0-1017-oem
> and it doesn't happen, with 6.1.0-1020-oem and 6.1.0-1021-oem it does.
> I don't know what these map to upstream, however with NixOS installed
> the same corruption failure occurs on 6.1.52. The stack traces give
> illegal instructions and all kinds of badness across all modules when
> the device is simply present on the system, resulting in a hung
> system, or a multitude of processes crashing and the system failing to
> start. Disabling the device in the system BIOS results in a working
> system, and no extreme corruption. kmem_cache_alloc_node is the common
> fixture in the traces (I don't have a serial line), but I suspect
> that's not where the problem is. The corruption this time happens
> without block crypto being involved, and simply booting the installer
> from a USB stick.
This is probably be related to [1].
Versions from 6.1.39 to 6.1.52 are affected. Fixed in v6.1.53.
[1] https://www.spinics.net/lists/stable/msg678947.html
Regards,
--
Giovanni
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: Linux 6.1.52 regression: Intel QAT kernel panic (memory corruption)
2023-09-15 5:55 ` Giovanni Cabiddu
@ 2023-10-05 3:55 ` Kyle Sanderson
0 siblings, 0 replies; 3+ messages in thread
From: Kyle Sanderson @ 2023-10-05 3:55 UTC (permalink / raw)
To: Giovanni Cabiddu
Cc: Linux-Kernal, qat-linux, Greg KH, Linus Torvalds,
Linux Crypto Mailing List
On Thu, Sep 14, 2023 at 10:55 PM Giovanni Cabiddu
<giovanni.cabiddu@intel.com> wrote:
>
> On Thu, Sep 14, 2023 at 10:27:22PM -0700, Kyle Sanderson wrote:
> > Hello Intel QAT Maintainers,
> >
> > It looks like QAT has regressed again. The present symptom is just
> > straight up memory corruption. I was running Canonical 6.1.0-1017-oem
> > and it doesn't happen, with 6.1.0-1020-oem and 6.1.0-1021-oem it does.
> > I don't know what these map to upstream, however with NixOS installed
> > the same corruption failure occurs on 6.1.52.
> This is probably be related to [1].
> Versions from 6.1.39 to 6.1.52 are affected. Fixed in v6.1.53.
>
> [1] https://www.spinics.net/lists/stable/msg678947.html
>
> Regards,
>
> --
> Giovanni
Thank you Giovanni - that appears to have been it. Ubuntu
6.1.0-1023-oem (v6.1.53) no longer reproduces the issue.
K.
On Thu, Sep 14, 2023 at 10:55 PM Giovanni Cabiddu
<giovanni.cabiddu@intel.com> wrote:
>
> On Thu, Sep 14, 2023 at 10:27:22PM -0700, Kyle Sanderson wrote:
> > Hello Intel QAT Maintainers,
> >
> > It looks like QAT has regressed again. The present symptom is just
> > straight up memory corruption. I was running Canonical 6.1.0-1017-oem
> > and it doesn't happen, with 6.1.0-1020-oem and 6.1.0-1021-oem it does.
> > I don't know what these map to upstream, however with NixOS installed
> > the same corruption failure occurs on 6.1.52. The stack traces give
> > illegal instructions and all kinds of badness across all modules when
> > the device is simply present on the system, resulting in a hung
> > system, or a multitude of processes crashing and the system failing to
> > start. Disabling the device in the system BIOS results in a working
> > system, and no extreme corruption. kmem_cache_alloc_node is the common
> > fixture in the traces (I don't have a serial line), but I suspect
> > that's not where the problem is. The corruption this time happens
> > without block crypto being involved, and simply booting the installer
> > from a USB stick.
> This is probably be related to [1].
> Versions from 6.1.39 to 6.1.52 are affected. Fixed in v6.1.53.
>
> [1] https://www.spinics.net/lists/stable/msg678947.html
>
> Regards,
>
> --
> Giovanni
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2023-10-05 13:59 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2023-09-15 5:27 Linux 6.1.52 regression: Intel QAT kernel panic (memory corruption) Kyle Sanderson
2023-09-15 5:55 ` Giovanni Cabiddu
2023-10-05 3:55 ` Kyle Sanderson
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®