From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from ssh247.corpemail.net (ssh247.corpemail.net [210.51.61.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id C62AE2638BF for ; Thu, 22 May 2025 08:08:15 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=210.51.61.247 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1747901301; cv=none; b=Dgij11I7IoKSIZWPfqPLpyE4ARsOmDP9oZtw3B1c8jfUABC89KDFavRedpNcjOFrWpjoa0Fha40FQRVB3qYQ/E4d0EIP5igZrNrlVBIS03FQE5klcX5I7gJ0nO3h9V1gXdqYbfwiXuZ5YNnH9OYkAwIjj80Yqlec+jqZbbqLWAk= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1747901301; c=relaxed/simple; bh=xn0bzdTEqrrB2HhBUSRLE1k7hIDGNEE2RRIdYi69ycc=; h=From:To:CC:Subject:Date:Message-ID:References:In-Reply-To: Content-Type:MIME-Version; b=ttNIhwWE1aga1+jvbuGHu0SC3QC/MzsxlT58nba1hbmKzHJai+vsYzmB2+8B4bBL+6i6E3UhyWY+STMQxaHOwUQz3Q19uBKfVCO2bxhQ+LAB2foAwhDweDkmjfnPSvkyXoOOKchft9jMDL8iXJjjwQp0LVS3Z+d9IGm/R3GeU+w= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=inspur.com; spf=pass smtp.mailfrom=inspur.com; arc=none smtp.client-ip=210.51.61.247 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=inspur.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=inspur.com Received: from jtjnmail201624.home.langchao.com by ssh247.corpemail.net ((D)) with ASMTP (SSL) id 202505221608037672; Thu, 22 May 2025 16:08:03 +0800 Received: from jtjnmail201622.home.langchao.com (10.100.2.22) by jtjnmail201624.home.langchao.com (10.100.2.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Thu, 22 May 2025 16:08:02 +0800 Received: from jtjnmail201622.home.langchao.com ([fe80::15c3:8d74:3aa6:25f6]) by jtjnmail201622.home.langchao.com ([fe80::15c3:8d74:3aa6:25f6%7]) with mapi id 15.01.2507.039; Thu, 22 May 2025 16:08:02 +0800 From: =?utf-8?B?Qm8gTGl1ICjliJjms6IpLea1qua9ruS/oeaBrw==?= To: "hsiangkao@linux.alibaba.com" , "xiang@kernel.org" , "chao@kernel.org" CC: "linux-erofs@lists.ozlabs.org" , "linux-kernel@vger.kernel.org" Subject: RE: [PATCH v5] erofs: support deflate decompress by using Intel QAT Thread-Topic: [PATCH v5] erofs: support deflate decompress by using Intel QAT Thread-Index: AQHbyuEGmfH0eixYq0GAC0x1fGTM9bPdwY0AgACHwQA= Date: Thu, 22 May 2025 08:08:02 +0000 Message-ID: References: <49ca7ddc-4ea7-4081-84ee-609a23b815e4@linux.alibaba.com> In-Reply-To: <49ca7ddc-4ea7-4081-84ee-609a23b815e4@linux.alibaba.com> Accept-Language: zh-CN, en-US Content-Language: zh-CN X-MS-Has-Attach: yes X-MS-TNEF-Correlator: Content-Type: multipart/signed; micalg=SHA1; protocol="application/x-pkcs7-signature"; boundary="----=_NextPart_000_0030_01DBCB33.44482130" Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 tUid: 2025522160803d54babb357ce7e819c474450970c1f1d X-Abuse-Reports-To: service@corp-email.com Abuse-Reports-To: service@corp-email.com X-Complaints-To: service@corp-email.com X-Report-Abuse-To: service@corp-email.com ------=_NextPart_000_0030_01DBCB33.44482130 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable >-----Original Message----- >From: Gao Xiang >Sent: Thursday, May 22, 2025 3:54 PM >To: Bo Liu (=E5=88=98=E6=B3=A2)-=E6=B5=AA=E6=BD=AE=E4=BF=A1=E6=81=AF = ; xiang@kernel.org; >chao@kernel.org >Cc: linux-erofs@lists.ozlabs.org; linux-kernel@vger.kernel.org >Subject: Re: [PATCH v5] erofs: support deflate decompress by using = Intel QAT > >Hi Bo, > >On 2025/5/22 14:16, Bo Liu wrote: >> This patch introdueces the use of the Intel QAT to decompress >> compressed data in the EROFS filesystem, aiming to improve the >> decompression speed of compressed datea. >> >> We created a 285MiB compressed file and then used the following >> command to create EROFS images with different cluster size. >> # mkfs.erofs -zdeflate,level=3D9 -C16384 >> >> fio command was used to test random read and small random read(~5%) >> and sequential read performance. >> # fio -filename=3Dtestfile -bs=3D4k -rw=3Dread -name=3Djob1 >> # fio -filename=3Dtestfile -bs=3D4k -rw=3Drandread = -name=3Djob1 >> # fio -filename=3Dtestfile -bs=3D4k -rw=3Drandread = --io_size=3D14m >> -name=3Djob1 >> >> Here are some performance numbers for reference: >> >> Processors: Intel(R) Xeon(R) 6766E(144 core) >> Memory: 521 GiB >> >> = |------------------------------------------------------------------------= -----| >> | | Cluster size | sequential read | randread | small >> | randread(5%) | >> = |-----------|--------------|-----------------|-----------|---------------= -----| >> | Intel QAT | 4096 | 538 MiB/s | 112 MiB/s | 20.76 >MiB/s | >> | Intel QAT | 16384 | 699 MiB/s | 158 MiB/s | 21.02 >MiB/s | >> | Intel QAT | 65536 | 917 MiB/s | 278 MiB/s | 20.90 >MiB/s | >> | Intel QAT | 131072 | 1056 MiB/s | 351 MiB/s | 23.36 >MiB/s | >> | Intel QAT | 262144 | 1145 MiB/s | 431 MiB/s | 26.66 >MiB/s | >> | deflate | 4096 | 499 MiB/s | 108 MiB/s | 21.50 >MiB/s | >> | deflate | 16384 | 422 MiB/s | 125 MiB/s | 18.94 >MiB/s | >> | deflate | 65536 | 452 MiB/s | 159 MiB/s | 13.02 >MiB/s | >> | deflate | 131072 | 452 MiB/s | 177 MiB/s | 11.44 >MiB/s | >> | deflate | 262144 | 466 MiB/s | 194 MiB/s | 10.60 >MiB/s | >> >> Signed-off-by: Bo Liu >> --- >> v1: >> = https://lore.kernel.org/linux-erofs/20250410042048.3044-1-liubo03@insp >> ur.com/ >> v2: >> = https://lore.kernel.org/linux-erofs/20250410042048.3044-1-liubo03@insp >> ur.com/T/#t >> v3: >> = https://lore.kernel.org/linux-erofs/20250516082634.3801-1-liubo03@insp >> ur.com/ >> v4: >> = https://lore.kernel.org/linux-erofs/20250521100326.2867828-1-hsiangkao >> @linux.alibaba.com/ >> change since v4: >> - add sysfs documentation. >> >> Documentation/ABI/testing/sysfs-fs-erofs | 12 ++ >> fs/erofs/Kconfig | 14 ++ >> fs/erofs/Makefile | 1 + >> fs/erofs/compress.h | 10 ++ >> fs/erofs/decompressor_crypto.c | 186 >+++++++++++++++++++++++ >> fs/erofs/decompressor_deflate.c | 17 ++- >> fs/erofs/sysfs.c | 34 ++++- >> fs/erofs/zdata.c | 1 + >> 8 files changed, 272 insertions(+), 3 deletions(-) >> create mode 100644 fs/erofs/decompressor_crypto.c >> >> diff --git a/Documentation/ABI/testing/sysfs-fs-erofs >> b/Documentation/ABI/testing/sysfs-fs-erofs >> index b134146d735b..95201a62f704 100644 >> --- a/Documentation/ABI/testing/sysfs-fs-erofs >> +++ b/Documentation/ABI/testing/sysfs-fs-erofs >> @@ -27,3 +27,15 @@ Description: Writing to this will drop >compression-related caches, >> - 1 : invalidate cached compressed folios >> - 2 : drop in-memory pclusters >> - 3 : drop in-memory pclusters and cached compressed folios >> + >> +What: /sys/fs/erofs/accel >> +Date: May 2025 >> +Contact: "Bo Liu" >> +Description: The accel file is read-write and allows to set or show >> + hardware decompression accelerators, and it supports writing >> + multiple accelerators separated by =E2=80=98\n=E2=80=99. > > Used to set or show hardware accelerators in effect and multiple > accelerators are separated by '\n'. > > Supported accelerator(s): qat_deflate > > Disable all accelerators with an empty string (echo > accel). > >> + Currently supported accelerators: > >... OK, I will make some changes Thanks Bo Liu ------=_NextPart_000_0030_01DBCB33.44482130 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIILFzCCA8kw ggKxoAMCAQICEHiR8OF3G5iSSYrK6OtgewAwDQYJKoZIhvcNAQELBQAwWTETMBEGCgmSJomT8ixk ARkWA2NvbTEYMBYGCgmSJomT8ixkARkWCGxhbmdjaGFvMRQwEgYKCZImiZPyLGQBGRYEaG9tZTES MBAGA1UEAxMJSU5TUFVSLUNBMB4XDTE3MDEwOTA5MjgzMFoXDTM0MDUxMTEyMjAwNFowWTETMBEG CgmSJomT8ixkARkWA2NvbTEYMBYGCgmSJomT8ixkARkWCGxhbmdjaGFvMRQwEgYKCZImiZPyLGQB GRYEaG9tZTESMBAGA1UEAxMJSU5TUFVSLUNBMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKC AQEAq+Q17xtjJLyp5hgXDie1r4DeNj76VUvbZNSywWU5zhx+e0Lu0kwcZ0T3KncZdgdWyqYvRJMQ /VVqX3gS4VxtLw3zBrg9kGuD0LfpH0cA2b0ZHpxRh5WapP14flcSh/lnawig29z44wfUEg43yTZO lOfPKos/Dm6wyrJtaPmD6AF7w4+vFZH0zMYfjQkSN/xGgS3OPBNAB8PTHM2sV+fFmnnlTFpyRg0O IIA2foALZvjIjNdUfp8kMGSh/ZVMfHqTH4eo+FcZPZ+t9nTaJQz9cSylw36+Ig6FGZHA/Zq+0fYy VCxR1ZLULGS6wsVep8j075zlSinrVpMadguOcArThwIDAQABo4GMMIGJMBMGCSsGAQQBgjcUAgQG HgQAQwBBMAsGA1UdDwQEAwIBhjAPBgNVHRMBAf8EBTADAQH/MB0GA1UdDgQWBBReWQOmtExYYJFO 9h61pTmmMsE1ajAQBgkrBgEEAYI3FQEEAwIBATAjBgkrBgEEAYI3FQIEFgQUJmGwrST2eo+dKLZv FQ4PiIOniEswDQYJKoZIhvcNAQELBQADggEBAIhkYRbyElnZftcS7NdO0TO0y2wCULFpAyG//cXy rXPdTLpQO0k0aAy42P6hTLbkpkrq4LfVOhcx4EWC1XOuORBV2zo4jk1oFnvEsuy6H4a8o7favPPX 90Nfvmhvz/rGy4lZTSZV2LONmT85D+rocrfsCGdQX/dtxx0jWdYDcO53MLq5qzCFiyQRcLNqum66 pa8v1OSs99oKptY1dR7+GFHdA7Zokih5tugQbm7jJR+JRSyf+PomWuIiZEvYs+NpNVac+gyDUDkZ sb0vHPENGwf1a9gElQa+c+EHfy9Y8O+7Ha8IpLWUArNP980tBvO/TYYU6LMz07h7RyiXqr7fvEcw ggdGMIIGLqADAgECAhN+AADR0dVMbAhPX/CLAAAAANHRMA0GCSqGSIb3DQEBCwUAMFkxEzARBgoJ kiaJk/IsZAEZFgNjb20xGDAWBgoJkiaJk/IsZAEZFghsYW5nY2hhbzEUMBIGCgmSJomT8ixkARkW BGhvbWUxEjAQBgNVBAMTCUlOU1BVUi1DQTAeFw0yMDA3MTQwNjI4MjdaFw0yNTA3MTMwNjI4Mjda MIGiMRMwEQYKCZImiZPyLGQBGRYDY29tMRgwFgYKCZImiZPyLGQBGRYIbGFuZ2NoYW8xFDASBgoJ kiaJk/IsZAEZFgRob21lMR4wHAYDVQQLDBXkupHmlbDmja7kuK3lv4Ppm4blm6IxGDAWBgNVBAMM D+WImOazoihsaXVibzAzKTEhMB8GCSqGSIb3DQEJARYSbGl1Ym8wM0BpbnNwdXIuY29tMIIBIjAN BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA+3+Pi2sJmnH6l/ARe11rpWA0BA8HSEkoNntgCXwp VQbrBcbdvBVcUCof4t5psWepSAQGzYKLommFbOHzyqzFmutCh7/vlzUI5ERxV39RhwTKFRH0/Fqh C/svU35yne9Q5N2D2u5Aje0/KxEUiwJ8AOMwBBPYEi6V7yrQ82uMFd0uZ8j1VwrazbtUjPMMe6tM MYMtVotD+cTUCGUvsJNeynGfOntKruRTbzTTJWZRdgCDsIBQtOoxjnO6tLEdMpoCwVn+NdwUYsau XdGGavx9lT1Hn5zxL4cLmv13bn/EV7wIqIWY4A9YPtSIbMPQkXNMEPfVjuHxM8oHzjzRw15tjQID AQABo4IDuzCCA7cwPQYJKwYBBAGCNxUHBDAwLgYmKwYBBAGCNxUIgvKpH4SB13qGqZE9hoD3FYPY j1yBSv2LJoGUp00CAWQCAWAwKQYDVR0lBCIwIAYIKwYBBQUHAwIGCCsGAQUFBwMEBgorBgEEAYI3 CgMEMAsGA1UdDwQEAwIFoDA1BgkrBgEEAYI3FQoEKDAmMAoGCCsGAQUFBwMCMAoGCCsGAQUFBwME MAwGCisGAQQBgjcKAwQwRAYJKoZIhvcNAQkPBDcwNTAOBggqhkiG9w0DAgICAIAwDgYIKoZIhvcN AwQCAgCAMAcGBSsOAwIHMAoGCCqGSIb3DQMHMB0GA1UdDgQWBBTkHdp/y3+DuDJ13Q1YzgU9iV7N dzAfBgNVHSMEGDAWgBReWQOmtExYYJFO9h61pTmmMsE1ajCCAQ8GA1UdHwSCAQYwggECMIH/oIH8 oIH5hoG6bGRhcDovLy9DTj1JTlNQVVItQ0EsQ049SlRDQTIwMTIsQ049Q0RQLENOPVB1YmxpYyUy MEtleSUyMFNlcnZpY2VzLENOPVNlcnZpY2VzLENOPUNvbmZpZ3VyYXRpb24sREM9aG9tZSxEQz1s YW5nY2hhbyxEQz1jb20/Y2VydGlmaWNhdGVSZXZvY2F0aW9uTGlzdD9iYXNlP29iamVjdENsYXNz PWNSTERpc3RyaWJ1dGlvblBvaW50hjpodHRwOi8vSlRDQTIwMTIuaG9tZS5sYW5nY2hhby5jb20v Q2VydEVucm9sbC9JTlNQVVItQ0EuY3JsMIIBKQYIKwYBBQUHAQEEggEbMIIBFzCBsQYIKwYBBQUH MAKGgaRsZGFwOi8vL0NOPUlOU1BVUi1DQSxDTj1BSUEsQ049UHVibGljJTIwS2V5JTIwU2Vydmlj ZXMsQ049U2VydmljZXMsQ049Q29uZmlndXJhdGlvbixEQz1ob21lLERDPWxhbmdjaGFvLERDPWNv bT9jQUNlcnRpZmljYXRlP2Jhc2U/b2JqZWN0Q2xhc3M9Y2VydGlmaWNhdGlvbkF1dGhvcml0eTBh BggrBgEFBQcwAoZVaHR0cDovL0pUQ0EyMDEyLmhvbWUubGFuZ2NoYW8uY29tL0NlcnRFbnJvbGwv SlRDQTIwMTIuaG9tZS5sYW5nY2hhby5jb21fSU5TUFVSLUNBLmNydDBBBgNVHREEOjA4oCIGCisG AQQBgjcUAgOgFAwSbGl1Ym8wM0BpbnNwdXIuY29tgRJsaXVibzAzQGluc3B1ci5jb20wDQYJKoZI hvcNAQELBQADggEBAA+BaY3B3qXmvZq7g7tZLzq2VQjU//XHTmyl58GLDWdVHsuX3lrAGwEfLVnU odpvthjtb7T7xEUzJh4F62zLFSm8HOBPH1B+6SFQKChHZeM0pauvXr1krRtVv82RgLsU26XrXFUP N+NcPwt7vOw1zHOiDic4anL3A9gsuDljAi2l+CA5RY05yL+8orasEAhOYL6+ks9aB8QiCxbZzShk DTMkrh0N1DjoBLaibtnlI/fxOUYM6vgdiI+FC02G41B364ZAc1mabSFvGIP6cIdr/olprPQOj9cq 6zMi05qUBUj22hDvhcY0TlT4fEJSrvblp/LG6qTtVI3ilUAxhe8i9cIxggOTMIIDjwIBATBwMFkx EzARBgoJkiaJk/IsZAEZFgNjb20xGDAWBgoJkiaJk/IsZAEZFghsYW5nY2hhbzEUMBIGCgmSJomT 8ixkARkWBGhvbWUxEjAQBgNVBAMTCUlOU1BVUi1DQQITfgAA0dHVTGwIT1/wiwAAAADR0TAJBgUr DgMCGgUAoIIB+DAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0yNTA1 MjIwODA0NThaMCMGCSqGSIb3DQEJBDEWBBQWw9Jux2Pt6xZgvxK7xNdwVHVnVTB/BgkrBgEEAYI3 EAQxcjBwMFkxEzARBgoJkiaJk/IsZAEZFgNjb20xGDAWBgoJkiaJk/IsZAEZFghsYW5nY2hhbzEU MBIGCgmSJomT8ixkARkWBGhvbWUxEjAQBgNVBAMTCUlOU1BVUi1DQQITfgAA0dHVTGwIT1/wiwAA AADR0TCBgQYLKoZIhvcNAQkQAgsxcqBwMFkxEzARBgoJkiaJk/IsZAEZFgNjb20xGDAWBgoJkiaJ k/IsZAEZFghsYW5nY2hhbzEUMBIGCgmSJomT8ixkARkWBGhvbWUxEjAQBgNVBAMTCUlOU1BVUi1D QQITfgAA0dHVTGwIT1/wiwAAAADR0TCBkwYJKoZIhvcNAQkPMYGFMIGCMAoGCCqGSIb3DQMHMAsG CWCGSAFlAwQBKjALBglghkgBZQMEARYwCwYJYIZIAWUDBAECMA4GCCqGSIb3DQMCAgIAgDANBggq hkiG9w0DAgIBQDAHBgUrDgMCGjALBglghkgBZQMEAgMwCwYJYIZIAWUDBAICMAsGCWCGSAFlAwQC ATANBgkqhkiG9w0BAQEFAASCAQAPRUsga5q70/FSMu2ybjnQ7Bdcytek6b/yWLfFX8z1Mg0o0A0Y 4ZMA7VrUjiNpM3C9s6mwK5Q86qEl4QYiCjMr1GRgqtEv1lSa8N6uNJa278nXOs56smbC40KRts5U 3f73lI5ZmTQ9t1cOXbD7F52E5NB+Mr/UhgE3V44QKVfTOL5I5oWifmOxR79AgGTMNFoWlyWp4WFH 37+YIXinoaHFqgToDZRal2PZLZKsRFxvQNsiO+UnPGNL3Rc8PGFzpL7ovfNl6K4ryrMrn1D82n+A 8X6r3TbTx7IhN8TyRu+13D+iolNs/OIRXK4YAArlNehLT+HElOlhMWaUvJDuw29SAAAAAAAA ------=_NextPart_000_0030_01DBCB33.44482130--