From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-oo2-f38.google.com (mail-oo2-f38.google.com [74.125.231.166]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id C4C054052C4 for ; Sat, 26 Sep 2026 15:24:17 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=74.125.231.166 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1790436259; cv=none; b=CfmI+7p1UUmN9P565jd3fIjKfsZtRCAMsVqbmogMF2wzp/ahUuAhf5XKbm69sJlLYsKpGxGvNfzTPscI0wN9a/MykyI6NDklqFaXH7lANHnsBj8VYRFQy/7vSxX3npzEIfwGtfmA4+b9JC7T8qoJDHEjcKZEvJPtvYmcViwPp8M= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1790436259; c=relaxed/simple; bh=kBaEADxi+tizzfCdPMIDfF9nbDsmc/EW3wbKD4zMYGU=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=pmHjD4oEGLDGfCm3XL8ExuhOalgC9m9ZJ/Nn4To29xfHtPOgYQjFlRyrdFANeTV2+3afjn4hQcUo245kjJMb+WUJAPPvnnvJ2hkUN49mBRn599MBPRuLOhw8Js6Vy6Foe+EmRo/96TPBS79phNRnXLtZPFqeuzXDxFZAouk2LuI= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=nLe0GtSb; arc=none smtp.client-ip=74.125.231.166 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="nLe0GtSb" Received: by mail-oo2-f38.google.com with SMTP id 46e09a7af769-805cc8b4231so1287481a34.2 for ; Sat, 26 Sep 2026 08:24:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1790436256; x=1791041056; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to:content-type; bh=9SpFkGZb0zSmE51hIVgs/JK2EDkgGWRwWNxYbnnSzQc=; b=nLe0GtSb8XpLanJLs9RGqqpWTA6LC0HUfdxTqiSQfLDLZzbOYXEQKXNeVHC8Er8uNR xqaRdIbZjnfHBC0gv8j5lRVoZoV04cU7HuV21hDsZ2aHyP/QQtgHI/CCdd5UeftxVCJG b9zACCidd8CDjzQwmAOHlJAboEFdZq3lcmlZGoJQQO245S99NnA26CUvrfJXSGzm/0Pg M6K8fL1GDOFxZ+W3rfBqzX3Y0AqvtuDT6BMOBg2YAmWwxBK1jfd0Jyu6vUDdC8DODm9H mN2xEmd2gMzceQhOsJVXDCIOpdWhWA9LAc5Ltw89FSjm8VutwKheMtTBp765dEVmf6GS II0A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1790436256; x=1791041056; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to:content-type; bh=9SpFkGZb0zSmE51hIVgs/JK2EDkgGWRwWNxYbnnSzQc=; b=DXZowYbwF1NrPb5PARPUu7Wd+/MxxZgknHM0sSl8CSODsJ1D69vXypwoIXd26zlSu1 xqANcwi+EL4xe0DvSy431GduwbGzgYqr7aKCw8tTOVwgkPk+Q/RuSmLdxhy1thfnybS7 tTK+GQFHTeHvy5xsMrBLkORonARDFLd8FAAsZheL7fPcmhJ6F/gvYC8zk9bYLmOoRseS RDDQlVdcMOna36LcCPxO51ZIsT29GAgqOcWmrv18k2syNv9ASppIq54GpOT2F1shgiqK SbldfXjGbGGpk5l7WEaAyuc7NrV2koRAnfJzyXUsVVuO1r2Go6ANAWWlLWn2NFPLo06p IyrA== X-Forwarded-Encrypted: i=1; AKwUvBz0jNojfQ86oGD7EMH7KiQeRxsC6g9Q2GFESWRQ0kQINJBRqnUf4Xtdy1sQMthjXvfVMQ0vEYchHMhibxc=@vger.kernel.org X-Gm-Message-State: AFuF++kojMZqDZEetp34QCjieDReDC3eqG0UjXRZ3It99A8ZvXLiZGLK ZWDgddroujuE/cN7/QydfPXte3ncRr6zEkQvSUvIobkk1BHlMDDXRrMOL6ZLkg== X-Gm-Gg: AYBFou1/RiXPiTPRPdbuQgNhkh2tlIsESf0d+wRJd6jOaYrfn6dnkcNo9Fh9TmmrVZ7 xDNx2E2N+0HrybJTk/7lNT646Eky7mPAkGVFT7EqZXBFxaHjwN4CNscWOI9Kh0WDxd6zWEvrv3D MoRH1w7Jovk/xGlb9Lm9QZ8v0NB40UUb3l1uDI2zNvOj2pWQMMfcR0DYuPvkQJTflxGeCc6aDay GeMi4D/qYS4Ri9fEI3fPhcazPoQCZbUwQ67jEXhkoUOmIAERAUEeD4Anip9Fj64P2UG8rGnbUyo Qgnm35HYtMnKRXsSiiiB8SfDqAhJ9DtK2QygX/PziRSSnIks5Tj7f2bB3s7cctI0CfA6CRZy+pK B5iiPOhJZ26XpgQA6chrXiSyL8C/mxTufi0rH0qYvC4n/bU5DxsOJ4Q+dZTOgFkgAnMaXhHHD80 6jDLiFgF1Qa42wjjr2azsTzPyEG4jEhMEML5sOPTnGIVYyXf/Ji/UUlLsG1AZqziWkOHnUfnF1d IeZWgFVmDkSdKoSnqTxNz/Yi5ExlNxzLgdmwDVF X-Received: by 2002:a05:6808:c412:b0:4b9:e5fa:8908 with SMTP id 5614622812f47-4d72cf3fbb4mr8927841b6e.27.1790436256542; Sat, 26 Sep 2026 08:24:16 -0700 (PDT) Received: from archlinux.lan ([136.34.156.120]) by smtp.gmail.com with ESMTPSA id 5614622812f47-4dbf6206942sm4653798b6e.9.2026.09.26.08.24.14 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 26 Sep 2026 08:24:16 -0700 (PDT) From: Danish Khateeb To: Willy Tarreau , =?UTF-8?q?Thomas=20Wei=C3=9Fschuh?= Cc: Shuah Khan , linux-kselftest@vger.kernel.org, linux-kernel@vger.kernel.org, Danish Khateeb Subject: [PATCH v2 0/2] tools/nolibc: check for overflow in malloc() Date: Sat, 26 Sep 2026 10:24:12 -0500 Message-ID: <20260926152414.251214-1-danishkhateeb03@gmail.com> X-Mailer: git-send-email 2.55.0 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit malloc() does not check the addition of its header size for overflow, so malloc(SIZE_MAX), calloc(SIZE_MAX, 1) and realloc(ptr, SIZE_MAX) return a single page instead of NULL. As suggested by Thomas, patch 1 drops the rounding to 4096 bytes, and patch 2 adds the overflow check on top. Tested on x86_64 (GCC and clang), i386, and on arm, arm64 and sparc64 under qemu-user: - nolibc-test: no failures, with patch 1 alone and with the series. - A separate program: malloc(), calloc() and realloc() with sizes close to SIZE_MAX fail with ENOMEM, and free() still unmaps every page. Changes in v2: - Drop the rounding in a separate patch, instead of checking it for overflow (Thomas) - Drop the test patch (Thomas) - Link to v1: https://lore.kernel.org/r/20260926134332.58184-1-danishkhateeb03@gmail.com Danish Khateeb (2): tools/nolibc: stop rounding malloc() sizes up to 4096 bytes tools/nolibc: check for overflow in malloc() tools/include/nolibc/stdlib.h | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) base-commit: 0e1c44b472e1ec21efdad1df21b10e5c568b65b5 -- 2.55.0