From patchwork Wed Mar 12 15:16:32 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Sebastian Andrzej Siewior X-Patchwork-Id: 14013625 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 99065C28B28 for ; Wed, 12 Mar 2025 15:16:55 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 34D5D280003; Wed, 12 Mar 2025 11:16:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 2FD4F280001; Wed, 12 Mar 2025 11:16:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1C5D9280003; Wed, 12 Mar 2025 11:16:54 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id F3C9E280001 for ; Wed, 12 Mar 2025 11:16:53 -0400 (EDT) Received: from smtpin27.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 6CAC51A12B9 for ; Wed, 12 Mar 2025 15:16:54 +0000 (UTC) X-FDA: 83213251548.27.8649F07 Received: from galois.linutronix.de (Galois.linutronix.de [193.142.43.55]) by imf20.hostedemail.com (Postfix) with ESMTP id EC51E1C0018 for ; Wed, 12 Mar 2025 15:16:48 +0000 (UTC) Authentication-Results: imf20.hostedemail.com; dkim=pass header.d=linutronix.de header.s=2020 header.b="EMfrX/R9"; dkim=pass header.d=linutronix.de header.s=2020e header.b=cSY3YaaR; spf=pass (imf20.hostedemail.com: domain of bigeasy@linutronix.de designates 193.142.43.55 as permitted sender) smtp.mailfrom=bigeasy@linutronix.de; dmarc=pass (policy=none) header.from=linutronix.de ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1741792609; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=si5dEG1uweLN2PpJ+c7HS1w13Fpbcv6DZJnMkGCu60E=; b=nqRKDWmVO+tyTICkSNDmKw7DOflzRtoVsJSITodgNH2kiNhHvYbwsyFFsJ0mzVZp3lrOak cI2VFcaGvM23Nuij3QT7tE1PCRBEX+PKZ6cuahOHJ1DdcAX6zh/7u1jQssJhctVK5xU1Kh uzuje8vkPINYD0EeuSmWrTUXY3fSH8U= ARC-Authentication-Results: i=1; imf20.hostedemail.com; dkim=pass header.d=linutronix.de header.s=2020 header.b="EMfrX/R9"; dkim=pass header.d=linutronix.de header.s=2020e header.b=cSY3YaaR; spf=pass (imf20.hostedemail.com: domain of bigeasy@linutronix.de designates 193.142.43.55 as permitted sender) smtp.mailfrom=bigeasy@linutronix.de; dmarc=pass (policy=none) header.from=linutronix.de ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1741792609; a=rsa-sha256; cv=none; b=O7otfLnYBELXxSyUni5HHdZPd7YGPOGTfBwcWBlybuaf7jPYg0h1VZc0BYCPakO5dKTQrE gP/ncJ/shX1M7VMoj1c3rf928EVBT9oxv6UeovdCenz+5yMq9qIhtD4yiK+l7vpru7RHyL Te413gn71a/kpgGXF0r4THYjSU5jY3U= From: Sebastian Andrzej Siewior DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1741792606; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=si5dEG1uweLN2PpJ+c7HS1w13Fpbcv6DZJnMkGCu60E=; b=EMfrX/R9YbQeVeibLTnVIcDgRjZJIad2AZx5Xd7ySh2JnD3eCWASpiKflcDN7GmWq4qMoh IpPF1VWHe7XH05QFyFWTxFJ02liXcEf36esB5TOf7xtAW7musWSJeZi+EFFuIHk1JJ6yk5 jbyv0PSnzD5CmzBbmlvW2Olk6EulUVI9ro0r83hcc1INRG5EqPBLYlqRgsIS7dxCK01b4a dz5tXNiItIMdFYGI+2NNhJEct5Ot2HRa7RORjo5Vo43kGXvc+lAeQ3P4v4fK6pS91mmsIt 6GAl26aC3Hx+GzF+GaOfgSWiU81d1QPUBPyyCMc2A1eLiyxa/GxKT1Y2BDsyrw== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1741792606; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=si5dEG1uweLN2PpJ+c7HS1w13Fpbcv6DZJnMkGCu60E=; b=cSY3YaaRvRgNorkJBb3yqfXwVgcNB0RlpjUgNxpakCGJQPbFWUioGUS4qN8TNWCxahNu8W j7h31g8OqIhGIVDQ== To: linux-kernel@vger.kernel.org Cc: =?utf-8?q?Andr=C3=A9_Almeida?= , Darren Hart , Davidlohr Bueso , Ingo Molnar , Juri Lelli , Peter Zijlstra , Thomas Gleixner , Valentin Schneider , Waiman Long , Andrew Morton , Uladzislau Rezki , Christoph Hellwig , linux-mm@kvack.org, Christoph Hellwig , Sebastian Andrzej Siewior Subject: [PATCH v10 19/21] mm: Add vmalloc_huge_node() Date: Wed, 12 Mar 2025 16:16:32 +0100 Message-ID: <20250312151634.2183278-20-bigeasy@linutronix.de> In-Reply-To: <20250312151634.2183278-1-bigeasy@linutronix.de> References: <20250312151634.2183278-1-bigeasy@linutronix.de> MIME-Version: 1.0 X-Rspam-User: X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: EC51E1C0018 X-Stat-Signature: bkah5wb87134gei4t1ahj8bpnpcepnce X-HE-Tag: 1741792608-525410 X-HE-Meta: U2FsdGVkX1/wWc2kKE7FVQvdNCI7EtbZ3fSdVni4lLD8P730dZPaNTodNlNSt1ILlhUADH4QpPdNmDrVRinhkKKontQajNhlv7kJTa+UGyoyzlPYXXiFkvgnELnfMnG3B+n+vHV/R+sZNcDdaz6buhpGfEMK4qEL4cgffi83Q7fbBBsKs9PK679PGNqxlrPN66MmY3WWVhSkS8vwBWM0+caaP9i9VlpPkPQBaYi91E70YF5rLX8MdtdRIHdNSDdRnL/nHfq0WHsDWSMf5/oAC5QpTD2KMB1OzyNBRkYYuJBgxT626dvSxRfVNo6NxFpyBqHIKa5OOO3LJbC2YuuB3QDlHsSqfA1gfHrczmTHKrOgYgNYtzMITJac145Uf9JRAhApmC5gWdVnGFdrGuWa3VqvoFKjKnhDADu1pM0+6UKBxLn8O/LltbZaZaRskL7oeBOx4giaq1vustHYWv85meubStVzuR+mLhXD4cSqtjIeRemWFBBc6Z3LUhl0xrZwalgGGu4LcJmwxRkpNswbrj+BSW/Rmwj5SQuYjn/Kocz3JzB3WewVSOMGhyxssbtXAIlSkj/EUUHYTt6x2NN8+MovoQLW+7LLfWKNVdLmP/NlMCPi+9ZEq6HMF2kW3WCMd/ifz0ARCrDML3mTg1faCjkgpt2DWKGaBzpXlFeUCl1sJEzIhbgdVZnHBYm52ndiakaNriC6ANYpVuTH48DnHTTbWtJVqao3eDEq3wQIX67xOD3vabP9li0uwcyUS89HUzs15dmz0o5o0MqyqxFJzYKlq+34E0zqbuZfUaRjB5E0xmoQGYo2JU3u+oxMxzSlu5gbhMNcQILJB9NMJ3uBhWwj7fJp91IqB30Tf0pJ+ne2zNnL+lmNEQpy2w5v7NMefszcsOtMkNVnwQw/mLQF1asjdLE9tSwrvMImzFRw5Ygw0IYNWqjNKfWRtkH1b3tmOfcVpRtt8J9E8rT3k5/ fS4lLA7t d8G9zfHxR9OAH1WjTWx3zvVI/jKki3nr5DtLcKCL/Oe5SNwYthYTPqcJLHPemkp9CiiQ+tfZ/r9fr2aUpgkcoS5rfUsdfdsobPgyMbmUc9/J7/dywh9v22EVFFWi7M2dT0T9YpacuoyoxIrwGrdddFkn4IiEKiNWuzsd3EUl49akEw6KLL2h779flEIE8AG+Wq08pQ9se9ldTAjD8VSAShMkxxTgr1pIHYXOeL2dQ0xmmEfqdfeeu+sdkkS3PgksrrRU7ut2EVyyUOnDQ9rOOO+WOpCm54rn3HsUoXWWiTYP4CJV+0uDOdpqERVm+RHcsbgm/A7k8C7Gq7zEA28qVFo8nm6tw8PHGoGwJKWzcSesTQ/x0Yv0Ez0zHFkInldgHDDMqbvOohPyMHWTl/pSoY4AyWo6PU9+dBC2FzVKA8bkVDnU= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Peter Zijlstra To enable node specific hash-tables. [bigeasy: use __vmalloc_node_range_noprof(), add nommu bits] Cc: Andrew Morton Cc: Uladzislau Rezki Cc: Christoph Hellwig Cc: linux-mm@kvack.org Signed-off-by: Peter Zijlstra (Intel) Reviewed-by: Christoph Hellwig Signed-off-by: Sebastian Andrzej Siewior --- include/linux/vmalloc.h | 3 +++ mm/nommu.c | 5 +++++ mm/vmalloc.c | 7 +++++++ 3 files changed, 15 insertions(+) diff --git a/include/linux/vmalloc.h b/include/linux/vmalloc.h index 31e9ffd936e39..09c3e3e33f1f8 100644 --- a/include/linux/vmalloc.h +++ b/include/linux/vmalloc.h @@ -171,6 +171,9 @@ void *__vmalloc_node_noprof(unsigned long size, unsigned long align, gfp_t gfp_m void *vmalloc_huge_noprof(unsigned long size, gfp_t gfp_mask) __alloc_size(1); #define vmalloc_huge(...) alloc_hooks(vmalloc_huge_noprof(__VA_ARGS__)) +void *vmalloc_huge_node_noprof(unsigned long size, gfp_t gfp_mask, int node) __alloc_size(1); +#define vmalloc_huge_node(...) alloc_hooks(vmalloc_huge_node_noprof(__VA_ARGS__)) + extern void *__vmalloc_array_noprof(size_t n, size_t size, gfp_t flags) __alloc_size(1, 2); #define __vmalloc_array(...) alloc_hooks(__vmalloc_array_noprof(__VA_ARGS__)) diff --git a/mm/nommu.c b/mm/nommu.c index baa79abdaf037..d04e601a8f4d7 100644 --- a/mm/nommu.c +++ b/mm/nommu.c @@ -209,6 +209,11 @@ EXPORT_SYMBOL(vmalloc_noprof); void *vmalloc_huge_noprof(unsigned long size, gfp_t gfp_mask) __weak __alias(__vmalloc_noprof); +void *vmalloc_huge_node_noprof(unsigned long size, gfp_t gfp_mask, int node) +{ + return vmalloc_huge_noprof(size, gfp_mask); +} + /* * vzalloc - allocate virtually contiguous memory with zero fill * diff --git a/mm/vmalloc.c b/mm/vmalloc.c index a6e7acebe9adf..69247b46413ca 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -3966,6 +3966,13 @@ void *vmalloc_huge_noprof(unsigned long size, gfp_t gfp_mask) } EXPORT_SYMBOL_GPL(vmalloc_huge_noprof); +void *vmalloc_huge_node_noprof(unsigned long size, gfp_t gfp_mask, int node) +{ + return __vmalloc_node_range_noprof(size, 1, VMALLOC_START, VMALLOC_END, + gfp_mask, PAGE_KERNEL, VM_ALLOW_HUGE_VMAP, + node, __builtin_return_address(0)); +} + /** * vzalloc - allocate virtually contiguous memory with zero fill * @size: allocation size