From patchwork Tue Mar 4 13:58:13 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Borislav Petkov X-Patchwork-Id: 14000784 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 049E9C021B8 for ; Tue, 4 Mar 2025 13:58:54 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 8E110280007; Tue, 4 Mar 2025 08:58:53 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 89020280004; Tue, 4 Mar 2025 08:58:53 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7348C280007; Tue, 4 Mar 2025 08:58:53 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 4A16A280004 for ; Tue, 4 Mar 2025 08:58:53 -0500 (EST) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 0B2891A00FB for ; Tue, 4 Mar 2025 13:58:53 +0000 (UTC) X-FDA: 83184024546.30.7A21830 Received: from nyc.source.kernel.org (nyc.source.kernel.org [147.75.193.91]) by imf01.hostedemail.com (Postfix) with ESMTP id 6F06440005 for ; Tue, 4 Mar 2025 13:58:51 +0000 (UTC) Authentication-Results: imf01.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=vF23nCnL; spf=pass (imf01.hostedemail.com: domain of bp@kernel.org designates 147.75.193.91 as permitted sender) smtp.mailfrom=bp@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1741096731; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=xgJGz8LK+XXFuSSYnj1ItMez95xgr3OW/atRa/PU/o0=; b=dtyuo5d6Zc2iCaReqQOkZQFL0VVafrScHZxVEYMGHpLBhrBfvjz5nBSz1F6eq8s8ABR0Ai UqfQ03mRnkJFINP5ftXR82VClucIocIEFxPr3/Py0VsfG62sMkl6rAMt283X9CuquYkwHU M6Xfec0L6qR63e7wruU5NZ9uuozXW8M= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1741096731; a=rsa-sha256; cv=none; b=AJlLPXH9dtNB95BZe4ggXHqoHVCJOB+WOyA01m8bvOVWTxp4lDdRXV9LPrxUBoxTNMpe1A +5A8uJBFwABxlsLbml8uO3Z7ukO/7eNCDQx/pZNf7a5HAMW13A+92qBEePfEv8QoqOu4t1 5gt/BJEODoIEhEHhPGX78uKODYBUQpI= ARC-Authentication-Results: i=1; imf01.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=vF23nCnL; spf=pass (imf01.hostedemail.com: domain of bp@kernel.org designates 147.75.193.91 as permitted sender) smtp.mailfrom=bp@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by nyc.source.kernel.org (Postfix) with ESMTP id C988AA447F1; Tue, 4 Mar 2025 13:53:19 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 5A1BEC4CEE5; Tue, 4 Mar 2025 13:58:47 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1741096730; bh=zGmupePrg6X0HyaMkp7BsDdleTUSKa3KpW1HRLcE7Sc=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=vF23nCnLD/EN0hiNA2S0Dqw90+rhjkP7uGC0lVh/1ZHuOtrBMANtrepOA+aV8+MSg xgQ3p8MST+8/lt1MLO2MGozYt0O0K8QxxfiQwlnoblC+mjaG2PxViOVq2Ey1bn1u1W LST5ksnoIkQCTZetTqtr14iX9Ge96BNiyflO2nZlNIdba3YhxfHu6uorNEOYk8Q1ZN VA4+d0KCUxq25Nf042VOC2jEWSMDGciSFvhrCSNt7DNEHCiNNtyerc8nn3+d0/WKE7 np3qfANNc6IBDPhbUPt2PdJtVlJtsvBd4o0khHeqErwRCkbI7idmpiS3cAkqF1e4yW jzYPtG1e7BX6Q== From: Borislav Petkov To: riel@surriel.com Cc: Manali.Shukla@amd.com, akpm@linux-foundation.org, andrew.cooper3@citrix.com, jackmanb@google.com, jannh@google.com, kernel-team@meta.com, linux-kernel@vger.kernel.org, linux-mm@kvack.org, mhklinux@outlook.com, nadav.amit@gmail.com, thomas.lendacky@amd.com, x86@kernel.org, zhengqi.arch@bytedance.com, Borislav Petkov Subject: [PATCH v15 08/11] x86/mm: Add global ASID process exit helpers Date: Tue, 4 Mar 2025 14:58:13 +0100 Message-ID: <20250304135816.12356-9-bp@kernel.org> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250304135816.12356-1-bp@kernel.org> References: <20250304135816.12356-1-bp@kernel.org> MIME-Version: 1.0 X-Stat-Signature: xc513fcs9brzarzhn3x544e8p8o6rbhh X-Rspamd-Queue-Id: 6F06440005 X-Rspam-User: X-Rspamd-Server: rspam01 X-HE-Tag: 1741096731-375754 X-HE-Meta: U2FsdGVkX1/4lTX9lukCYGVHpK5evd/UDiL63WZnHD3ffIIJdUNFwk2nwybMk1OPr4KgMSw1uI2Fu3j41SjnXfLL2KmhozT+qxwTf25DyBKVi1Lu26jSXOOAD+LWvIbhovbq/q69nfDooicUj5Tkc1GErH6xIQHr9cbnLQz+24XlhsDKvyAyqctuG9FeY3/P7OcKVIy/PQ92PgITpS2y9UiK3AhvnP2P912tebtuUh2sxCAgdheSQAswdP6itsVMXiTCuiJ0UIIRpH2l6uYFp2SstqxrGyN7mVq0zmdTd3POslH+0Yhp7EI7N+UYqaIyD/5mkjJP3HS7ww+kJPs/LGI9GB+t1V74yVvJefu1KO+5s/wiYti8b4K5m747adzlEPSYP277SxcrXU5yLu6LrLrkL0D1IbYnmXi/WF7T5nURXo0jOydx2zJODENGhkPpLWdF6wH3n/ERK6kCyHkishmp/MJ7EHr95X0/PujuMm6xvIzZ+MrCZoumr1S/wSAHYh4Cf1eX9kPHeGVdTSDe/gTQY5nWGUk7bczp2eqbSZ4ZtDb8loIuf//aspiGh/09AzdUtTTdm0KAfVq8WuAMxW5REdeTVCCxZRRu378NUTi5GdhBq1NrRuPlQfewbNZHUuq5vY7yrpaNpJmmR4NxJbLsnbH1q3kKp6YOdcd66fEyMDh41pWsJi/EUefy52hlFilDxiq7XwgC4lIuff7Z1AZSRh1ElhxprZB+3Gq+34Ey0qAKeHHeefHarK6Jr4ktWSUyit4RBUZZFEAM3rZTpXKw/59PLGVGuTZrh8McRHVXakU0CaW2+OGXDW0I6vBQIQ1PGUJvWlsjJL0lQff8owOG21UwMEQO9xqDuaiPW02CAFYPrehX7IwviHP5p973WzcoZ9HfD97Rik2BrFtcT+yGuj8UITOZPLx41lxGUulmniTcv50voRm9IcmcgWtm/qapt73YghEqmM/Mhkw tshZPfzZ RflkdMBwOCDp2/apSo8tRylFSxF1uTPEQWAWrQWKkx9+6K/PznNieVkmVdxvKYHl9RKX+H+Z3TWBqjFw1W6P2UdtbEXuCmU+WiSnbFPHdwds+wcAcz8JOgQxKuDNiIy2Oi5P8m7ucE0u388cd7+PqL6aNKjbxO4s4vCOV4K1EqrOhFWAt1YTCZUG25Pm+5V7gPY6HR1mGjE1ZbwK6+NNOUdf8ek21dq7xPFvEBC1U+G+EblcwlfJGwMGyEJYhs08ITJ3vgvMv6zCJ0nVp/jv6j2o+eWFKe6KGMI04AcqGupIFXNEEJueOO2eylJYKf+l2h4L3RhWFfg8QWU1Um3CXw8fyTt4O1ItV9nPCTEAGrhEm2B0= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Rik van Riel A global ASID is allocated for the lifetime of a process. Free the global ASID at process exit time. [ bp: Massage, create helpers, hide details inside them. ] Signed-off-by: Rik van Riel Signed-off-by: Borislav Petkov (AMD) Link: https://lore.kernel.org/r/20250226030129.530345-10-riel@surriel.com --- arch/x86/include/asm/mmu_context.h | 8 +++++++- arch/x86/include/asm/tlbflush.h | 9 +++++++++ 2 files changed, 16 insertions(+), 1 deletion(-) diff --git a/arch/x86/include/asm/mmu_context.h b/arch/x86/include/asm/mmu_context.h index a2c70e495b1b..2398058b6e83 100644 --- a/arch/x86/include/asm/mmu_context.h +++ b/arch/x86/include/asm/mmu_context.h @@ -2,7 +2,6 @@ #ifndef _ASM_X86_MMU_CONTEXT_H #define _ASM_X86_MMU_CONTEXT_H -#include #include #include #include @@ -13,6 +12,7 @@ #include #include #include +#include extern atomic64_t last_mm_ctx_id; @@ -139,6 +139,9 @@ static inline void mm_reset_untag_mask(struct mm_struct *mm) #define enter_lazy_tlb enter_lazy_tlb extern void enter_lazy_tlb(struct mm_struct *mm, struct task_struct *tsk); +#define mm_init_global_asid mm_init_global_asid +extern void mm_init_global_asid(struct mm_struct *mm); + extern void mm_free_global_asid(struct mm_struct *mm); /* @@ -163,6 +166,8 @@ static inline int init_new_context(struct task_struct *tsk, mm->context.execute_only_pkey = -1; } #endif + + mm_init_global_asid(mm); mm_reset_untag_mask(mm); init_new_context_ldt(mm); return 0; @@ -172,6 +177,7 @@ static inline int init_new_context(struct task_struct *tsk, static inline void destroy_context(struct mm_struct *mm) { destroy_context_ldt(mm); + mm_free_global_asid(mm); } extern void switch_mm(struct mm_struct *prev, struct mm_struct *next, diff --git a/arch/x86/include/asm/tlbflush.h b/arch/x86/include/asm/tlbflush.h index 1f61a39a8776..e6c3be06dd21 100644 --- a/arch/x86/include/asm/tlbflush.h +++ b/arch/x86/include/asm/tlbflush.h @@ -261,6 +261,14 @@ static inline u16 mm_global_asid(struct mm_struct *mm) return asid; } +static inline void mm_init_global_asid(struct mm_struct *mm) +{ + if (cpu_feature_enabled(X86_FEATURE_INVLPGB)) { + mm->context.global_asid = 0; + mm->context.asid_transition = false; + } +} + static inline void mm_assign_global_asid(struct mm_struct *mm, u16 asid) { /* @@ -281,6 +289,7 @@ static inline bool mm_in_asid_transition(struct mm_struct *mm) } #else static inline u16 mm_global_asid(struct mm_struct *mm) { return 0; } +static inline void mm_init_global_asid(struct mm_struct *mm) { } static inline void mm_assign_global_asid(struct mm_struct *mm, u16 asid) { } static inline bool mm_in_asid_transition(struct mm_struct *mm) { return false; } #endif /* CONFIG_BROADCAST_TLB_FLUSH */