From patchwork Tue Feb 20 11:44:29 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Chengming Zhou X-Patchwork-Id: 13563906 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 57373C54788 for ; Tue, 20 Feb 2024 11:44:45 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 2B3496B0078; Tue, 20 Feb 2024 06:44:44 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 2748D6B007D; Tue, 20 Feb 2024 06:44:44 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 102F16B0083; Tue, 20 Feb 2024 06:44:44 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 00BA76B0078 for ; Tue, 20 Feb 2024 06:44:43 -0500 (EST) Received: from smtpin26.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id C6DD940642 for ; Tue, 20 Feb 2024 11:44:43 +0000 (UTC) X-FDA: 81812000046.26.479F509 Received: from out-179.mta1.migadu.com (out-179.mta1.migadu.com [95.215.58.179]) by imf19.hostedemail.com (Postfix) with ESMTP id 014C61A0019 for ; Tue, 20 Feb 2024 11:44:41 +0000 (UTC) Authentication-Results: imf19.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=cwrTmA0s; spf=pass (imf19.hostedemail.com: domain of chengming.zhou@linux.dev designates 95.215.58.179 as permitted sender) smtp.mailfrom=chengming.zhou@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1708429482; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=VdP64AtdS178q4SDQJio0KmQ+nTJNdPzbvzklfYy4hs=; b=zg7r5aecSPROUvxAa0nRCSwcMb9BFVxpihMYVA5fGwfK/RPsNsZzbHbQlyQCW7QvUax5eo fEuO4oOyu035oPUEruvvH7hiCj6TVg5qn4W4N9EfiAhFLbLCipm6C4M7+ZEKfP/KmBuADE MbHzVcqLO49QQH1DUQBujyNLD0VGW1c= ARC-Authentication-Results: i=1; imf19.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=cwrTmA0s; spf=pass (imf19.hostedemail.com: domain of chengming.zhou@linux.dev designates 95.215.58.179 as permitted sender) smtp.mailfrom=chengming.zhou@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1708429482; a=rsa-sha256; cv=none; b=AHjeStob4Jh/UBHqW8jRHwH668yxYMq38JEqvX1qXAqh/CxZPXxi2bm7Rqf/6VvrkbMDsB mD9zvO6rBztUmLaqXo6I24qyAmDcpQxwrIele7sOyTIl4BxnTdrC1ersEdVL5MIlOnasCE 7mk+L9PE2uPRVBVuEJ6wuHnx23uheUQ= X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1708429480; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VdP64AtdS178q4SDQJio0KmQ+nTJNdPzbvzklfYy4hs=; b=cwrTmA0sPvnMUtwA1woeElKaxcGZpRmNkxQyoQlraw0/zO68U4jf0+tF/GGDIFjo092brD MbMMc1y0eiy8oqd6A3oW0hX1mpmoCKUB5Ic238upKw/66Sq9v557RCnf7Zuci8Fb/6+ktp Mi3mbziPE2AVdaVY3GIzj8PWB9dDJpQ= From: Chengming Zhou Date: Tue, 20 Feb 2024 11:44:29 +0000 Subject: [PATCH RESEND 1/3] mm/zsmalloc: remove set_zspage_mapping() MIME-Version: 1.0 Message-Id: <20240220-b4-zsmalloc-cleanup-v1-1-b7e9cbab9541@linux.dev> References: <20240220-b4-zsmalloc-cleanup-v1-0-b7e9cbab9541@linux.dev> In-Reply-To: <20240220-b4-zsmalloc-cleanup-v1-0-b7e9cbab9541@linux.dev> To: hannes@cmpxchg.org, Andrew Morton , Sergey Senozhatsky , nphamcs@gmail.com, yosryahmed@google.com, Minchan Kim Cc: linux-mm@kvack.org, Chengming Zhou , linux-kernel@vger.kernel.org X-Developer-Signature: v=1; a=ed25519-sha256; t=1708429476; l=2317; i=chengming.zhou@linux.dev; s=20240220; h=from:subject:message-id; bh=cqkPrPVAWUs+Ao8dP81X35doam5/5XwHmrqtbfkzja8=; b=fJGX+bZSZ9DmHcZLQStOZiyYVufKsK8+b2cCFX9z5c6zB+JgATrPXCCxaEuuk1J57ChPoEPcs Y8dHZRV9xLBDyR4EYl5pMCg/yarVPtVH/ac7GQz0+x5knNUdq0ZOH7g X-Developer-Key: i=chengming.zhou@linux.dev; a=ed25519; pk=5+68Wfci+T30FoQos5RH+hfToF6SlC+S9LMPSPBFWuw= X-Migadu-Flow: FLOW_OUT X-Rspamd-Queue-Id: 014C61A0019 X-Rspam-User: X-Stat-Signature: 1zwtyg44oehgitii8euq4bwaw6exu14s X-Rspamd-Server: rspam01 X-HE-Tag: 1708429481-425877 X-HE-Meta: U2FsdGVkX1+ufPLgnChSjbX0m0A/rz7YO99eLPLcy/hNg5QBIVNpVhY0UzcHjRCrhl+BgQTfsSHs9k8VTOX6lYSYiUn84gRYDtCKBcnum4gWqkuX/tZsWg6jkeE58LucwryVKVUb9F5hcW0Cicrm/h2R6+Lhk3Rai6MGCKF0MNNIvc2JJNLjoVptJsNfK7zGR7jpXnlF7h8Msh/mzL3r9AujGaFPxqafSFvQU3bVB3Lvza2S1iVa2JyQgLwXaJj6U/H3X02oDFbfNBb1c5dJhREduzg5rIaVMRGGquEOw4Bpliy1zZOAiOE8TrBiONu9q1YUND2Xc8hGv+TbeiGjJlDvwCQp3I0SG9B2/PTXpLbubtjYT2O3x4YO73/ZUwg0fUUElWA9jFlBG2NZPlkB0hnfYsLPxwGTs3J4YZ0svNUWTGS+6fAEKMrWVhw0ob3yyzrs9d3H0Vg3Rc4Zk0cNxHDGTJsHSdW0oVYN1SO8l6+imESJfG4rjSUwdNgJBuRmZFk25zll3NnC/wg04mmlSXAkn1ta6G/l5OIFcLak1BLVMoYdOPkLJ4sObZtSq+27yxYruWdCCUWIoihv/stC2lj6x8h9l36m8+91l59StjS2ZwQIidDCAnYKae3TMsDYd/Axk6kghlmXgBZclSLHPeQbdGFBKByOn2zcsCW/FrVn88JCmr7xRC6g341NVC8+edLa8i10NbdEZx9xD0TAFtI2DVemLZADbTNWoBx0YhPAgLXE+tAMv8HAmIDoLkRTHJaLsd8xQCZGl422FBcS5HjKnq8awXkvdUuA7vfYJG3yTzup5BN7uxxVnjm2w4iblohQ7u4euOfPhBwXX+SXUdRmnZ7IjEpuJ3j8gnPXZr64zLk8uQPDFbcTGT+S5h0aql9US+3y5y+04zsiVVQcrXU8tv27CHmkH/i+dLwTh2ueTxwFjV3SdstJ/gM2n/ZQuMQ1kzlP/H+7VHM7hNP PUVy2ym/ 0wYiQtt79qJjq2PGV8a47zc70+BNLu5nH/6ddxdnjBMQmzwgVt+E5Hqm2SQ9bwhiDD+M3K8Fj9S2mNcj0v8RBvodaYq1R3d02YS0dM3SsDA55xQJfd5IJ/90ljbzHjbq6dk9JRUaTGQ5MXY0PDSW/oo/WtGKn9JOvYHV70uqibXG7/Y2momWYsOXM3F8Kf++wxMc3 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Chengming Zhou We only need to update zspage->fullness when insert_zspage(), since zspage->class is never changed after allocated. Signed-off-by: Chengming Zhou Reviewed-by: Sergey Senozhatsky --- mm/zsmalloc.c | 13 ++----------- 1 file changed, 2 insertions(+), 11 deletions(-) diff --git a/mm/zsmalloc.c b/mm/zsmalloc.c index a48f4651d143..a6653915bf17 100644 --- a/mm/zsmalloc.c +++ b/mm/zsmalloc.c @@ -486,14 +486,6 @@ static struct size_class *zspage_class(struct zs_pool *pool, return pool->size_class[zspage->class]; } -static void set_zspage_mapping(struct zspage *zspage, - unsigned int class_idx, - int fullness) -{ - zspage->class = class_idx; - zspage->fullness = fullness; -} - /* * zsmalloc divides the pool into various size classes where each * class maintains a list of zspages where each zspage is divided @@ -688,6 +680,7 @@ static void insert_zspage(struct size_class *class, { class_stat_inc(class, fullness, 1); list_add(&zspage->list, &class->fullness_list[fullness]); + zspage->fullness = fullness; } /* @@ -725,7 +718,6 @@ static int fix_fullness_group(struct size_class *class, struct zspage *zspage) remove_zspage(class, zspage, currfg); insert_zspage(class, zspage, newfg); - set_zspage_mapping(zspage, class_idx, newfg); out: return newfg; } @@ -1005,6 +997,7 @@ static struct zspage *alloc_zspage(struct zs_pool *pool, create_page_chain(class, zspage, pages); init_zspage(class, zspage); zspage->pool = pool; + zspage->class = class->index; return zspage; } @@ -1397,7 +1390,6 @@ unsigned long zs_malloc(struct zs_pool *pool, size_t size, gfp_t gfp) obj = obj_malloc(pool, zspage, handle); newfg = get_fullness_group(class, zspage); insert_zspage(class, zspage, newfg); - set_zspage_mapping(zspage, class->index, newfg); record_obj(handle, obj); atomic_long_add(class->pages_per_zspage, &pool->pages_allocated); class_stat_inc(class, ZS_OBJS_ALLOCATED, class->objs_per_zspage); @@ -1655,7 +1647,6 @@ static int putback_zspage(struct size_class *class, struct zspage *zspage) fullness = get_fullness_group(class, zspage); insert_zspage(class, zspage, fullness); - set_zspage_mapping(zspage, class->index, fullness); return fullness; } From patchwork Tue Feb 20 11:44:30 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Chengming Zhou X-Patchwork-Id: 13563907 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 54F5BC48BC3 for ; Tue, 20 Feb 2024 11:44:47 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 59B866B0083; Tue, 20 Feb 2024 06:44:46 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 4880D6B0088; Tue, 20 Feb 2024 06:44:46 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 28D666B0089; Tue, 20 Feb 2024 06:44:46 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 0D7256B0083 for ; Tue, 20 Feb 2024 06:44:46 -0500 (EST) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id D408B12068C for ; Tue, 20 Feb 2024 11:44:45 +0000 (UTC) X-FDA: 81812000130.14.52C154E Received: from out-187.mta1.migadu.com (out-187.mta1.migadu.com [95.215.58.187]) by imf28.hostedemail.com (Postfix) with ESMTP id 315A7C0005 for ; Tue, 20 Feb 2024 11:44:43 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=g0nQyEhc; spf=pass (imf28.hostedemail.com: domain of chengming.zhou@linux.dev designates 95.215.58.187 as permitted sender) smtp.mailfrom=chengming.zhou@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1708429484; a=rsa-sha256; cv=none; b=oQi8HTbnI+Xaq+LsenFu7XI0gZrSDlLkiATyCyP7kRkuoG8Q+W2+W0vlQwNeon5pmhiwhz SwXdDk+Py7inUepZ5ByJW2A7wyv5eqoplC6B8h3I+6NqFXybzf9gPAVsshbzU2Lo3Y05h8 Xek707nmA3gMqYb25UN434CSRPQ9GiU= ARC-Authentication-Results: i=1; imf28.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=g0nQyEhc; spf=pass (imf28.hostedemail.com: domain of chengming.zhou@linux.dev designates 95.215.58.187 as permitted sender) smtp.mailfrom=chengming.zhou@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1708429484; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=frGjyVgHupGD7XyoLjuBNXl6egeagHTj4tQawTxfLDk=; b=d5lkO2sQYKmQG3gHWuhKKcuuIeQwS1CBtuxCHoFcqAMLM6v2uaEo1FF1o/PapU8uo93Y3w fp1Oz75nmzrUMPE/JySQyEWy+n1NfA44mPWxW/iS8R7jnyUCTNK9ASXbPafASSd/IHgZ8J IkolDdfAVr5fIfD1xzF0iJaLOlSW0DI= X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1708429482; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=frGjyVgHupGD7XyoLjuBNXl6egeagHTj4tQawTxfLDk=; b=g0nQyEhc0uv+uyH42ziPQ1j9bhr8hQRZCCD1pT3uRaE0h01LgIKi7xFEjBfKNbh47w5tba emvlznq1s+LOnT3Lw9TXWIogMbzkBgFeeOLy8fgJ2ioyd72Q8p+oL3w56Dqvf7WbgzC07F xS30vIqd5dGOK4fSMvu6DsMCjzJH//c= From: Chengming Zhou Date: Tue, 20 Feb 2024 11:44:30 +0000 Subject: [PATCH RESEND 2/3] mm/zsmalloc: remove_zspage() don't need fullness parameter MIME-Version: 1.0 Message-Id: <20240220-b4-zsmalloc-cleanup-v1-2-b7e9cbab9541@linux.dev> References: <20240220-b4-zsmalloc-cleanup-v1-0-b7e9cbab9541@linux.dev> In-Reply-To: <20240220-b4-zsmalloc-cleanup-v1-0-b7e9cbab9541@linux.dev> To: hannes@cmpxchg.org, Andrew Morton , Sergey Senozhatsky , nphamcs@gmail.com, yosryahmed@google.com, Minchan Kim Cc: linux-mm@kvack.org, Chengming Zhou , linux-kernel@vger.kernel.org X-Developer-Signature: v=1; a=ed25519-sha256; t=1708429476; l=2152; i=chengming.zhou@linux.dev; s=20240220; h=from:subject:message-id; bh=GQWspwGCFRIlLWu+jB/4L2Vh7hNigRDA/nhdzUelvTs=; b=HfKohdQBHsp+yH25vS97QDG5EljLYcLDRXNqctQwnwKj01ORLuWu4tU2UdBSKwG84P3sebhh0 +EDf/e7QoXHDzKOZQ3ztPMFYVZxHPOhdOxb/wSKcAv5ObGPWQggBTCa X-Developer-Key: i=chengming.zhou@linux.dev; a=ed25519; pk=5+68Wfci+T30FoQos5RH+hfToF6SlC+S9LMPSPBFWuw= X-Migadu-Flow: FLOW_OUT X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 315A7C0005 X-Stat-Signature: jpq4p5ag95atiiup3i3hmyrxxg1d7djn X-Rspam-User: X-HE-Tag: 1708429483-258807 X-HE-Meta: U2FsdGVkX19t95GowxJ1qagaoefa3k5J0Xm8vCo0lJJQRykf/BuH9vqoPQssIjmdirAN8Otjwkk2jJBLYkfGQHETbFvDjtTr/fAYDFi0il7craHewliZTJhV1OdhORPjesmGkdGcZf/4uzx0y2WxN99rbqj7VCN7epRDn38e2PmX3oK/IdeCDJFuSr8cN9FqQOK8jUUhxUA0efxUEzGoQTawRMe/G0eIc9NSFFaGrMIEXUGHy5d/jpkJa6TOjNif77WN31ZMkFFMNgl0gmFYAoK0odzjqn4FNfjUTCRE9tfaYI7vi0UNkLH465yGPjDW2od3N9Z/iOKjjph4wusvsqI/iyrv02HC02HPbKpMt8+zhqxCt+5kNnPnflAUArsHIRRIl9sWBJi+R0DnEpF8IqA6ZK2EekhxfuPChsdpv3IpQ0T9crlQXY/8SnLPsmMAFuL90QIifsFcLrWf5BJZRkXOYGAw17HStQZS33MWvXPVVuPgcqsnj7uSXwbyNSa1gFZ8+YBHQtNfQEHSfhX4XY/NZjre8rTZH+9FKfmVIHhaTZQFhJMkhbBMO7EGRabaE++/4Hg03likHpJmva1QSPpsZA0iZtZ3Ydul084ShaWI6F6XecQOQ+nYNGC0rBPP3BXpsYUqkc/JbMGY4Iuy4ApKt/FLBh8ZYmzTHyHEt7/q1SNI1P03iRxZPoeJKbfF7BeCkN2nQ734ohz5/tmt1ih498ywfnaUNbIE/NIeWQ6TUCuefVm3unLMcxEnh2iIHbLDGNHLLvVGVr4s9rgNpCYvOS6fBbnk2gQnQq7VR3KULy5IH6w15IicHknhLANsxAheHEnzT0ti1uROLgbsiIXeO/nBMycs X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Chengming Zhou We must remove_zspage() from its current fullness list, then use insert_zspage() to update its fullness and insert to new fullness list. Obviously, remove_zspage() doesn't need the fullness parameter. Signed-off-by: Chengming Zhou Reviewed-by: Sergey Senozhatsky --- mm/zsmalloc.c | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/mm/zsmalloc.c b/mm/zsmalloc.c index a6653915bf17..c39fac9361d7 100644 --- a/mm/zsmalloc.c +++ b/mm/zsmalloc.c @@ -687,10 +687,10 @@ static void insert_zspage(struct size_class *class, * This function removes the given zspage from the freelist identified * by . */ -static void remove_zspage(struct size_class *class, - struct zspage *zspage, - int fullness) +static void remove_zspage(struct size_class *class, struct zspage *zspage) { + int fullness = zspage->fullness; + VM_BUG_ON(list_empty(&class->fullness_list[fullness])); list_del_init(&zspage->list); @@ -716,7 +716,7 @@ static int fix_fullness_group(struct size_class *class, struct zspage *zspage) if (newfg == currfg) goto out; - remove_zspage(class, zspage, currfg); + remove_zspage(class, zspage); insert_zspage(class, zspage, newfg); out: return newfg; @@ -878,7 +878,7 @@ static void free_zspage(struct zs_pool *pool, struct size_class *class, return; } - remove_zspage(class, zspage, ZS_INUSE_RATIO_0); + remove_zspage(class, zspage); __free_zspage(pool, class, zspage); } @@ -1609,7 +1609,7 @@ static struct zspage *isolate_src_zspage(struct size_class *class) zspage = list_first_entry_or_null(&class->fullness_list[fg], struct zspage, list); if (zspage) { - remove_zspage(class, zspage, fg); + remove_zspage(class, zspage); return zspage; } } @@ -1626,7 +1626,7 @@ static struct zspage *isolate_dst_zspage(struct size_class *class) zspage = list_first_entry_or_null(&class->fullness_list[fg], struct zspage, list); if (zspage) { - remove_zspage(class, zspage, fg); + remove_zspage(class, zspage); return zspage; } } From patchwork Tue Feb 20 11:44:31 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Chengming Zhou X-Patchwork-Id: 13563908 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6B8C4C48BC4 for ; Tue, 20 Feb 2024 11:44:49 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id CA1E16B0088; Tue, 20 Feb 2024 06:44:48 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id C27086B0089; Tue, 20 Feb 2024 06:44:48 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A7E116B008A; Tue, 20 Feb 2024 06:44:48 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 8EA106B0088 for ; Tue, 20 Feb 2024 06:44:48 -0500 (EST) Received: from smtpin26.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 62AAD80642 for ; Tue, 20 Feb 2024 11:44:48 +0000 (UTC) X-FDA: 81812000256.26.B99760B Received: from out-184.mta1.migadu.com (out-184.mta1.migadu.com [95.215.58.184]) by imf12.hostedemail.com (Postfix) with ESMTP id 7EF3F4000E for ; Tue, 20 Feb 2024 11:44:46 +0000 (UTC) Authentication-Results: imf12.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=sFquOSfJ; spf=pass (imf12.hostedemail.com: domain of chengming.zhou@linux.dev designates 95.215.58.184 as permitted sender) smtp.mailfrom=chengming.zhou@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1708429486; a=rsa-sha256; cv=none; b=PXlEZD+laHomUNKc5aFpru0/2sGi9hrNXBv4PiY7r5ApCPb3t3XMWF7QBEUFL4MQy+YVig Ul7Eb7hbHK2lzrurAwgiXaKhNTGNeCUe1g1zl6NxvBxd/cl6rg+9mQvlsgKKXj77v/HtRl Y62ap1LDK2GbrhZ5Gqw5tVIE/g8fiNI= ARC-Authentication-Results: i=1; imf12.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=sFquOSfJ; spf=pass (imf12.hostedemail.com: domain of chengming.zhou@linux.dev designates 95.215.58.184 as permitted sender) smtp.mailfrom=chengming.zhou@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1708429486; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=ci79DiUWa7UnDzkerNUYQl6snYV1NrEQXPg7SGeMzMg=; b=n0vBNPXqi6a/pzZCUDPHxikZYXschs7taB7nta2V22L+F0C4SNxViOBK7jtlTGKURPLPRf TrXLDz8V+I8qOq5TKHEHQqFH39rVc0WU5LiavgAI/4FJzQbuDxGwW8FwqAHVVfwvCVnKlF fpEySGYOLV2ER/FQv/tQIB5A31rBmjY= X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1708429485; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ci79DiUWa7UnDzkerNUYQl6snYV1NrEQXPg7SGeMzMg=; b=sFquOSfJAfNaMCcn09Pz5sjO2zdozOZHHOKnWpE+LDSMzXP7F23EP9QanRL77oXcAT277F FC0SYpH2l+d3i9aCwXkf2Azx5DhAJIYgQhIpB19q7jstT7MPGibYDvOKlG4K6U8vBu87Ju bRtPc7aXmlSDbI5CnxSzfSZECVV6PY8= From: Chengming Zhou Date: Tue, 20 Feb 2024 11:44:31 +0000 Subject: [PATCH RESEND 3/3] mm/zsmalloc: remove get_zspage_mapping() MIME-Version: 1.0 Message-Id: <20240220-b4-zsmalloc-cleanup-v1-3-b7e9cbab9541@linux.dev> References: <20240220-b4-zsmalloc-cleanup-v1-0-b7e9cbab9541@linux.dev> In-Reply-To: <20240220-b4-zsmalloc-cleanup-v1-0-b7e9cbab9541@linux.dev> To: hannes@cmpxchg.org, Andrew Morton , Sergey Senozhatsky , nphamcs@gmail.com, yosryahmed@google.com, Minchan Kim Cc: linux-mm@kvack.org, Chengming Zhou , linux-kernel@vger.kernel.org X-Developer-Signature: v=1; a=ed25519-sha256; t=1708429476; l=2848; i=chengming.zhou@linux.dev; s=20240220; h=from:subject:message-id; bh=Xgdlm55CLoh7bhkT80TmmQFtvDTRQ4HP1+zxTxJBYgU=; b=6L4Rze0bnsKiqR9+QLqh2qD7BDtQUhtZu8ueGs9RPgzByahXpM+6pkTSsBD1omm7SA3abUFN5 ZTBlKgut6b+DoJxWVUkh0tjpPfx/6AV6Utfx4wSudSlGuNzInKTxDcM X-Developer-Key: i=chengming.zhou@linux.dev; a=ed25519; pk=5+68Wfci+T30FoQos5RH+hfToF6SlC+S9LMPSPBFWuw= X-Migadu-Flow: FLOW_OUT X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 7EF3F4000E X-Stat-Signature: a66cy43rz4hgqzmt5kr6z1t5fgb9nyj5 X-Rspam-User: X-HE-Tag: 1708429486-386972 X-HE-Meta: U2FsdGVkX196BvxqGiSnlQdWHaWJZT6V7ZXP+5nCl7qFEG+mUUyo/KH6BSpSieE5V4mrhrOKsuYVBI+iaQbi+PkIgP1GcoozVefl2y7INdSKsd+4Sg0u8lbA5ME1nOEKdBtJCTB4Nhqmwo32yLPRmvKS5QrDP8uD698q7Cw4TueSJj0mo1D+b760ZB/BUdMjQuKMMfco7KLJASxT2thNksAeQa8XKYdsMPsY2HN66xeYpVRtpvtVEFyEpSLTY7WeNJnopcBabsoW0hLB5mF+rmoG1beYn3kjlMMKm8HpEWv1NFd/cDMPPf3ms3wQoPHrfysejV2LWB2aleBZ4c7sLQpuaFIl57Ly9nyZnrssGvPW7xP9tSPif8Q0+xPtiAk4tlzNtrfh1n8qzamFvLfyf+W6UqAdPjilWLmdrGW7L7XmdCdXIZEtPdhFkK8d6ki/0XeI/OU1uwW84NViMQXB+IrQluFerO0L+KaXtz7sbJBxVMyiClshtA9Lg2qTmprA07+hZ9lSs31IwXeQJGouKXB4X50yb5uL7QySXFp27fe4sBybGwKpBHo+fcFPsOnT2A/CMhR+Tj1SxKxgmmXa925//k3+98tf7XyUqs13H7EqibRz1w9H6AAjDZo6MwTrMVPrRn6j2y9mEmUN8fj7brkLwqOuRTtGC6+zPU7SE7bLRZmuF14V3IJRvMcRW4lFAYtUkJwX+OEnfOfeBDguyS/M2lUCu8ucrbRO36axlRPi79Oh9sIEtLjL+BrZpDnc4aXaYmHQfershSTqs/BF0L3iNcJIIQ8RT1AZ7wk8u3gbkTFNMgRLmT1amdm8shxTTVJN+xgRIumBcl7N4BWJXlpytQnR1JCvYpJK5OLRwa1n4aeCG0LjJtYYxUV+MmJ6b1au5yrsuQwo0rlrwfI77jIH1lTVbXPKdqiNFk44c8I+cGN1Xs1sMILJ8aDF1vy0dzem5M6C6qugs3o+ajk O3Nj4Cfx 29x08W/2rnn8zVboSGgcuTYzjmkOzKIoibrXuTBTdXUtGZ63/+8PAGXKq7ch0+CpefzZJP7GxbgN8pNSvVE93Sq7oej19AaMbiiPHDDKBtC8SqNdFPaFq7WLBF2NmBdN1GIqqIYA8mMnaZnbnnDFKm5jRXrwRfKkHxKVVYtP/H5103xc6fF3MgNZCP+dhJIz7KX96 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Chengming Zhou Actually we seldom use the class_idx returned from get_zspage_mapping(), only the zspage->fullness is useful, just use zspage->fullness to remove this helper. Note zspage->fullness is not stable outside pool->lock, remove redundant "VM_BUG_ON(fullness != ZS_INUSE_RATIO_0)" in async_free_zspage() since we already have the same VM_BUG_ON() in __free_zspage(), which is safe to access zspage->fullness with pool->lock held. Signed-off-by: Chengming Zhou Reviewed-by: Sergey Senozhatsky --- mm/zsmalloc.c | 28 ++++------------------------ 1 file changed, 4 insertions(+), 24 deletions(-) diff --git a/mm/zsmalloc.c b/mm/zsmalloc.c index c39fac9361d7..63ec385cd670 100644 --- a/mm/zsmalloc.c +++ b/mm/zsmalloc.c @@ -470,16 +470,6 @@ static inline void set_freeobj(struct zspage *zspage, unsigned int obj) zspage->freeobj = obj; } -static void get_zspage_mapping(struct zspage *zspage, - unsigned int *class_idx, - int *fullness) -{ - BUG_ON(zspage->magic != ZSPAGE_MAGIC); - - *fullness = zspage->fullness; - *class_idx = zspage->class; -} - static struct size_class *zspage_class(struct zs_pool *pool, struct zspage *zspage) { @@ -708,12 +698,10 @@ static void remove_zspage(struct size_class *class, struct zspage *zspage) */ static int fix_fullness_group(struct size_class *class, struct zspage *zspage) { - int class_idx; - int currfg, newfg; + int newfg; - get_zspage_mapping(zspage, &class_idx, &currfg); newfg = get_fullness_group(class, zspage); - if (newfg == currfg) + if (newfg == zspage->fullness) goto out; remove_zspage(class, zspage); @@ -835,15 +823,11 @@ static void __free_zspage(struct zs_pool *pool, struct size_class *class, struct zspage *zspage) { struct page *page, *next; - int fg; - unsigned int class_idx; - - get_zspage_mapping(zspage, &class_idx, &fg); assert_spin_locked(&pool->lock); VM_BUG_ON(get_zspage_inuse(zspage)); - VM_BUG_ON(fg != ZS_INUSE_RATIO_0); + VM_BUG_ON(zspage->fullness != ZS_INUSE_RATIO_0); next = page = get_first_page(zspage); do { @@ -1857,8 +1841,6 @@ static void async_free_zspage(struct work_struct *work) { int i; struct size_class *class; - unsigned int class_idx; - int fullness; struct zspage *zspage, *tmp; LIST_HEAD(free_pages); struct zs_pool *pool = container_of(work, struct zs_pool, @@ -1879,10 +1861,8 @@ static void async_free_zspage(struct work_struct *work) list_del(&zspage->list); lock_zspage(zspage); - get_zspage_mapping(zspage, &class_idx, &fullness); - VM_BUG_ON(fullness != ZS_INUSE_RATIO_0); - class = pool->size_class[class_idx]; spin_lock(&pool->lock); + class = zspage_class(pool, zspage); __free_zspage(pool, class, zspage); spin_unlock(&pool->lock); }