From patchwork Thu Jun 13 13:17:32 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Honggyu Kim X-Patchwork-Id: 13696763 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B90D7C27C75 for ; Thu, 13 Jun 2024 13:18:14 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3AC536B0098; Thu, 13 Jun 2024 09:18:14 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 3014B6B0099; Thu, 13 Jun 2024 09:18:14 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1A1326B009B; Thu, 13 Jun 2024 09:18:14 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id EE2D06B0099 for ; Thu, 13 Jun 2024 09:18:13 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 34A84A19CF for ; Thu, 13 Jun 2024 13:18:13 +0000 (UTC) X-FDA: 82225918866.16.F539365 Received: from invmail4.hynix.com (exvmail4.skhynix.com [166.125.252.92]) by imf23.hostedemail.com (Postfix) with ESMTP id 3362B140019 for ; Thu, 13 Jun 2024 13:18:10 +0000 (UTC) Authentication-Results: imf23.hostedemail.com; dkim=none; spf=pass (imf23.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1718284691; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Rl5E73uGRRcKTVvOfVp8xwFRVoPsVjC9ryzV00Kphw8=; b=pd1nt1KStAIVM7Gl5dW1e7pWMhNNGS35L9fWldUMLigkR1UaHe7/P6zno8/4DAjgik6Kdd 1WH8i+q85ogNUmMwvS655v/WZ1FgPUHu0f/KRRufglRvD7DiBaSY+9YYvQLVU+WtisRWec E6WVNkBtM4M9iC6Gzd6jOBLvF3dje6E= ARC-Authentication-Results: i=1; imf23.hostedemail.com; dkim=none; spf=pass (imf23.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1718284691; a=rsa-sha256; cv=none; b=lcsxwrKPPghHVVMZdo3u89ONAISDVhtg1F8uGULS0+VbtvlNeBhUBI9y0fCUW/MWEhiDQr DvxJGyEpQda6Eu460Zu7jZPoLs09tEVoih/7xfFnf57iqZ/N+v8yETnNWWC9eiHMcxNh78 0mX/M14FA82AzfZomzsS1jONm2eWDQU= X-AuditID: a67dfc5b-d6dff70000001748-2b-666af18c52e4 From: Honggyu Kim To: SeongJae Park , damon@lists.linux.dev Cc: Andrew Morton , Masami Hiramatsu , Mathieu Desnoyers , Steven Rostedt , Gregory Price , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, 42.hyeyoo@gmail.com, art.jeongseob@gmail.com, kernel_team@skhynix.com, Honggyu Kim Subject: [PATCH 1/8] mm: make alloc_demote_folio externally invokable for migration Date: Thu, 13 Jun 2024 22:17:32 +0900 Message-ID: <20240613131741.513-2-honggyu.kim@sk.com> X-Mailer: git-send-email 2.43.0.windows.1 In-Reply-To: <20240613131741.513-1-honggyu.kim@sk.com> References: <20240613131741.513-1-honggyu.kim@sk.com> MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFnrNLMWRmVeSWpSXmKPExsXC9ZZnkW7Px6w0g/2T5S0m9hhYzFm/hs3i /oPX7BZP/v9mtWhoesRicXnXHDaLe2v+s1ocWX+WxWLz2TPMFouXq1ns63jAZHH46xsmBx6P paffsHnsnHWX3aNl3y12j02rOtk8Nn2axO5xYsZvFo8Xm2cyemz8+J/d4/MmuQDOKC6blNSc zLLUIn27BK6MKacPMhd0clf8nbqavYFxPmcXIyeHhICJxK8JR9lg7FtNRxhBbDYBNYkrLycx dTFycIgIWElM2xHbxcjFwSywgVli0rkXTCA1wgLBElt6O5hBbBYBVYnuRYvAenkFTCXmfl3L AjFTU+Lx9p/sIDangJnEum/3wWqEgGo6/j9jhqgXlDg58wlYPbOAvETz1tnMIMskBJ6zSSyd vh7qOEmJgytusExg5J+FpGcWkp4FjEyrGIUy88pyEzNzTPQyKvMyK/SS83M3MQKjYFntn+gd jJ8uBB9iFOBgVOLh9XiWlSbEmlhWXJl7iFGCg1lJhHfWQqAQb0piZVVqUX58UWlOavEhRmkO FiVxXqNv5SlCAumJJanZqakFqUUwWSYOTqkGxgmbT4lXGsstDDgw6UuL2YoF6yd8jTLLK3dt O17lLnrE7YX+/IoTc24tC5Jr3nh8mVzz9vNvtiw0i566hcmqqyZp0dftbgncqpbcebz3fIqf 3RZpmdhcqv71ULHp8mPSJVyO2jbdKbtXra9fvXa6qJXD2qip2m/y9axDlcq53LdEVm16+c+s VImlOCPRUIu5qDgRADNYT1t+AgAA X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrNLMWRmVeSWpSXmKPExsXCNUNLT7fnY1aawdtLghYTewws5qxfw2Zx /8Frdosn/3+zWjQ0PWKx+PzsNbPF4bknWS0u75rDZnFvzX9WiyPrz7JYbD57htli8XI1i30d D5gsDn99w+TA57H09Bs2j52z7rJ7tOy7xe6xaVUnm8emT5PYPU7M+M3i8WLzTEaPjR//s3t8 u+3hsfjFByaPz5vkArijuGxSUnMyy1KL9O0SuDKmnD7IXNDJXfF36mr2Bsb5nF2MnBwSAiYS t5qOMILYbAJqEldeTmLqYuTgEBGwkpi2I7aLkYuDWWADs8Skcy+YQGqEBYIltvR2MIPYLAKq Et2LFoH18gqYSsz9upYFYqamxOPtP9lBbE4BM4l13+6D1QgB1XT8f8YMUS8ocXLmE7B6ZgF5 ieats5knMPLMQpKahSS1gJFpFaNIZl5ZbmJmjqlecXZGZV5mhV5yfu4mRmCQL6v9M3EH45fL 7ocYBTgYlXh4PZ5lpQmxJpYVV+YeYpTgYFYS4Z21ECjEm5JYWZValB9fVJqTWnyIUZqDRUmc 1ys8NUFIID2xJDU7NbUgtQgmy8TBKdXAuGcS/8F7a1WXezHoi9Wa+XJIXWbeGlhkM3ma+vV+ zQ9zWwUvLjzJqrD80YGJBgVCXYx7ngd4Fa7dmnji0M1ZQjcYD+cfKXqSumNq5dlOOz+DZXNn dshqrHdnyd24Y43Z8xTByVnHFjW5zFM9spfTIHbxr41aXwpDUo9YL2Isn2D1cIaEscu5AiWW 4oxEQy3mouJEAJ586qJuAgAA X-CFilter-Loop: Reflected X-Stat-Signature: i7iodnkbgh8h96ydkea4si3afu3cyt5j X-Rspam-User: X-Rspamd-Queue-Id: 3362B140019 X-Rspamd-Server: rspam02 X-HE-Tag: 1718284690-832784 X-HE-Meta: U2FsdGVkX19CYePHVLBOM8IpT4F4AaBwIXQ60TjJKVp7NQIJK4/AwrWPOaAvv3JS0JmHtP8B/yrgFnQFsHdHWKLyQbGRF9TihPka53gUNSmFYYOclJogRVXk3Cr1xWxTJHGfg+e2m4e5VBklLRowgNvDFMzRGK4aJre+4cUMvd3X4y2tVQEJjkKJW2SPgR3zlx5vcLi5CcBZjM0oz7M1koiYiMrHSy/IifoTQXPSCRY3wmm0OUy2VxVoBCzES9Bt3tIelxqdiHlLkFSG3T50e7dSa5rfJa2vFq3YsyXeqwfocbz2B0zm1CCvVDewHj1s0YLUxGDf6CH81LSbhlgqQHSViyyz+cAiB+N6BgtZuEAks2ZA3Di4bO0Uuf56KEA94+aXmesykt9BVbE6jdZ/Bfu/S45skjMtRzzaTEF/9zsGzPBzRQJKcuemWe82AkWa4O9CIWL7oMgN9ZYmPtHiAQ99LkUqShPl4veLRDWNKkB5fZ6EVHoMnFPt6rtYDSXdhNTtB7kJJH1Fbh03XL1+okWt4gWVCt0xgINxm0F3XaaneDecgpQFwhV5CwbMdWyz7e3YG4mP/YTN7RMiKjr9BLJ7ocaEW22vw4XHrw11L2z0tvSXLCB1jiQoe7bLGZHERF5XY5JKLfIamhU8c/9C7dXXrzun/npCcvgXwPcTgpYqdqYhZBHCwQWQmQ2skpHmZsdAw1AD1YDHdJp9ZHQAcRWyyPxKbywLwKu9vrU/Yvm/LDIlF5Pkgg2Nh2U7dOnywkg2Zfn2zUZ5cufwPlBcIPSW12Hk0R3GpIuyrJK67oskmjHYWGxKTrKejUrxWdNfToszP7MY+lap6SGMuhPgJ9y32R/gfFOOZpY7JZYlAdbQqAowpWryCzPmK9A6h09+ivFVgWTKIZiLJQ8P0JqfRKrrsO9I8np1SHFDZydT4J23Stas3gknAf/pthfo97vzxodIsAdDCvlkcDRWpGz Z6KA94cH AwgInHZ5ORAJRKmmvFDd+Lw7SjhcblCNj+JHmBcB0PP8QtSuzxxdbHoWdJH3LIcKKD8qIveBWDv3Lfnt5m6ZUZpvV1+LJCBtbe8duYKC4jqGGTycJK/vaLiDQyJioyvyqyzGwaqo5w8UBr6UWLm/dsXRX+fTWhlPmceJwVrPQKg02vDo1vf+4YNT0IXdtan6L2grsXENTFDFptoU= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The alloc_demote_folio can be used out of vmscan.c so it'd be better to remove static keyword from it. Signed-off-by: Honggyu Kim Reviewed-by: SeongJae Park Signed-off-by: SeongJae Park --- mm/internal.h | 1 + mm/vmscan.c | 3 +-- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/mm/internal.h b/mm/internal.h index b2c75b12014e..b3ca996a4efc 100644 --- a/mm/internal.h +++ b/mm/internal.h @@ -1052,6 +1052,7 @@ extern unsigned long __must_check vm_mmap_pgoff(struct file *, unsigned long, unsigned long, unsigned long); extern void set_pageblock_order(void); +struct folio *alloc_demote_folio(struct folio *src, unsigned long private); unsigned long reclaim_pages(struct list_head *folio_list); unsigned int reclaim_clean_pages_from_list(struct zone *zone, struct list_head *folio_list); diff --git a/mm/vmscan.c b/mm/vmscan.c index 2e34de9cd0d4..2f4406872f43 100644 --- a/mm/vmscan.c +++ b/mm/vmscan.c @@ -916,8 +916,7 @@ static void folio_check_dirty_writeback(struct folio *folio, mapping->a_ops->is_dirty_writeback(folio, dirty, writeback); } -static struct folio *alloc_demote_folio(struct folio *src, - unsigned long private) +struct folio *alloc_demote_folio(struct folio *src, unsigned long private) { struct folio *dst; nodemask_t *allowed_mask; From patchwork Thu Jun 13 13:17:33 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Honggyu Kim X-Patchwork-Id: 13696764 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C7DC0C27C4F for ; Thu, 13 Jun 2024 13:18:16 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 68DDE6B0099; Thu, 13 Jun 2024 09:18:14 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 5740A6B009C; Thu, 13 Jun 2024 09:18:14 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 215CC6B009A; Thu, 13 Jun 2024 09:18:14 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id ED1F86B0098 for ; Thu, 13 Jun 2024 09:18:13 -0400 (EDT) Received: from smtpin05.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 16089A19CE for ; Thu, 13 Jun 2024 13:18:13 +0000 (UTC) X-FDA: 82225918866.05.751785C Received: from invmail4.hynix.com (exvmail4.hynix.com [166.125.252.92]) by imf28.hostedemail.com (Postfix) with ESMTP id F069FC0017 for ; Thu, 13 Jun 2024 13:18:10 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=none; spf=pass (imf28.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1718284690; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=vkLVLR7lzzPMBnbyfxFYyYGebPismruQB5Ra8PgByho=; b=aXDxqCOpd4vuTTkNwygwFgXi58mCs1wo0+Rqh7/pwVzBe8h/WxaQxoqFUr9yngviR62lhC fP2Src5Qaw2OWzzWGxa+EUGCD5RybXXCjL8gvEdeZfZCq7cIMnfY6ZgD07Q8p1f70CzJKk kgApcPt/BV3GSeHOzwbC/xhz5XHdg38= ARC-Authentication-Results: i=1; imf28.hostedemail.com; dkim=none; spf=pass (imf28.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1718284690; a=rsa-sha256; cv=none; b=6kikLfHNZQTTaYECLzWKXdTt+x2ywGjLLBb3gBr2XPLxV5iyzO3btTtvD4VFzcZO0aBTey ynDmGOfDEOPFX9WMOE0pqtzPSweL5MdIRGVKs1y++ioXSJfxNJkxR373c/VNZn+jvu/Qi/ xRl/D3l/bS7wUVPbRURBNUwMCSoxXj0= X-AuditID: a67dfc5b-d6dff70000001748-30-666af18dbc35 From: Honggyu Kim To: SeongJae Park , damon@lists.linux.dev Cc: Andrew Morton , Masami Hiramatsu , Mathieu Desnoyers , Steven Rostedt , Gregory Price , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, 42.hyeyoo@gmail.com, art.jeongseob@gmail.com, kernel_team@skhynix.com, Honggyu Kim Subject: [PATCH 2/8] mm: rename alloc_demote_folio to alloc_migrate_folio Date: Thu, 13 Jun 2024 22:17:33 +0900 Message-ID: <20240613131741.513-3-honggyu.kim@sk.com> X-Mailer: git-send-email 2.43.0.windows.1 In-Reply-To: <20240613131741.513-1-honggyu.kim@sk.com> References: <20240613131741.513-1-honggyu.kim@sk.com> MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFnrFLMWRmVeSWpSXmKPExsXC9ZZnkW7vx6w0gzXXZCwm9hhYzFm/hs3i /oPX7BZP/v9mtWhoesRicXnXHDaLe2v+s1ocWX+WxWLz2TPMFouXq1ns63jAZHH46xsmBx6P paffsHnsnHWX3aNl3y12j02rOtk8Nn2axO5xYsZvFo8Xm2cyemz8+J/d4/MmuQDOKC6blNSc zLLUIn27BK6Ml4u7WQvu8VXc3fiarYFxDU8XIyeHhICJxNktB5hh7MdnFrGD2GwCahJXXk5i 6mLk4BARsJKYtiO2i5GLg1lgA7PEpHMvmEBqhAU8JRov94HVswioSixb2Aw2h1fAVOL+t5Us EDM1JR5v/wlWwylgJrHu231GEFsIqKbj/zOoekGJkzOfgNUzC8hLNG+dDXXPczaJ0/+MIGxJ iYMrbrBMYOSfhaRlFpKWBYxMqxiFMvPKchMzc0z0MirzMiv0kvNzNzECY2BZ7Z/oHYyfLgQf YhTgYFTi4fV4lpUmxJpYVlyZe4hRgoNZSYR31kKgEG9KYmVValF+fFFpTmrxIUZpDhYlcV6j b+UpQgLpiSWp2ampBalFMFkmDk6pBsaYmXzCRzMbSz63NCgZpNjkaOsou3aX2HtqSy2ZVenY qMbsa+WRJKVhGHjdctIUi3WlFpNkp/j5d/htVp9ikLg20Sv+cpqQz6xnyxLkv5n2z7Y04jn/ v/Xf43VHZKKm7RUy/FF8uDRx3noV+VvFRb/4lmRksTYsmng9v/9h9eL5u7b9sAuercRSnJFo qMVcVJwIAPglvkF9AgAA X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrNLMWRmVeSWpSXmKPExsXCNUNLT7f3Y1aawYlz3BYTewws5qxfw2Zx /8Frdosn/3+zWjQ0PWKx+PzsNbPF4bknWS0u75rDZnFvzX9WiyPrz7JYbD57htli8XI1i30d D5gsDn99w+TA57H09Bs2j52z7rJ7tOy7xe6xaVUnm8emT5PYPU7M+M3i8WLzTEaPjR//s3t8 u+3hsfjFByaPz5vkArijuGxSUnMyy1KL9O0SuDJeLu5mLbjHV3F342u2BsY1PF2MnBwSAiYS j88sYgex2QTUJK68nMTUxcjBISJgJTFtR2wXIxcHs8AGZolJ514wgdQIC3hKNF7uA6tnEVCV WLawmRnE5hUwlbj/bSULxExNicfbf4LVcAqYSaz7dp8RxBYCqun4/wyqXlDi5MwnYPXMAvIS zVtnM09g5JmFJDULSWoBI9MqRpHMvLLcxMwcU73i7IzKvMwKveT83E2MwCBfVvtn4g7GL5fd DzEKcDAq8fB6PMtKE2JNLCuuzD3EKMHBrCTCO2shUIg3JbGyKrUoP76oNCe1+BCjNAeLkjiv V3hqgpBAemJJanZqakFqEUyWiYNTqoExy3Iyi+vNoHLmLeGyyTmWH7Y/d1wb8jc0eNaSpR7X nz+dG+FeOHHHv8KlU5T2fTNbvs88wOZW86wYlksbczL23fnCMF2SbZeZ3X6Ju9ohvstMdp/e 7bbz3l0LQSfN0x2Ox5ZVhhY2hv62jZQT/nimQIVr9/GHZ1lrde9oXmTbw26gcFzK5d5uJZbi jERDLeai4kQAO1n+524CAAA= X-CFilter-Loop: Reflected X-Rspamd-Server: rspam03 X-Rspam-User: X-Rspamd-Queue-Id: F069FC0017 X-Stat-Signature: hx13rjommwdm6t4kje3ws548hqjomg9s X-HE-Tag: 1718284690-548290 X-HE-Meta: U2FsdGVkX18Kwi5P4Y8P/WP9mtbvFn6Vm7+39CSRSZ/tbj985corNUj5US2Kctwj17yFRsF8YajLswkOgBvXgW/x/gn4YmOlZZRLd3RptBCGww822LDk+bYgPy5Kal2iAHCJlJGZn9v5BZg+9YbmI5rcicFy8sEtgROOK9xhCz8nwaTWMUTsjyh9AkpwbiRrx1CdCYotvWuolfg05Na9Xwn+0gT4inVqYsQsQPg0rlbuppRv2NdFR5Aq9pFBf/s9akJKqYRwnC4xkkMrK/jJpx/5Fg3v0NyvureNkGsglszqaRqSn0e9Z6UFSFEaYG4AVb17uNM4BpLgUmBBquMx3oIjPcdPdnziWyOX8rAFaNhuYYe1bhyARivLomxc1ISMcDQ9URgk81XU1Sj1IK/GqxneFcM1kVxJvR2iczBfCny9Wv8ojp9k1Ibt4SyXIWQw2XnoZZ8SxMwgve7jAslbYA5WYtBynoNN+pHyhW9h1VJAhdRtzsyU8k8pVppsFQhX3ybvDPcGMxAt/jL1AJhWmanCNtTROF/d7WHes+rUpkpBJZrl1aw1bYYaS3r8wZrEuyYG/xhjj5idai5LyoYW+H9bGErhPEn5T+dKPapgb71zY5i464YfDtY4T3PYvZ3HEj+KqgFFMJifQvihW/krb6yAqA0aPi6gznCR1L7t5xE/Tjwvkv7QDQ8+W3JpcuXf1jsJSZpdfBmhJNrH8YlPj2wvfO5V2zitBFtbwBP3j4NZ3+VtP6tiy/xD0ZCk8RH8rvBppEru8w4wjQVGIlCntACMh9sCgrPQd01adPlp+htC0zpQHhAI8MYvlL3A+WItl59nrgfnhR1kVBo06VVrV/FZehNTinKSWOu5HSesuo8lvksZD5nGRypSwciYWgG3KrOuzDIP8oQBXLfZo9QJGt8Q5+y5qVepcvGStPmYu9Xy7Ep9uotHlqd/4GMD3ntjI8GmT6WJhD73XK9Yv0b 3yfyADRQ kFBo/XWmSZe2RLb5Mfz+66e477sy3wd4XPB2MG/Ax457UUruuc6vCjsVMWkbbZ4suUammdwaz05xlZtZu1rONgYxjWM5xqEO0hncMZBC3vg9Zp6WmZ22qCU2xnj408xZWLaAIgR7V+wIQP0RvT8L5RRQGnw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The alloc_demote_folio can also be used for general migration including both demotion and promotion so it'd be better to rename it from alloc_demote_folio to alloc_migrate_folio. Signed-off-by: Honggyu Kim --- mm/internal.h | 2 +- mm/vmscan.c | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/mm/internal.h b/mm/internal.h index b3ca996a4efc..9f967842f636 100644 --- a/mm/internal.h +++ b/mm/internal.h @@ -1052,7 +1052,7 @@ extern unsigned long __must_check vm_mmap_pgoff(struct file *, unsigned long, unsigned long, unsigned long); extern void set_pageblock_order(void); -struct folio *alloc_demote_folio(struct folio *src, unsigned long private); +struct folio *alloc_migrate_folio(struct folio *src, unsigned long private); unsigned long reclaim_pages(struct list_head *folio_list); unsigned int reclaim_clean_pages_from_list(struct zone *zone, struct list_head *folio_list); diff --git a/mm/vmscan.c b/mm/vmscan.c index 2f4406872f43..f5414b101909 100644 --- a/mm/vmscan.c +++ b/mm/vmscan.c @@ -916,7 +916,7 @@ static void folio_check_dirty_writeback(struct folio *folio, mapping->a_ops->is_dirty_writeback(folio, dirty, writeback); } -struct folio *alloc_demote_folio(struct folio *src, unsigned long private) +struct folio *alloc_migrate_folio(struct folio *src, unsigned long private) { struct folio *dst; nodemask_t *allowed_mask; @@ -979,7 +979,7 @@ static unsigned int demote_folio_list(struct list_head *demote_folios, node_get_allowed_targets(pgdat, &allowed_mask); /* Demotion ignores all cpuset and mempolicy settings */ - migrate_pages(demote_folios, alloc_demote_folio, NULL, + migrate_pages(demote_folios, alloc_migrate_folio, NULL, (unsigned long)&mtc, MIGRATE_ASYNC, MR_DEMOTION, &nr_succeeded); From patchwork Thu Jun 13 13:17:34 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Honggyu Kim X-Patchwork-Id: 13696765 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B215AC27C6E for ; Thu, 13 Jun 2024 13:18:19 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 28D156B008C; Thu, 13 Jun 2024 09:18:16 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 1A1396B009A; Thu, 13 Jun 2024 09:18:16 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id F36086B009B; Thu, 13 Jun 2024 09:18:15 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id D36BD6B008C for ; Thu, 13 Jun 2024 09:18:15 -0400 (EDT) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 8E01CA390F for ; Thu, 13 Jun 2024 13:18:15 +0000 (UTC) X-FDA: 82225918950.12.36F028D Received: from invmail4.hynix.com (exvmail4.hynix.com [166.125.252.92]) by imf28.hostedemail.com (Postfix) with ESMTP id 7C240C001C for ; Thu, 13 Jun 2024 13:18:13 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=none; spf=pass (imf28.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1718284693; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SN9/9fXVS0VGJMpc94Tf26ovwLc7alHK1OzF0qhMZVE=; b=hf+0fzoiV/4sbXGNup94kICKDgk7ht5D6seYOsMOY/u10OUWDH1IkxYiOcHF5TXV7Lfbo1 lDYZkiaY5s3xyZW02KalcgKX/s3c811fbcTFlrVvtmubnulDeycqtaY8fsiLaOLzzbK5dK FFv0EVuN2yii+Q+3KnWDxoU4KGbo+L4= ARC-Authentication-Results: i=1; imf28.hostedemail.com; dkim=none; spf=pass (imf28.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1718284693; a=rsa-sha256; cv=none; b=OdDE/XptxSV0HlMUdCps/pwSlCPleM2dGGGetNqvYfnMDclY8GmA9KMtHvp6bBb07/tmCc Un2s+ioWO3FhNBVlWxptT7CovjXD/jipR4CmYdh3nTeky5KYEzqhj4XV5EDqdCi3ReFo0C 7nJePQH2lh6pGuxXyFWephEASUm4uys= X-AuditID: a67dfc5b-d6dff70000001748-34-666af18e204d From: Honggyu Kim To: SeongJae Park , damon@lists.linux.dev Cc: Andrew Morton , Masami Hiramatsu , Mathieu Desnoyers , Steven Rostedt , Gregory Price , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, 42.hyeyoo@gmail.com, art.jeongseob@gmail.com, kernel_team@skhynix.com, Hyeongtak Ji , Honggyu Kim Subject: [PATCH 3/8] mm/damon/sysfs-schemes: add target_nid on sysfs-schemes Date: Thu, 13 Jun 2024 22:17:34 +0900 Message-ID: <20240613131741.513-4-honggyu.kim@sk.com> X-Mailer: git-send-email 2.43.0.windows.1 In-Reply-To: <20240613131741.513-1-honggyu.kim@sk.com> References: <20240613131741.513-1-honggyu.kim@sk.com> MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFnrJLMWRmVeSWpSXmKPExsXC9ZZnkW7fx6w0g49rJS0m9hhYzFm/hs3i /oPX7BZP/v9mtWhoesRicXnXHDaLe2v+s1ocWX+WxWLz2TPMFouXq1ns63jAZHH46xsmBx6P paffsHnsnHWX3aNl3y12j02rOtk8Nn2axO5xYsZvFo8Xm2cyemz8+J/d4/MmuQDOKC6blNSc zLLUIn27BK6M4+vbWAouW1U82vGIsYFxo0EXIyeHhICJxI8n+1hg7Juf5jOD2GwCahJXXk5i 6mLk4BARsJKYtiO2i5GLg1ngGrPE7u6TYDXCAj4S969MZgOpYRFQlWi5GgFi8gqYSmyZngAx UVPi8faf7CA2p4CZxLpv9xlBbCGgko7/z8Cm8AoISpyc+QTsAmYBeYnmrbOZQVZJCLxnk9g4 fQHUaZISB1fcYJnAyD8LSc8sJD0LGJlWMQpl5pXlJmbmmOhlVOZlVugl5+duYgRGwLLaP9E7 GD9dCD7EKMDBqMTD6/EsK02INbGsuDL3EKMEB7OSCO+shUAh3pTEyqrUovz4otKc1OJDjNIc LErivEbfylOEBNITS1KzU1MLUotgskwcnFINjHxMrMyrBbO3m5w9P6/qcM1bS/6lb+Kez7Xh Dnrx63et6Mlvjs4HOFet8ovykyqY/7WxOlO9pkMtYs+O3Nmlix/t7/M3Z1iQ0nD5kvOqKZb6 2/y1r58I0t32+vn/V3HnJ1xze35keZyP/r/6VUpFYp6saafCe3dULQ/lZZwg9Pahy+W/Mmym l5VYijMSDbWYi4oTAWOkM+d8AgAA X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrHLMWRmVeSWpSXmKPExsXCNUNLT7fvY1aaQfciLouJPQYWc9avYbO4 /+A1u8WT/79ZLRqaHrFYfH72mtmi88l3RovDc0+yWlzeNYfN4t6a/6wWR9afZbHYfPYMs8Xi 5WoW+zoeMFkc/vqGyYHfY+npN2weO2fdZfdo2XeL3WPTqk42j02fJrF7nJjxm8XjxeaZjB4b P/5n9/h228Nj8YsPTB6fN8kFcEdx2aSk5mSWpRbp2yVwZRxf38ZScNmq4tGOR4wNjBsNuhg5 OSQETCRufprPDGKzCahJXHk5iamLkYNDRMBKYtqO2C5GLg5mgWvMEru7T4LVCAv4SNy/MpkN pIZFQFWi5WoEiMkrYCqxZXoCxERNicfbf7KD2JwCZhLrvt1nBLGFgEo6/j8Dm8IrIChxcuYT FhCbWUBeonnrbOYJjDyzkKRmIUktYGRaxSiSmVeWm5iZY6pXnJ1RmZdZoZecn7uJERjqy2r/ TNzB+OWy+yFGAQ5GJR5ej2dZaUKsiWXFlbmHGCU4mJVEeGctBArxpiRWVqUW5ccXleakFh9i lOZgURLn9QpPTRASSE8sSc1OTS1ILYLJMnFwSjUwLimsDXa7s64sdW/LCov9ydvW7Wl9qcpe 9IQjqrwuvCTpd/mv1wlLttmVKNpv6yyWV766MmN91u8zG0xL5L9ecZ/1X/CB5xyZ9hjlf/8m 9PnecXI/k8mx7NiFDUHHHbcH77EqvXzgbIuvxjxu05xHnmEzgnR9bNJ3mYWsDQ6+KtVq6Gqx Rn2ZEktxRqKhFnNRcSIA/VO9TnECAAA= X-CFilter-Loop: Reflected X-Rspamd-Server: rspam03 X-Rspam-User: X-Rspamd-Queue-Id: 7C240C001C X-Stat-Signature: k4gnbfxfeg6tds3b8bc39411t54cgh1d X-HE-Tag: 1718284693-603810 X-HE-Meta: U2FsdGVkX1/7i1qOFwmOiim41DMnTG5ByCgyeOKENMD75Lo5aaRPw6Nvgt7FxBWLCmx7R7Bp9BDUROntt1XEqKvnqrlIYytqU7m13YzBcCjsXWG7NxXrAzDJEwC1u4P+8fHk5BG/+JY1rpYA7cmyTpq52/YpSKLDZVXd1ahKHsHfaTf6G471TDV7mAX29WG++ue2dUYooPpS1bdp0kVn3zMZWiT1l934VbUrtwCdMayxXV3xKdxY9NoC3FXD/1mim0fSkcvQc0izDA6kG+QEIK+3lHD8+H3tEeJp/AeUDjKEpAlptdZZ9O9Vv7uAymxXqRksAJzm+pcxEuc8IuaeKENB3mAflHgxrORDlQRDxKHLk6AORuXY9b7uRQVeHlDJA7ojUqkKP11CasOPPbmpOCdC/pGoOOEs2W193MmFb2OxBWqrgbpebBlU/za4Rk69KW5tp05BtLnCnvl8zfaT1cxjU4BY6WTCtRVKQmG4ujM2FxfXtVqKD9woPgwXcdLSFV5jUFIEgpGkhcitsfrXcAEGUgdgGxwdb66z5HIqFe/djf+GuW5aBDWi8JBcMtUB8UAfIFknLaaVJEpG9/EOuxPuJekeJVFmRpYXp6E+OY6e3N/7edve+pqhfucWr41sl3nhoK2AMXNg5cA/VaftbzGGVo0TyNBr3/VwKpGdKiCqXF03gYgADT04rQ2q81WoZCkC9SZeABeiapJhApjhOPR3nI3sKpwoSozzdOcI925ZdQa4DvhI7XGzzArEpPwgSzpl8C7Eaxa3gFvUxFw5msL2dWHKg7DFHW12qpdMZf/LoTvUkjjfPJBybFEPGh4iiriJ6QOfNDiW5RKUJ9fII8J16wGGzjMD2NdqYlvb7uYoohwQjCPdbM4kmI7LKhgMU5gLL/7Z2Z+Rn34EPbNS0bCzBqVmJwfOss/USPtN7diTEJfEo+C9raIuotVggmbMr2Accm6RnUpOFeStRvM RNTOYGCi CbXpBVz6r2BhrOFe3ZONdLXrdEho7VFNxpnq1W+ltA7jb6cFDomG1ckdosRSLmNXgwBXxpEAxZCs/6OKRVm8wfyycMm7DPa+R+LBwuU44gu95KcqF/QlpJAdcopqGujfZrZ+8p6YqBRXYzCgPSKyzW+nX1/S9nYBHUycW2fDp1t5yq7T8KLF8MILgUEEKO/VgRGMG3bI6XODBO0/XtJGTkOyh/g== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Hyeongtak Ji This patch adds target_nid under /sys/kernel/mm/damon/admin/kdamonds//contexts//schemes// The 'target_nid' can be used as the destination node for DAMOS actions such as DAMOS_MIGRATE_{HOT,COLD} in the follow up patches. Signed-off-by: Hyeongtak Ji Signed-off-by: Honggyu Kim Signed-off-by: SeongJae Park --- include/linux/damon.h | 11 ++++++++++- mm/damon/core.c | 5 ++++- mm/damon/dbgfs.c | 2 +- mm/damon/lru_sort.c | 3 ++- mm/damon/reclaim.c | 3 ++- mm/damon/sysfs-schemes.c | 33 ++++++++++++++++++++++++++++++++- 6 files changed, 51 insertions(+), 6 deletions(-) diff --git a/include/linux/damon.h b/include/linux/damon.h index f7da65e1ac04..21d6b69a015c 100644 --- a/include/linux/damon.h +++ b/include/linux/damon.h @@ -374,6 +374,7 @@ struct damos_access_pattern { * @apply_interval_us: The time between applying the @action. * @quota: Control the aggressiveness of this scheme. * @wmarks: Watermarks for automated (in)activation of this scheme. + * @target_nid: Destination node if @action is "migrate_{hot,cold}". * @filters: Additional set of &struct damos_filter for &action. * @stat: Statistics of this scheme. * @list: List head for siblings. @@ -389,6 +390,10 @@ struct damos_access_pattern { * monitoring context are inactive, DAMON stops monitoring either, and just * repeatedly checks the watermarks. * + * @target_nid is used to set the migration target node for migrate_hot or + * migrate_cold actions, which means it's only meaningful when @action is either + * "migrate_hot" or "migrate_cold". + * * Before applying the &action to a memory region, &struct damon_operations * implementation could check pages of the region and skip &action to respect * &filters @@ -410,6 +415,9 @@ struct damos { /* public: */ struct damos_quota quota; struct damos_watermarks wmarks; + union { + int target_nid; + }; struct list_head filters; struct damos_stat stat; struct list_head list; @@ -726,7 +734,8 @@ struct damos *damon_new_scheme(struct damos_access_pattern *pattern, enum damos_action action, unsigned long apply_interval_us, struct damos_quota *quota, - struct damos_watermarks *wmarks); + struct damos_watermarks *wmarks, + int target_nid); void damon_add_scheme(struct damon_ctx *ctx, struct damos *s); void damon_destroy_scheme(struct damos *s); diff --git a/mm/damon/core.c b/mm/damon/core.c index 6392f1cc97a3..c0ec5be4f56e 100644 --- a/mm/damon/core.c +++ b/mm/damon/core.c @@ -354,7 +354,8 @@ struct damos *damon_new_scheme(struct damos_access_pattern *pattern, enum damos_action action, unsigned long apply_interval_us, struct damos_quota *quota, - struct damos_watermarks *wmarks) + struct damos_watermarks *wmarks, + int target_nid) { struct damos *scheme; @@ -381,6 +382,8 @@ struct damos *damon_new_scheme(struct damos_access_pattern *pattern, scheme->wmarks = *wmarks; scheme->wmarks.activated = true; + scheme->target_nid = target_nid; + return scheme; } diff --git a/mm/damon/dbgfs.c b/mm/damon/dbgfs.c index 2461cfe2e968..51a6f1cac385 100644 --- a/mm/damon/dbgfs.c +++ b/mm/damon/dbgfs.c @@ -281,7 +281,7 @@ static struct damos **str_to_schemes(const char *str, ssize_t len, pos += parsed; scheme = damon_new_scheme(&pattern, action, 0, "a, - &wmarks); + &wmarks, NUMA_NO_NODE); if (!scheme) goto fail; diff --git a/mm/damon/lru_sort.c b/mm/damon/lru_sort.c index 3de2916a65c3..3775f0f2743d 100644 --- a/mm/damon/lru_sort.c +++ b/mm/damon/lru_sort.c @@ -163,7 +163,8 @@ static struct damos *damon_lru_sort_new_scheme( /* under the quota. */ "a, /* (De)activate this according to the watermarks. */ - &damon_lru_sort_wmarks); + &damon_lru_sort_wmarks, + NUMA_NO_NODE); } /* Create a DAMON-based operation scheme for hot memory regions */ diff --git a/mm/damon/reclaim.c b/mm/damon/reclaim.c index 9bd341d62b4c..a05ccb41749b 100644 --- a/mm/damon/reclaim.c +++ b/mm/damon/reclaim.c @@ -177,7 +177,8 @@ static struct damos *damon_reclaim_new_scheme(void) /* under the quota. */ &damon_reclaim_quota, /* (De)activate this according to the watermarks. */ - &damon_reclaim_wmarks); + &damon_reclaim_wmarks, + NUMA_NO_NODE); } static void damon_reclaim_copy_quota_status(struct damos_quota *dst, diff --git a/mm/damon/sysfs-schemes.c b/mm/damon/sysfs-schemes.c index bea5bc52846a..0632d28b67f8 100644 --- a/mm/damon/sysfs-schemes.c +++ b/mm/damon/sysfs-schemes.c @@ -6,6 +6,7 @@ */ #include +#include #include "sysfs-common.h" @@ -1445,6 +1446,7 @@ struct damon_sysfs_scheme { struct damon_sysfs_scheme_filters *filters; struct damon_sysfs_stats *stats; struct damon_sysfs_scheme_regions *tried_regions; + int target_nid; }; /* This should match with enum damos_action */ @@ -1470,6 +1472,7 @@ static struct damon_sysfs_scheme *damon_sysfs_scheme_alloc( scheme->kobj = (struct kobject){}; scheme->action = action; scheme->apply_interval_us = apply_interval_us; + scheme->target_nid = NUMA_NO_NODE; return scheme; } @@ -1692,6 +1695,28 @@ static ssize_t apply_interval_us_store(struct kobject *kobj, return err ? err : count; } +static ssize_t target_nid_show(struct kobject *kobj, + struct kobj_attribute *attr, char *buf) +{ + struct damon_sysfs_scheme *scheme = container_of(kobj, + struct damon_sysfs_scheme, kobj); + + return sysfs_emit(buf, "%d\n", scheme->target_nid); +} + +static ssize_t target_nid_store(struct kobject *kobj, + struct kobj_attribute *attr, const char *buf, size_t count) +{ + struct damon_sysfs_scheme *scheme = container_of(kobj, + struct damon_sysfs_scheme, kobj); + int err = 0; + + /* TODO: error handling for target_nid range. */ + err = kstrtoint(buf, 0, &scheme->target_nid); + + return err ? err : count; +} + static void damon_sysfs_scheme_release(struct kobject *kobj) { kfree(container_of(kobj, struct damon_sysfs_scheme, kobj)); @@ -1703,9 +1728,13 @@ static struct kobj_attribute damon_sysfs_scheme_action_attr = static struct kobj_attribute damon_sysfs_scheme_apply_interval_us_attr = __ATTR_RW_MODE(apply_interval_us, 0600); +static struct kobj_attribute damon_sysfs_scheme_target_nid_attr = + __ATTR_RW_MODE(target_nid, 0600); + static struct attribute *damon_sysfs_scheme_attrs[] = { &damon_sysfs_scheme_action_attr.attr, &damon_sysfs_scheme_apply_interval_us_attr.attr, + &damon_sysfs_scheme_target_nid_attr.attr, NULL, }; ATTRIBUTE_GROUPS(damon_sysfs_scheme); @@ -2031,7 +2060,8 @@ static struct damos *damon_sysfs_mk_scheme( }; scheme = damon_new_scheme(&pattern, sysfs_scheme->action, - sysfs_scheme->apply_interval_us, "a, &wmarks); + sysfs_scheme->apply_interval_us, "a, &wmarks, + sysfs_scheme->target_nid); if (!scheme) return NULL; @@ -2068,6 +2098,7 @@ static void damon_sysfs_update_scheme(struct damos *scheme, scheme->action = sysfs_scheme->action; scheme->apply_interval_us = sysfs_scheme->apply_interval_us; + scheme->target_nid = sysfs_scheme->target_nid; scheme->quota.ms = sysfs_quotas->ms; scheme->quota.sz = sysfs_quotas->sz; From patchwork Thu Jun 13 13:17:35 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Honggyu Kim X-Patchwork-Id: 13696766 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7375BC27C4F for ; Thu, 13 Jun 2024 13:18:22 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 80C186B009A; Thu, 13 Jun 2024 09:18:16 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 76EFA6B009B; Thu, 13 Jun 2024 09:18:16 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5E69F6B009C; Thu, 13 Jun 2024 09:18:16 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 34C746B009B for ; Thu, 13 Jun 2024 09:18:16 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id D83D7121A43 for ; Thu, 13 Jun 2024 13:18:15 +0000 (UTC) X-FDA: 82225918950.16.88FC36A Received: from invmail4.hynix.com (exvmail4.skhynix.com [166.125.252.92]) by imf23.hostedemail.com (Postfix) with ESMTP id ABC8C140004 for ; Thu, 13 Jun 2024 13:18:13 +0000 (UTC) Authentication-Results: imf23.hostedemail.com; dkim=none; spf=pass (imf23.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1718284693; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Twkyo3ljIBjbS2/4ZLgfrWPOETcL3lQW8GhcvAO3s1o=; b=tu1C836gjJaoO1taIPo6Zy1qgXeMn8V4LVSfq3jNanCmXvWE829v7CltNLSeNcMluN45DU LyT5YfRNvDuDzJ545D/RpJ7bgapm/2iNBBQ/pIshGCCYtHotkzw5bTHJ+4UXxexKoF4f+R 9hJc2MPUtUwaRI/z+5DyD+Yjbxydv80= ARC-Authentication-Results: i=1; imf23.hostedemail.com; dkim=none; spf=pass (imf23.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1718284693; a=rsa-sha256; cv=none; b=wGAcYRm4AXrtRnMFtIDvvbXDjCHDmMQfzM+llVtCrU11fF+aZ+pOpQ9mwHIWGg0uuMkA9V UA0pFk90Uxe3D8CdAMHnd2hzEr3paLk11/eVG1/WpHuMf1orMn/+7gw0gSmXMCDbpuzD1a Sq5L8q0sXavLwSq7OMBxSBqZG4TN0+I= X-AuditID: a67dfc5b-d6dff70000001748-3a-666af18f9bbd From: Honggyu Kim To: SeongJae Park , damon@lists.linux.dev Cc: Andrew Morton , Masami Hiramatsu , Mathieu Desnoyers , Steven Rostedt , Gregory Price , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, 42.hyeyoo@gmail.com, art.jeongseob@gmail.com, kernel_team@skhynix.com, Honggyu Kim Subject: [PATCH 4/8] mm/migrate: add MR_DAMON to migrate_reason Date: Thu, 13 Jun 2024 22:17:35 +0900 Message-ID: <20240613131741.513-5-honggyu.kim@sk.com> X-Mailer: git-send-email 2.43.0.windows.1 In-Reply-To: <20240613131741.513-1-honggyu.kim@sk.com> References: <20240613131741.513-1-honggyu.kim@sk.com> MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFnrNLMWRmVeSWpSXmKPExsXC9ZZnkW7/x6w0g3UvxS0m9hhYzFm/hs3i /oPX7BZP/v9mtWhoesRicXnXHDaLe2v+s1ocWX+WxWLz2TPMFouXq1ns63jAZHH46xsmBx6P paffsHnsnHWX3aNl3y12j02rOtk8Nn2axO5xYsZvFo8Xm2cyemz8+J/d4/MmuQDOKC6blNSc zLLUIn27BK6M6U07mAsauCoaZixkbmBcx9HFyMkhIWAi8WXGTUYY++nyvewgNpuAmsSVl5OY uhg5OEQErCSm7YjtYuTiYBbYwCwx6dwLJpAaYQF7iQUHLzKD2CwCqhLvN60Am8MrYCox99Fs doiZmhKPt/8EszkFzCTWfbsPViMEVNPx/xkzRL2gxMmZT1hAbGYBeYnmrbOZQZZJCDxnk7j3 ZBozxCBJiYMrbrBMYOSfhaRnFpKeBYxMqxiFMvPKchMzc0z0MirzMiv0kvNzNzECo2BZ7Z/o HYyfLgQfYhTgYFTi4fV4lpUmxJpYVlyZe4hRgoNZSYR31kKgEG9KYmVValF+fFFpTmrxIUZp DhYlcV6jb+UpQgLpiSWp2ampBalFMFkmDk6pBsaK5Vw7li85IvLbel3Egpr0L3nRLMEet3qq z05I2rNQPXHm9/ccNsouk4RY3Vtq9531Y5j8uGF15sfpE///3eqYfYdh1cLQPccyN3vZVE3q NQouEm82V9HvE2dV3t0zy+rj3wOs/VtfiW1UX+G1/1rvvBmCV2b0hApe3Lrl9oHspc/S1A5c NIpVYinOSDTUYi4qTgQAAwjJXH4CAAA= X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrNLMWRmVeSWpSXmKPExsXCNUNLT7f/Y1aawetPbBYTewws5qxfw2Zx /8Frdosn/3+zWjQ0PWKx+PzsNbPF4bknWS0u75rDZnFvzX9WiyPrz7JYbD57htli8XI1i30d D5gsDn99w+TA57H09Bs2j52z7rJ7tOy7xe6xaVUnm8emT5PYPU7M+M3i8WLzTEaPjR//s3t8 u+3hsfjFByaPz5vkArijuGxSUnMyy1KL9O0SuDKmN+1gLmjgqmiYsZC5gXEdRxcjJ4eEgInE 0+V72UFsNgE1iSsvJzF1MXJwiAhYSUzbEdvFyMXBLLCBWWLSuRdMIDXCAvYSCw5eZAaxWQRU Jd5vWsEIYvMKmErMfTSbHWKmpsTj7T/BbE4BM4l13+6D1QgB1XT8f8YMUS8ocXLmExYQm1lA XqJ562zmCYw8s5CkZiFJLWBkWsUokplXlpuYmWOqV5ydUZmXWaGXnJ+7iREY5Mtq/0zcwfjl svshRgEORiUeXo9nWWlCrIllxZW5hxglOJiVRHhnLQQK8aYkVlalFuXHF5XmpBYfYpTmYFES 5/UKT00QEkhPLEnNTk0tSC2CyTJxcEo1MGb0F0Y3rGq+7HBaZTtb6e0Ni/wnXc+4+swjmWl7 0kSjZsHtTNFHZm9uCp2zofrEKZv3apdFF8arRP6zWSdj1DNhh8HZh21HsnLWm4SkufrmymSq pz+znrHu+cay8kvHa7eHfWueukSKm6GUIXSOyOUHpwxa463t3zi4vEyt3crTwHYi8XTvLSWW 4oxEQy3mouJEAILNfGxuAgAA X-CFilter-Loop: Reflected X-Stat-Signature: uu6rufm5txm9aw8qj8onk4qj3g4u5yqn X-Rspam-User: X-Rspamd-Queue-Id: ABC8C140004 X-Rspamd-Server: rspam02 X-HE-Tag: 1718284693-512920 X-HE-Meta: U2FsdGVkX18uAHYmjBcqhGj4ZtHh5ARQ/ogy+V/lJWdfSw7/SW6R5/GIRKcmB9zyOyADmfWF7/ZQUqKdqz1CQZu2qE/zYn2QFtVJp2LBnAnrxijhgZGXbDUycoAmH8C7FpreSiBRiB0sGavHlkjOfZ5viu0Wc67U+VlEJP+qw6IlC/y0OOl4coTZMPeowF1l2uVEGFEdzLKs/0jFIgfccFo/T6YNzfhDceuTOm+CxYSx4Qjsbh+3BVAMuLtFAHj3R/Pi3CbkdkGKS69O+QwINTRPHMYjFMWRPeKlexMEKUIZjam3GijzUONwRdZyEPU3mQlB4YyP34L9P7Wgf6UH2yH5knkHipYLxGpGP9XBQkm77THfso42DL/mfPclwLOZhr6+0LfKgBh/Xqe1AqXHMBnDwRp+AAuAbYJUU+XuOegOzosPvLy/CFD5GbJRaST49Y8nDrm88mzkV+rXJF9ECqP/IeOvBr2JnqCws9/OOdYohlW9gtuw8wzbMcD11WiihU1rS7CQzgoymWlj6I8tOlv8gFSETxYwQJhqm6N1CjqLG3icZFHsGSbr7F7srnevrObkxKFgXh7KXZSqYo9IZEFzkS3Y104Vc28elGdhTIq7xGAdWhQ8FHhpbIQ41Ff1X2idZfHXl5zYy8qAL5j4oDaI/GHupvUDMCtzLueh9tK43P54LBKOjXtbVrunDHcLnRzwMiYWLAlcWh+71YKRmQG/YAlsXouY+pzDA9WsTXYYbnDcxGhrjWGRBgSM76J5WAjLFnEHUSFmjSzncr0w5M/khdLRM3hRJqWLuyjQZCbPgvkN3QpYunpC0rwcQ75eqispNHT6qFxeA1vTtRB0dqMzwH1F3/Ls9pbTDPgcABFI2sHGF0MnbXnPHDoR+nwKoqC3V7jAJbqJRcTz9ugMFHVyoqMyoBwHAHV3Gua11slo3mY9Ud5zz3ypyWUpcrdFh9TWNfTeNraccFIGvVL aOVHL34z fcR9P2GcXGlZL/1sYjoCJc/mrGEyCuV3OWBI125poPOowx/TXrKFHZ2jZJjiRED0WFysRPSEqSXwIoU9vQUwVVQYw1lQXB9CTTzRD4JDyN95t6DvvYIgP274m4aMgh15Qd1wjg7PqwjRZU/SKqg3oTcpzefGmbQ4tYU4vkBHTEPJp40QIVFbGRexOJj8wYC78R98nckQa6Fi1gZs= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000001, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The current patch series introduces DAMON based migration across NUMA nodes so it'd be better to have a new migrate_reason in trace events. Signed-off-by: Honggyu Kim Reviewed-by: SeongJae Park Signed-off-by: SeongJae Park --- include/linux/migrate_mode.h | 1 + include/trace/events/migrate.h | 3 ++- 2 files changed, 3 insertions(+), 1 deletion(-) diff --git a/include/linux/migrate_mode.h b/include/linux/migrate_mode.h index f37cc03f9369..cec36b7e7ced 100644 --- a/include/linux/migrate_mode.h +++ b/include/linux/migrate_mode.h @@ -29,6 +29,7 @@ enum migrate_reason { MR_CONTIG_RANGE, MR_LONGTERM_PIN, MR_DEMOTION, + MR_DAMON, MR_TYPES }; diff --git a/include/trace/events/migrate.h b/include/trace/events/migrate.h index 0190ef725b43..cd01dd7b3640 100644 --- a/include/trace/events/migrate.h +++ b/include/trace/events/migrate.h @@ -22,7 +22,8 @@ EM( MR_NUMA_MISPLACED, "numa_misplaced") \ EM( MR_CONTIG_RANGE, "contig_range") \ EM( MR_LONGTERM_PIN, "longterm_pin") \ - EMe(MR_DEMOTION, "demotion") + EM( MR_DEMOTION, "demotion") \ + EMe(MR_DAMON, "damon") /* * First define the enums in the above macros to be exported to userspace From patchwork Thu Jun 13 13:17:36 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Honggyu Kim X-Patchwork-Id: 13696767 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7D7ABC27C4F for ; Thu, 13 Jun 2024 13:18:25 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id A59E66B009B; Thu, 13 Jun 2024 09:18:18 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id A04C76B009D; Thu, 13 Jun 2024 09:18:18 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 880CD6B009E; Thu, 13 Jun 2024 09:18:18 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 58F496B009B for ; Thu, 13 Jun 2024 09:18:18 -0400 (EDT) Received: from smtpin17.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id CAA3B1A19EA for ; Thu, 13 Jun 2024 13:18:17 +0000 (UTC) X-FDA: 82225919034.17.56674BD Received: from invmail4.hynix.com (exvmail4.hynix.com [166.125.252.92]) by imf28.hostedemail.com (Postfix) with ESMTP id C747AC001C for ; Thu, 13 Jun 2024 13:18:15 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=none; spf=pass (imf28.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1718284695; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nv1oWni34khPhdRw64DblZPBH5T/Fb3rcF3xoWmpT6k=; b=jzEwHiMmRgUVniKMfsZFLYX9PYGL929bK5nHdY3JVfP0k2og+DgMUx4rFGtNBSsOYsT2AT PI+yQhqIgG9OiWcHAdKJT1412PIETYGUhdjoVWRHCf1jT6mnMJquVtZvOwsMAotdX1JxnC y+4NNBhBXahW9eNIlyVEUygWuGHYKrE= ARC-Authentication-Results: i=1; imf28.hostedemail.com; dkim=none; spf=pass (imf28.hostedemail.com: domain of honggyu.kim@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=honggyu.kim@sk.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1718284695; a=rsa-sha256; cv=none; b=uPmG0exzKWBhUDK51jKKTLMXfwuJr4yL7Po0cpu8lWyH1vVNyfS1fu9jlkk2FIoaAnUY9V OrtwNO7iGGPTPyz0JCBu2G1g/wr/cbBrvq6jdGsUelP5M3hT1WpbyqzEr8MAsO/Vzg4X+Q wsllZyZFGA1hAol/np+XmMv+vbjx17A= X-AuditID: a67dfc5b-d6dff70000001748-40-666af1901b75 From: Honggyu Kim To: SeongJae Park , damon@lists.linux.dev Cc: Andrew Morton , Masami Hiramatsu , Mathieu Desnoyers , Steven Rostedt , Gregory Price , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, 42.hyeyoo@gmail.com, art.jeongseob@gmail.com, kernel_team@skhynix.com, Honggyu Kim , Hyeongtak Ji Subject: [PATCH 5/8] mm/damon/paddr: introduce DAMOS_MIGRATE_COLD action for demotion Date: Thu, 13 Jun 2024 22:17:36 +0900 Message-ID: <20240613131741.513-6-honggyu.kim@sk.com> X-Mailer: git-send-email 2.43.0.windows.1 In-Reply-To: <20240613131741.513-1-honggyu.kim@sk.com> References: <20240613131741.513-1-honggyu.kim@sk.com> MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFnrBLMWRmVeSWpSXmKPExsXC9ZZnke6Ej1lpBjdW8llM7DGwmLN+DZvF /Qev2S2e/P/NatHQ9IjF4vKuOWwW99b8Z7U4sv4si8Xms2eYLRYvV7PY1/GAyeLw1zdMDjwe S0+/YfPYOesuu0fLvlvsHptWdbJ5bPo0id3jxIzfLB4vNs9k9Nj48T+7x+dNcgGcUVw2Kak5 mWWpRfp2CVwZ7w8/ZSnYZF2x9vdq9gbGpQZdjJwcEgImEtsOnWTuYuQAs+9c0wAJswmoSVx5 OYkJJCwiYCUxbUdsFyMXB7PANWaJ5c2LwOLCAqESLcscQMpZBFQl/vSdZAWxeQVMJWa132KD mK4p8Xj7T3YQm1PATGLdt/uMILYQUE3H/2fMEPWCEidnPmEBsZkF5CWat85mhuj9zCbxcqYW hC0pcXDFDZYJjPyzkLTMQtKygJFpFaNQZl5ZbmJmjoleRmVeZoVecn7uJkZg+C+r/RO9g/HT heBDjAIcjEo8vB7PstKEWBPLiitzDzFKcDArifDOWggU4k1JrKxKLcqPLyrNSS0+xCjNwaIk zmv0rTxFSCA9sSQ1OzW1ILUIJsvEwSnVwMjld5Jhq76pcr32hJn12xYavfu4Jf15bvCpuf73 f6xT/9w3tWOd6Cqv/FPr+5fciy+yeG0srHcxyD/qkMLX6aeLrgtbML9cMNkmq9vN5prZO9HP OxgNZ0vf641wmrLLqUi3q2eBxvvsa9W7XaQ0qu5LnPi/w+WJ6ZFQn+tC7B8yXDSfZRR+/KnE UpyRaKjFXFScCACWyrSaewIAAA== X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrHLMWRmVeSWpSXmKPExsXCNUNLT3fCx6w0g2P3mS0m9hhYzFm/hs3i /oPX7BZP/v9mtWhoesRi8fnZa2aLziffGS0Ozz3JanF51xw2i3tr/rNaHFl/lsVi89kzzBaL l6tZ7Ot4wGRx+OsbJgd+j6Wn37B57Jx1l92jZd8tdo9NqzrZPDZ9msTucWLGbxaPF5tnMnps /Pif3ePbbQ+PxS8+MHl83iQXwB3FZZOSmpNZllqkb5fAlfH+8FOWgk3WFWt/r2ZvYFxq0MXI wSEhYCJx55pGFyMnB5uAmsSVl5OYQMIiAlYS03bEdjFycTALXGOWWN68CCwuLBAq0bLMAaSc RUBV4k/fSVYQm1fAVGJW+y02EFtCQFPi8faf7CA2p4CZxLpv9xlBbCGgmo7/z5gh6gUlTs58 wgJiMwvISzRvnc08gZFnFpLULCSpBYxMqxhFMvPKchMzc0z1irMzKvMyK/SS83M3MQJDfVnt n4k7GL9cdj/EKMDBqMTD6/EsK02INbGsuDL3EKMEB7OSCO+shUAh3pTEyqrUovz4otKc1OJD jNIcLErivF7hqQlCAumJJanZqakFqUUwWSYOTqkGRp6wL2+DGuM2la101t3DMlG0L7RqV9u0 ZRJT7ngJBO573TYh/s45q30vYn57zQ71/rBJK00j5c2z+RsT3hxPUcjeu/WQY8df1fUiF3z6 /r9Y28Pi+KvowL9VPV6NSnMf3pmw6NQb3dk1R5Yd1J3iuH6iEBejdfLVLe82ts3fvbT024s/ K12zezWVWIozEg21mIuKEwGItZOkcQIAAA== X-CFilter-Loop: Reflected X-Rspamd-Server: rspam03 X-Rspam-User: X-Rspamd-Queue-Id: C747AC001C X-Stat-Signature: 3j8778pjkig99wzqmw1rinxd9hftoyma X-HE-Tag: 1718284695-686499 X-HE-Meta: U2FsdGVkX18dj4bJwSJo256QN48Tpvc2kIGkgeYT4joL6d2x9cDLiqeSYT60gY5hBNk+8JqLtxczhxCDa39wX5Jxf7rkKHWlx5PHGZPr5A178MQdPvxPHhWQfdjMMQt5r6rq7t/s/F8N37ebJ3eqPxVx1NybyHjDtN1exV5yOQ9wRcTD7l8oSswyPW5mH9STCqQaRKC+0OqBG+wnUHVtAY0QTNEeMEvmrKr6LCt5LV5KuQSuEMm6EKBxIr0qx0/U7bFknvejPhSmVMCwHh+7lqeOvnKdwTm30l9hLHhbg5KVSkmKH5f2DTWXi4k/QbrnRfQlytaM2kUyWhONWhSVjnfRVE5qoBrUI8B/TLT/4WMiwyvR21DwzYRMoJD0qS3jLTcMDw5okunksz5sPk8e6DmMyi7G+gjczqXoFHlW8Bcmmz3yO9j4FuodKJwTN8Y09qzzNz1a+zed/DhQ8otxqGM7zqUaOmw79ng0+40pLGv+Dnfe9f+S2ClmVH2xktg66B6Z1jNjmMs2jLzAqBGjD7Io8TtTvmTkVpWQw6LOD/78zpW7zYCxCue0Mhlk37VDZdDkZrH5WpwHCwTbjuw+BAh3iik8+n3E2xrEGtEw/IE8j4XCBl3EzcuqpVIZDM9ScxsKKKy/2dtywX8knC+IuuNfT7uja6n0vsImkIBCu/1jDd46l8oUwWpPwb4e5L4ZXknJdm3IeHFzo7K3XS9x8s6X50YmPypRj6bG1YB4DorR0O8/5v7vriWrKBcIBc5NHNAkOQkKsPb4lEARSuCxUKs0Xg7Gz3AtYQP33gDQOuwCU9CYTnADRa0eXmuiAvN851B4kXRTFDGnwkGSyHMsOhbFK57OcIZqthiKKTgurGVYLmHQ7FtuCR3jSNz6zTWBwsdSSeF+42+GlPKwmZkf433q8Z1LL5rty91v620UQgMSIKfT87x6vTOg+BAw3PHE6ajabhce9mqahvMGwHH qZvwzQXH RNDzZ/gWq09GFkT0YCgx1K13JcaM7SYQfo4U4ZpaW3PHBwUt/F8rEIasbCrL5usgs648Bw5Y2bxd60wT6ziFm+gAWuGfesKB0hzyaQwEmCP7PafiyCXpcGMIW3Fes8YrO5++vF3vu3bbwJKOC/K6oB086RwkxJbwDCmj9l+NT8Uq4LT5ZXkYmpvSJHoJJ2ijiDb/Hpx/VXufHwblGH71+AQ6OqA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: This patch introduces DAMOS_MIGRATE_COLD action, which is similar to DAMOS_PAGEOUT, but migrate folios to the given 'target_nid' in the sysfs instead of swapping them out. The 'target_nid' sysfs knob informs the migration target node ID. Here is one of the example usage of this 'migrate_cold' action. $ cd /sys/kernel/mm/damon/admin/kdamonds/ $ cat contexts//schemes//action migrate_cold $ echo 2 > contexts//schemes//target_nid $ echo commit > state $ numactl -p 0 ./hot_cold 500M 600M & $ numastat -c -p hot_cold Per-node process memory usage (in MBs) PID Node 0 Node 1 Node 2 Total -------------- ------ ------ ------ ----- 701 (hot_cold) 501 0 601 1101 Since there are some common routines with pageout, many functions have similar logics between pageout and migrate cold. damon_pa_migrate_folio_list() is a minimized version of shrink_folio_list(). Signed-off-by: Honggyu Kim Signed-off-by: Hyeongtak Ji Signed-off-by: SeongJae Park --- include/linux/damon.h | 2 + mm/damon/paddr.c | 154 +++++++++++++++++++++++++++++++++++++++ mm/damon/sysfs-schemes.c | 1 + 3 files changed, 157 insertions(+) diff --git a/include/linux/damon.h b/include/linux/damon.h index 21d6b69a015c..56714b6eb0d7 100644 --- a/include/linux/damon.h +++ b/include/linux/damon.h @@ -105,6 +105,7 @@ struct damon_target { * @DAMOS_NOHUGEPAGE: Call ``madvise()`` for the region with MADV_NOHUGEPAGE. * @DAMOS_LRU_PRIO: Prioritize the region on its LRU lists. * @DAMOS_LRU_DEPRIO: Deprioritize the region on its LRU lists. + * @DAMOS_MIGRATE_COLD: Migrate the regions prioritizing colder regions. * @DAMOS_STAT: Do nothing but count the stat. * @NR_DAMOS_ACTIONS: Total number of DAMOS actions * @@ -122,6 +123,7 @@ enum damos_action { DAMOS_NOHUGEPAGE, DAMOS_LRU_PRIO, DAMOS_LRU_DEPRIO, + DAMOS_MIGRATE_COLD, DAMOS_STAT, /* Do nothing but only record the stat */ NR_DAMOS_ACTIONS, }; diff --git a/mm/damon/paddr.c b/mm/damon/paddr.c index 18797c1b419b..882ae54af829 100644 --- a/mm/damon/paddr.c +++ b/mm/damon/paddr.c @@ -12,6 +12,9 @@ #include #include #include +#include +#include +#include #include "../internal.h" #include "ops-common.h" @@ -325,6 +328,153 @@ static unsigned long damon_pa_deactivate_pages(struct damon_region *r, return damon_pa_mark_accessed_or_deactivate(r, s, false); } +static unsigned int __damon_pa_migrate_folio_list( + struct list_head *migrate_folios, struct pglist_data *pgdat, + int target_nid) +{ + unsigned int nr_succeeded; + nodemask_t allowed_mask = NODE_MASK_NONE; + struct migration_target_control mtc = { + /* + * Allocate from 'node', or fail quickly and quietly. + * When this happens, 'page' will likely just be discarded + * instead of migrated. + */ + .gfp_mask = (GFP_HIGHUSER_MOVABLE & ~__GFP_RECLAIM) | + __GFP_NOWARN | __GFP_NOMEMALLOC | GFP_NOWAIT, + .nid = target_nid, + .nmask = &allowed_mask + }; + + if (pgdat->node_id == target_nid || target_nid == NUMA_NO_NODE) + return 0; + + if (list_empty(migrate_folios)) + return 0; + + /* Migration ignores all cpuset and mempolicy settings */ + migrate_pages(migrate_folios, alloc_migrate_folio, NULL, + (unsigned long)&mtc, MIGRATE_ASYNC, MR_DAMON, + &nr_succeeded); + + return nr_succeeded; +} + +static unsigned int damon_pa_migrate_folio_list(struct list_head *folio_list, + struct pglist_data *pgdat, + int target_nid) +{ + unsigned int nr_migrated = 0; + struct folio *folio; + LIST_HEAD(ret_folios); + LIST_HEAD(migrate_folios); + + while (!list_empty(folio_list)) { + struct folio *folio; + + cond_resched(); + + folio = lru_to_folio(folio_list); + list_del(&folio->lru); + + if (!folio_trylock(folio)) + goto keep; + + /* Relocate its contents to another node. */ + list_add(&folio->lru, &migrate_folios); + folio_unlock(folio); + continue; +keep: + list_add(&folio->lru, &ret_folios); + } + /* 'folio_list' is always empty here */ + + /* Migrate folios selected for migration */ + nr_migrated += __damon_pa_migrate_folio_list( + &migrate_folios, pgdat, target_nid); + /* + * Folios that could not be migrated are still in @migrate_folios. Add + * those back on @folio_list + */ + if (!list_empty(&migrate_folios)) + list_splice_init(&migrate_folios, folio_list); + + try_to_unmap_flush(); + + list_splice(&ret_folios, folio_list); + + while (!list_empty(folio_list)) { + folio = lru_to_folio(folio_list); + list_del(&folio->lru); + folio_putback_lru(folio); + } + + return nr_migrated; +} + +static unsigned long damon_pa_migrate_pages(struct list_head *folio_list, + int target_nid) +{ + int nid; + unsigned long nr_migrated = 0; + LIST_HEAD(node_folio_list); + unsigned int noreclaim_flag; + + if (list_empty(folio_list)) + return nr_migrated; + + noreclaim_flag = memalloc_noreclaim_save(); + + nid = folio_nid(lru_to_folio(folio_list)); + do { + struct folio *folio = lru_to_folio(folio_list); + + if (nid == folio_nid(folio)) { + list_move(&folio->lru, &node_folio_list); + continue; + } + + nr_migrated += damon_pa_migrate_folio_list(&node_folio_list, + NODE_DATA(nid), + target_nid); + nid = folio_nid(lru_to_folio(folio_list)); + } while (!list_empty(folio_list)); + + nr_migrated += damon_pa_migrate_folio_list(&node_folio_list, + NODE_DATA(nid), + target_nid); + + memalloc_noreclaim_restore(noreclaim_flag); + + return nr_migrated; +} + +static unsigned long damon_pa_migrate(struct damon_region *r, struct damos *s) +{ + unsigned long addr, applied; + LIST_HEAD(folio_list); + + for (addr = r->ar.start; addr < r->ar.end; addr += PAGE_SIZE) { + struct folio *folio = damon_get_folio(PHYS_PFN(addr)); + + if (!folio) + continue; + + if (damos_pa_filter_out(s, folio)) + goto put_folio; + + if (!folio_isolate_lru(folio)) + goto put_folio; + list_add(&folio->lru, &folio_list); +put_folio: + folio_put(folio); + } + applied = damon_pa_migrate_pages(&folio_list, s->target_nid); + cond_resched(); + return applied * PAGE_SIZE; +} + + static unsigned long damon_pa_apply_scheme(struct damon_ctx *ctx, struct damon_target *t, struct damon_region *r, struct damos *scheme) @@ -336,6 +486,8 @@ static unsigned long damon_pa_apply_scheme(struct damon_ctx *ctx, return damon_pa_mark_accessed(r, scheme); case DAMOS_LRU_DEPRIO: return damon_pa_deactivate_pages(r, scheme); + case DAMOS_MIGRATE_COLD: + return damon_pa_migrate(r, scheme); case DAMOS_STAT: break; default: @@ -356,6 +508,8 @@ static int damon_pa_scheme_score(struct damon_ctx *context, return damon_hot_score(context, r, scheme); case DAMOS_LRU_DEPRIO: return damon_cold_score(context, r, scheme); + case DAMOS_MIGRATE_COLD: + return damon_cold_score(context, r, scheme); default: break; } diff --git a/mm/damon/sysfs-schemes.c b/mm/damon/sysfs-schemes.c index 0632d28b67f8..880015d5b5ea 100644 --- a/mm/damon/sysfs-schemes.c +++ b/mm/damon/sysfs-schemes.c @@ -1458,6 +1458,7 @@ static const char * const damon_sysfs_damos_action_strs[] = { "nohugepage", "lru_prio", "lru_deprio", + "migrate_cold", "stat", };