From patchwork Thu Dec 5 04:00:25 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yang Shi X-Patchwork-Id: 11274161 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id C9935139A for ; Thu, 5 Dec 2019 04:00:38 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 9325E21823 for ; Thu, 5 Dec 2019 04:00:38 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9325E21823 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.alibaba.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id B1F356B0E41; Wed, 4 Dec 2019 23:00:37 -0500 (EST) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id AD01C6B0E42; Wed, 4 Dec 2019 23:00:37 -0500 (EST) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 9E6BC6B0E43; Wed, 4 Dec 2019 23:00:37 -0500 (EST) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0032.hostedemail.com [216.40.44.32]) by kanga.kvack.org (Postfix) with ESMTP id 883926B0E41 for ; Wed, 4 Dec 2019 23:00:37 -0500 (EST) Received: from smtpin28.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with SMTP id 23A3F181AEF3C for ; Thu, 5 Dec 2019 04:00:37 +0000 (UTC) X-FDA: 76229736114.28.birth32_3f762aba00623 X-Spam-Summary: 2,0,0,db384726b6bee78a,d41d8cd98f00b204,yang.shi@linux.alibaba.com,:fabecassis@nvidia.com:jhubbard@nvidia.com:mhocko@suse.com:cl@linux.com:vbabka@suse.cz:mgorman@techsingularity.net:akpm@linux-foundation.org:yang.shi@linux.alibaba.com::linux-kernel@vger.kernel.org:stable@vger.kernel.org,RULES_HIT:2:41:355:379:541:800:960:973:988:989:1260:1261:1345:1437:1535:1606:1730:1747:1777:1792:2198:2199:2393:2553:2559:2562:2731:2895:2898:2909:3138:3139:3140:3141:3142:3355:3865:3867:3868:3870:3871:3872:4117:4250:4321:4605:5007:6261:7875:7903:8660:10004:11026:11232:11473:11658:11914:12043:12048:12291:12295:12296:12297:12438:12555:12663:12679:12683:12895:13148:13153:13161:13215:13221:13228:13229:13230:13255:14096:14394:21060:21080:21451:21627:21740:30003:30012:30016:30046:30051:30054:30064:30070:30080:30090,0,RBL:115.124.30.133:@linux.alibaba.com:.lbl8.mailshell.net-62.20.2.100 64.201.201.201,CacheIP:none,Bayesian:0.5,0.5,0.5,Netcheck:none,DomainCache:0,MSF:not bulk,SPF:fp,M SBL:0,DN X-HE-Tag: birth32_3f762aba00623 X-Filterd-Recvd-Size: 6645 Received: from out30-133.freemail.mail.aliyun.com (out30-133.freemail.mail.aliyun.com [115.124.30.133]) by imf39.hostedemail.com (Postfix) with ESMTP for ; Thu, 5 Dec 2019 04:00:35 +0000 (UTC) X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R111e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e04423;MF=yang.shi@linux.alibaba.com;NM=1;PH=DS;RN=11;SR=0;TI=SMTPD_---0Tk0Tvpk_1575518425; Received: from e19h19392.et15sqa.tbsite.net(mailfrom:yang.shi@linux.alibaba.com fp:SMTPD_---0Tk0Tvpk_1575518425) by smtp.aliyun-inc.com(127.0.0.1); Thu, 05 Dec 2019 12:00:32 +0800 From: Yang Shi To: fabecassis@nvidia.com, jhubbard@nvidia.com, mhocko@suse.com, cl@linux.com, vbabka@suse.cz, mgorman@techsingularity.net, akpm@linux-foundation.org Cc: yang.shi@linux.alibaba.com, linux-mm@kvack.org, linux-kernel@vger.kernel.org, stable@vger.kernel.org Subject: [PATCH] mm: move_pages: return valid node id in status if the page is already on the target node Date: Thu, 5 Dec 2019 12:00:25 +0800 Message-Id: <1575518425-58788-1-git-send-email-yang.shi@linux.alibaba.com> X-Mailer: git-send-email 1.8.3.1 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Felix Abecassis reports move_pages() would return random status if the pages are already on the target node by the below test program: ---8<--- int main(void) { const long node_id = 1; const long page_size = sysconf(_SC_PAGESIZE); const int64_t num_pages = 8; unsigned long nodemask = 1 << node_id; long ret = set_mempolicy(MPOL_BIND, &nodemask, sizeof(nodemask)); if (ret < 0) return (EXIT_FAILURE); void **pages = malloc(sizeof(void*) * num_pages); for (int i = 0; i < num_pages; ++i) { pages[i] = mmap(NULL, page_size, PROT_WRITE | PROT_READ, MAP_PRIVATE | MAP_POPULATE | MAP_ANONYMOUS, -1, 0); if (pages[i] == MAP_FAILED) return (EXIT_FAILURE); } ret = set_mempolicy(MPOL_DEFAULT, NULL, 0); if (ret < 0) return (EXIT_FAILURE); int *nodes = malloc(sizeof(int) * num_pages); int *status = malloc(sizeof(int) * num_pages); for (int i = 0; i < num_pages; ++i) { nodes[i] = node_id; status[i] = 0xd0; /* simulate garbage values */ } ret = move_pages(0, num_pages, pages, nodes, status, MPOL_MF_MOVE); printf("move_pages: %ld\n", ret); for (int i = 0; i < num_pages; ++i) printf("status[%d] = %d\n", i, status[i]); } ---8<--- Then running the program would return nonsense status values: $ ./move_pages_bug move_pages: 0 status[0] = 208 status[1] = 208 status[2] = 208 status[3] = 208 status[4] = 208 status[5] = 208 status[6] = 208 status[7] = 208 This is because the status is not set if the page is already on the target node, but move_pages() should return valid status as long as it succeeds. The valid status may be errno or node id. We can't simply initialize status array to zero since the pages may be not on node 0. Fix it by updating status with node id which the page is already on. And, it looks we have to update the status inside add_page_for_migration() since the page struct is not available outside it. Make add_page_for_migration() return 1 if store_status() is failed in order to not mix up the status value since -EFAULT is also a valid status. Fixes: a49bd4d71637 ("mm, numa: rework do_pages_move") Reported-by: Felix Abecassis Tested-by: Felix Abecassis Cc: John Hubbard Cc: Michal Hocko Cc: Christoph Lameter Cc: Vlastimil Babka Cc: Mel Gorman Cc: 4.17+ Signed-off-by: Yang Shi --- John found another return value inconsistency between the implementation and the manpage. The manpage says it should return -ENOENT if the page is already on the target node, but it doesn't. It looks the original code didn't return -ENOENT either, I'm not sure if this is a document issue or not. Anyway this is another issue, once we confirm it we can fix it later. mm/migrate.c | 34 ++++++++++++++++++++++++++++------ 1 file changed, 28 insertions(+), 6 deletions(-) diff --git a/mm/migrate.c b/mm/migrate.c index a8f87cb..c427bb2 100644 --- a/mm/migrate.c +++ b/mm/migrate.c @@ -1512,17 +1512,21 @@ static int do_move_pages_to_node(struct mm_struct *mm, /* * Resolves the given address to a struct page, isolates it from the LRU and * puts it to the given pagelist. - * Returns -errno if the page cannot be found/isolated or 0 when it has been - * queued or the page doesn't need to be migrated because it is already on - * the target node + * Returns: + * errno - if the page cannot be found/isolated + * 0 - when it has been queued or the page doesn't need to be migrated + * because it is already on the target node + * 1 - if store_status() is failed */ static int add_page_for_migration(struct mm_struct *mm, unsigned long addr, - int node, struct list_head *pagelist, bool migrate_all) + int node, struct list_head *pagelist, bool migrate_all, + int __user *status, int start) { struct vm_area_struct *vma; struct page *page; unsigned int follflags; int err; + bool same_node = false; down_read(&mm->mmap_sem); err = -EFAULT; @@ -1543,8 +1547,10 @@ static int add_page_for_migration(struct mm_struct *mm, unsigned long addr, goto out; err = 0; - if (page_to_nid(page) == node) + if (page_to_nid(page) == node) { + same_node = true; goto out_putpage; + } err = -EACCES; if (page_mapcount(page) > 1 && !migrate_all) @@ -1578,6 +1584,16 @@ static int add_page_for_migration(struct mm_struct *mm, unsigned long addr, put_page(page); out: up_read(&mm->mmap_sem); + + /* + * Must call store_status() after releasing mmap_sem since put_user + * need acquire mmap_sem too, otherwise potential deadlock may exist. + */ + if (same_node) { + if (store_status(status, start, node, 1)) + err = 1; + } + return err; } @@ -1639,10 +1655,16 @@ static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, * report them via status */ err = add_page_for_migration(mm, addr, current_node, - &pagelist, flags & MPOL_MF_MOVE_ALL); + &pagelist, flags & MPOL_MF_MOVE_ALL, status, + i); + if (!err) continue; + /* store_status() failed in add_page_for_migration() */ + if (err > 0) + goto out_flush; + err = store_status(status, i, err, 1); if (err) goto out_flush;