From patchwork Tue Nov 6 06:03:13 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Arun KS X-Patchwork-Id: 10669675 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 150B115A6 for ; Tue, 6 Nov 2018 06:03:38 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id E914D28DB7 for ; Tue, 6 Nov 2018 06:03:37 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id DAE3629196; Tue, 6 Nov 2018 06:03:37 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 16D4228DB7 for ; Tue, 6 Nov 2018 06:03:36 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D24316B02BA; Tue, 6 Nov 2018 01:03:35 -0500 (EST) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id CD3CF6B02BC; Tue, 6 Nov 2018 01:03:35 -0500 (EST) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BC1656B02BD; Tue, 6 Nov 2018 01:03:35 -0500 (EST) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-pf1-f198.google.com (mail-pf1-f198.google.com [209.85.210.198]) by kanga.kvack.org (Postfix) with ESMTP id 7ADAB6B02BA for ; Tue, 6 Nov 2018 01:03:35 -0500 (EST) Received: by mail-pf1-f198.google.com with SMTP id i81-v6so11687749pfj.1 for ; Mon, 05 Nov 2018 22:03:35 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-original-authentication-results:x-gm-message-state:from:to:cc :subject:date:message-id; bh=RPUzX8Dh7+TvgTXoUwarppk9LOW4PCu6OnlXBX3EleE=; b=QjTGxYVJ2q1io8rpx/GTmGhCcV1VNJP3uM2xphc0HpGhjA41tdV+RBCZ+JV6XBQtPb GIjPs+2yT8Mt/yGD91iZ3vGNBRfjARXXGbC/LscBUvtzG3fhUBWSpgWBHDzr0MRTvu/m nE7O9EFtVnpTkO5l6/39mMTHJYp4NqKfI8f0rkJPGoEqN9GPYwz3FcIdfSrQB3T7lmFy pHWnIpxYgAtgsYYcj23b0IynCS80uMEDtAMcm6ph5K8MVM7EmukDsZvvhEn4dJ/rhYyT HZjZfJKd4e5jfre1la5ehKmtfzw374Fy7Czy09VTAOeo/nRuD7hflDZ/meUl0bAwZlHr 08Lw== X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: domain of arunks@qualcomm.com designates 103.229.18.197 as permitted sender) smtp.mailfrom=arunks@qualcomm.com X-Gm-Message-State: AGRZ1gLC9tgmtKlYAYCUipVZUr1ioqsmQAfkZMIWSs4x91AKerwI5wWP UN6mNUE6WaNfhAu+UGcH6/P5ghBc1tmKTjRFuX2Fg1qtoAtvORedsx/9o3hyCWjoyxHX0PysvVk K83g/hAXMk8YihPuwUXRJteetOX1B0Q1rJ4m1U/pEXGP3O4lMMNqE/2lYGmte2wU= X-Received: by 2002:a17:902:8bc6:: with SMTP id r6-v6mr10760850plo.194.1541484215114; Mon, 05 Nov 2018 22:03:35 -0800 (PST) X-Google-Smtp-Source: AJdET5e2HxaljegC7eUv1KY9Bi/5Rj57X4ycZiA1NEVWsgbeg8+ci0YZfVsH/mJ+0NfM99XBxASK X-Received: by 2002:a17:902:8bc6:: with SMTP id r6-v6mr10760791plo.194.1541484214041; Mon, 05 Nov 2018 22:03:34 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1541484213; cv=none; d=google.com; s=arc-20160816; b=xHDREBSXdNHh904a+Fjkq7Fj3wYaVRlnQdhR2XkBo/WDwjyS1vIkzBZ9W8pYvspAv+ ullBrQHW/l8BDZngNMZG25ESXLFRE5cOkAb5zfxmmBecxc6sIMOBM0Dadk1uFtMAW59S 9FFPCwtQWRiYPpGW371iL6BsdbaA9TF2IXuqXTAHAsiMokAxdHgxCYzX1PEshXQIPYvV wsfXeYqsLvLDm4WJsyNbH4eEUPw/H0yMkFAtb4+7ncs+RNYG2XfAxcZyql39Su3lrinW uM97w3QfX+KJO+3PqlozUc0nD5KND8zHYSf19Q9Qjdv+fp66EjwR8xy/aB9hZMIxTNiy Lz2Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=message-id:date:subject:cc:to:from; bh=RPUzX8Dh7+TvgTXoUwarppk9LOW4PCu6OnlXBX3EleE=; b=eXKqC+JFd+Wv0jmBRUFutDU6aAv4r347FyZ9yu/raIGlxVcRinKAU8eoELsps/LKo2 aqug3NrghxBL+T7NeKBEeMgQXMCaZZDHFim6oyXzFpHvYBUaSda4+8Ic1435lJCOmvUs qoKFn5GGw9aO5YY+tkF6TG3RoVgsH73Clv5Aernk66KN5la8o9a88xn2EyiLYQGBXi2e whWOVu7yxMAVmxMqaVFJ8I8TT06drZjkcJ6q7zPowvHS6vwHoKiFvXlMPUrRpDIqqRGE +rIjcnWe0E0ecyJzz/hCF3B9Kt1wveYqgpzNZhvL7YP+LcZQeZuhI0SlLrYKz0iGeIGc ZVLg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of arunks@qualcomm.com designates 103.229.18.197 as permitted sender) smtp.mailfrom=arunks@qualcomm.com Received: from alexa-out-blr-01.qualcomm.com (alexa-out-blr-01.qualcomm.com. [103.229.18.197]) by mx.google.com with ESMTPS id y27si11829553pga.459.2018.11.05.22.03.33 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 05 Nov 2018 22:03:33 -0800 (PST) Received-SPF: pass (google.com: domain of arunks@qualcomm.com designates 103.229.18.197 as permitted sender) client-ip=103.229.18.197; Authentication-Results: mx.google.com; spf=pass (google.com: domain of arunks@qualcomm.com designates 103.229.18.197 as permitted sender) smtp.mailfrom=arunks@qualcomm.com X-IronPort-AV: E=Sophos;i="5.54,470,1534789800"; d="scan'208";a="276566" Received: from ironmsg01-blr.qualcomm.com ([10.86.208.130]) by alexa-out-blr-01.qualcomm.com with ESMTP/TLS/AES256-SHA; 06 Nov 2018 11:33:31 +0530 X-IronPort-AV: E=McAfee;i="5900,7806,9068"; a="5671282" Received: from blr-ubuntu-104.ap.qualcomm.com (HELO blr-ubuntu-104.qualcomm.com) ([10.79.40.64]) by ironmsg01-blr.qualcomm.com with ESMTP; 06 Nov 2018 11:33:30 +0530 Received: by blr-ubuntu-104.qualcomm.com (Postfix, from userid 346745) id 1FC3031C6; Tue, 6 Nov 2018 11:33:30 +0530 (IST) From: Arun KS To: arunks.linux@gmail.com, akpm@linux-foundation.org, mhocko@kernel.org, vbabka@suse.cz, osalvador@suse.de, linux-kernel@vger.kernel.org, linux-mm@kvack.org Cc: getarunks@gmail.com, Arun KS Subject: [PATCH v6 1/2] memory_hotplug: Free pages as higher order Date: Tue, 6 Nov 2018 11:33:13 +0530 Message-Id: <1541484194-1493-1-git-send-email-arunks@codeaurora.org> X-Mailer: git-send-email 1.9.1 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP When free pages are done with higher order, time spend on coalescing pages by buddy allocator can be reduced. With section size of 256MB, hot add latency of a single section shows improvement from 50-60 ms to less than 1 ms, hence improving the hot add latency by 60%. Modify external providers of online callback to align with the change. This patch modifies totalram_pages, zone->managed_pages and totalhigh_pages outside managed_page_count_lock. A follow up series will be send to convert these variable to atomic to avoid readers potentially seeing a store tear. Signed-off-by: Arun KS --- Changes since v5: - Rebased to 4.20-rc1. - Changelog updated. Changes since v4: - As suggested by Michal Hocko, - Simplify logic in online_pages_block() by using get_order(). - Seperate out removal of prefetch from __free_pages_core(). Changes since v3: - Renamed _free_pages_boot_core -> __free_pages_core. - Removed prefetch from __free_pages_core. - Removed xen_online_page(). Changes since v2: - Reuse code from __free_pages_boot_core(). Changes since v1: - Removed prefetch(). Changes since RFC: - Rebase. - As suggested by Michal Hocko remove pages_per_block. - Modifed external providers of online_page_callback. v5: https://lore.kernel.org/patchwork/patch/995739/ v4: https://lore.kernel.org/patchwork/patch/995111/ v3: https://lore.kernel.org/patchwork/patch/992348/ v2: https://lore.kernel.org/patchwork/patch/991363/ v1: https://lore.kernel.org/patchwork/patch/989445/ RFC: https://lore.kernel.org/patchwork/patch/984754/ --- Signed-off-by: Arun KS --- drivers/hv/hv_balloon.c | 6 ++++-- drivers/xen/balloon.c | 23 +++++++++++++++-------- include/linux/memory_hotplug.h | 2 +- mm/internal.h | 1 + mm/memory_hotplug.c | 42 ++++++++++++++++++++++++++++++------------ mm/page_alloc.c | 8 ++++---- 6 files changed, 55 insertions(+), 27 deletions(-) diff --git a/drivers/hv/hv_balloon.c b/drivers/hv/hv_balloon.c index 4163151..5728dc4 100644 --- a/drivers/hv/hv_balloon.c +++ b/drivers/hv/hv_balloon.c @@ -771,7 +771,7 @@ static void hv_mem_hot_add(unsigned long start, unsigned long size, } } -static void hv_online_page(struct page *pg) +static int hv_online_page(struct page *pg, unsigned int order) { struct hv_hotadd_state *has; unsigned long flags; @@ -783,10 +783,12 @@ static void hv_online_page(struct page *pg) if ((pfn < has->start_pfn) || (pfn >= has->end_pfn)) continue; - hv_page_online_one(has, pg); + hv_bring_pgs_online(has, pfn, (1UL << order)); break; } spin_unlock_irqrestore(&dm_device.ha_lock, flags); + + return 0; } static int pfn_covered(unsigned long start_pfn, unsigned long pfn_cnt) diff --git a/drivers/xen/balloon.c b/drivers/xen/balloon.c index fdfc64f..1214828 100644 --- a/drivers/xen/balloon.c +++ b/drivers/xen/balloon.c @@ -390,8 +390,8 @@ static enum bp_state reserve_additional_memory(void) /* * add_memory_resource() will call online_pages() which in its turn - * will call xen_online_page() callback causing deadlock if we don't - * release balloon_mutex here. Unlocking here is safe because the + * will call xen_bring_pgs_online() callback causing deadlock if we + * don't release balloon_mutex here. Unlocking here is safe because the * callers drop the mutex before trying again. */ mutex_unlock(&balloon_mutex); @@ -414,15 +414,22 @@ static enum bp_state reserve_additional_memory(void) return BP_ECANCELED; } -static void xen_online_page(struct page *page) +static int xen_bring_pgs_online(struct page *pg, unsigned int order) { - __online_page_set_limits(page); + unsigned long i, size = (1 << order); + unsigned long start_pfn = page_to_pfn(pg); + struct page *p; + pr_debug("Online %lu pages starting at pfn 0x%lx\n", size, start_pfn); mutex_lock(&balloon_mutex); - - __balloon_append(page); - + for (i = 0; i < size; i++) { + p = pfn_to_page(start_pfn + i); + __online_page_set_limits(p); + __balloon_append(p); + } mutex_unlock(&balloon_mutex); + + return 0; } static int xen_memory_notifier(struct notifier_block *nb, unsigned long val, void *v) @@ -747,7 +754,7 @@ static int __init balloon_init(void) balloon_stats.max_retry_count = RETRY_UNLIMITED; #ifdef CONFIG_XEN_BALLOON_MEMORY_HOTPLUG - set_online_page_callback(&xen_online_page); + set_online_page_callback(&xen_bring_pgs_online); register_memory_notifier(&xen_memory_nb); register_sysctl_table(xen_root); diff --git a/include/linux/memory_hotplug.h b/include/linux/memory_hotplug.h index ffd9cd1..84e9ae2 100644 --- a/include/linux/memory_hotplug.h +++ b/include/linux/memory_hotplug.h @@ -87,7 +87,7 @@ extern int test_pages_in_a_zone(unsigned long start_pfn, unsigned long end_pfn, unsigned long *valid_start, unsigned long *valid_end); extern void __offline_isolated_pages(unsigned long, unsigned long); -typedef void (*online_page_callback_t)(struct page *page); +typedef int (*online_page_callback_t)(struct page *page, unsigned int order); extern int set_online_page_callback(online_page_callback_t callback); extern int restore_online_page_callback(online_page_callback_t callback); diff --git a/mm/internal.h b/mm/internal.h index 291eb2b..3b1ec14 100644 --- a/mm/internal.h +++ b/mm/internal.h @@ -163,6 +163,7 @@ static inline struct page *pageblock_pfn_to_page(unsigned long start_pfn, extern int __isolate_free_page(struct page *page, unsigned int order); extern void memblock_free_pages(struct page *page, unsigned long pfn, unsigned int order); +extern void __free_pages_core(struct page *page, unsigned int order); extern void prep_compound_page(struct page *page, unsigned int order); extern void post_alloc_hook(struct page *page, unsigned int order, gfp_t gfp_flags); diff --git a/mm/memory_hotplug.c b/mm/memory_hotplug.c index 2b2b3cc..99b4228 100644 --- a/mm/memory_hotplug.c +++ b/mm/memory_hotplug.c @@ -46,7 +46,7 @@ * and restore_online_page_callback() for generic callback restore. */ -static void generic_online_page(struct page *page); +static int generic_online_page(struct page *page, unsigned int order); static online_page_callback_t online_page_callback = generic_online_page; static DEFINE_MUTEX(online_page_callback_lock); @@ -655,26 +655,44 @@ void __online_page_free(struct page *page) } EXPORT_SYMBOL_GPL(__online_page_free); -static void generic_online_page(struct page *page) +static int generic_online_page(struct page *page, unsigned int order) { - __online_page_set_limits(page); - __online_page_increment_counters(page); - __online_page_free(page); + __free_pages_core(page, order); + totalram_pages += (1UL << order); +#ifdef CONFIG_HIGHMEM + if (PageHighMem(page)) + totalhigh_pages += (1UL << order); +#endif + return 0; +} + +static int online_pages_blocks(unsigned long start, unsigned long nr_pages) +{ + unsigned long end = start + nr_pages; + int order, ret, onlined_pages = 0; + + while (start < end) { + order = min(MAX_ORDER - 1, + get_order(PFN_PHYS(end) - PFN_PHYS(start))); + + ret = (*online_page_callback)(pfn_to_page(start), order); + if (!ret) + onlined_pages += (1UL << order); + else if (ret > 0) + onlined_pages += ret; + + start += (1UL << order); + } + return onlined_pages; } static int online_pages_range(unsigned long start_pfn, unsigned long nr_pages, void *arg) { - unsigned long i; unsigned long onlined_pages = *(unsigned long *)arg; - struct page *page; if (PageReserved(pfn_to_page(start_pfn))) - for (i = 0; i < nr_pages; i++) { - page = pfn_to_page(start_pfn + i); - (*online_page_callback)(page); - onlined_pages++; - } + onlined_pages = online_pages_blocks(start_pfn, nr_pages); online_mem_sections(start_pfn, start_pfn + nr_pages); diff --git a/mm/page_alloc.c b/mm/page_alloc.c index a919ba5..7cf503f 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -1264,7 +1264,7 @@ static void __free_pages_ok(struct page *page, unsigned int order) local_irq_restore(flags); } -static void __init __free_pages_boot_core(struct page *page, unsigned int order) +void __free_pages_core(struct page *page, unsigned int order) { unsigned int nr_pages = 1 << order; struct page *p = page; @@ -1343,7 +1343,7 @@ void __init memblock_free_pages(struct page *page, unsigned long pfn, { if (early_page_uninitialised(pfn)) return; - return __free_pages_boot_core(page, order); + return __free_pages_core(page, order); } /* @@ -1433,14 +1433,14 @@ static void __init deferred_free_range(unsigned long pfn, if (nr_pages == pageblock_nr_pages && (pfn & (pageblock_nr_pages - 1)) == 0) { set_pageblock_migratetype(page, MIGRATE_MOVABLE); - __free_pages_boot_core(page, pageblock_order); + __free_pages_core(page, pageblock_order); return; } for (i = 0; i < nr_pages; i++, page++, pfn++) { if ((pfn & (pageblock_nr_pages - 1)) == 0) set_pageblock_migratetype(page, MIGRATE_MOVABLE); - __free_pages_boot_core(page, 0); + __free_pages_core(page, 0); } } From patchwork Tue Nov 6 06:03:14 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Arun KS X-Patchwork-Id: 10669677 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 47B3C15A6 for ; Tue, 6 Nov 2018 06:03:40 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 376A028DB7 for ; Tue, 6 Nov 2018 06:03:40 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 2B80B29196; Tue, 6 Nov 2018 06:03:40 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id C9AE928DB7 for ; Tue, 6 Nov 2018 06:03:39 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 844786B02BC; Tue, 6 Nov 2018 01:03:36 -0500 (EST) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id 7CCAC6B02BE; Tue, 6 Nov 2018 01:03:36 -0500 (EST) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6BAA16B02BF; Tue, 6 Nov 2018 01:03:36 -0500 (EST) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-pf1-f198.google.com (mail-pf1-f198.google.com [209.85.210.198]) by kanga.kvack.org (Postfix) with ESMTP id 3AF9D6B02BC for ; Tue, 6 Nov 2018 01:03:36 -0500 (EST) Received: by mail-pf1-f198.google.com with SMTP id b15-v6so7070269pfo.3 for ; Mon, 05 Nov 2018 22:03:36 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-original-authentication-results:x-gm-message-state:from:to:cc :subject:date:message-id:in-reply-to:references; bh=8hPsWF+zmvUgHpFK9J9WYDSCd8eYHRfYFfs0ZjrGO0Y=; b=b8fuewP+VVI9RC8E3wRyS5Jbw8VjCdYTSF/XfWzTMzLzE/VE4J3bEptOltTtST6TUV NX6krDBTR9IjxhWZov9GOeAuF0ExMc0IV2CoGqnYamN3/f43LU0OC58Xu6AHQ+WRzpgB WLF13bilBOGnhP9mhpARKcAd+qnAgDWIO51Laqw+vOqtp0ohGmPLUkF945EYcbAlmVms j8Gr6UgGPhdNPAyBoU53e+NDy3nzdB3KIdrFyQ+VDuv9lgQzV59KYzCOk+Z/UJZFGpFl hNB8DFMoAMT8RbcZx/5/Wnekkm/93c7sXsi0UHIMoTF++4f6ZEgCWnZz6mbWw8kR5qTz Mbjg== X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: domain of arunks@qualcomm.com designates 103.229.18.197 as permitted sender) smtp.mailfrom=arunks@qualcomm.com X-Gm-Message-State: AGRZ1gLUjx2MfS6FWbAVWIGhq2KmvNu3aqCqlFTndGLYDmVtvNhShgzP wtl8leJ8h43ifLI7K2t+T1KQjtwfvIWpcfOPiGE5zL8AvMEorc/A6hb6slUtiYqEh2Af02ihaSN 8d+2wNksLz70dfT79xfzoRGDhJ4KsFspQkW/D0q6xg7i5ZauVVgLgW7LK6TbmPYc= X-Received: by 2002:a17:902:c01:: with SMTP id 1-v6mr25094084pls.15.1541484215941; Mon, 05 Nov 2018 22:03:35 -0800 (PST) X-Google-Smtp-Source: AJdET5furwqRtzACrYjPAeDr2MDfj+C6bltrlGmwM9lszxX6UqJoxubxeeDeembSpP2IALrS/9pe X-Received: by 2002:a17:902:c01:: with SMTP id 1-v6mr25094066pls.15.1541484215339; Mon, 05 Nov 2018 22:03:35 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1541484215; cv=none; d=google.com; s=arc-20160816; b=oToqAZxwTYJIZ9XTOGTdEDQWqt763rFlNurR9fbgjupgfDrmIZfBZ9tc10rWtkel1p ER7aqw4wXOPoD8euxx0PyStoOF28s0q2ovW1H3i9Wmje9U18NAAffz2tpaUN9dYpHRTA iP+bDUiWpzqXneU3wHRe2VTCrki3+2MJ0hV5SIFASHEPsqYwSZUsC6UjDGFx84veiIQj FkEin4oIsqqbibelaL4KGCDOe2JhGj1eHIednczeQbOi1JLn1TxRUW/K34e5cN3Lo9bK xheZ18hh1d/EUEiL7BIE26YLpAq0APKKwnIERH8CaUR5PX9lSahX5rvxJok1Zm/RO1Cf r2kg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=references:in-reply-to:message-id:date:subject:cc:to:from; bh=8hPsWF+zmvUgHpFK9J9WYDSCd8eYHRfYFfs0ZjrGO0Y=; b=r+pDfwvx++fNcIEjLNQuEY/iNI34GZEuB5nR5MHt0G95ZMp9KgnqLzf5HSnZw9QbPD Ih8riTtFaP69LcvSfRNw4QzFLYuLv3iycDIIttsWNR86WSsv88veI44TMUxHeXiG+JXt vP7JCDxRrjhZdCuXzdqt8gYIAoSfsIhFTbVJrzeAGEmWZ+tNEp+tb7iOK8dMBetF7WG2 qm/0Ut8/QZGc0Asm41EnvkCsUXLaqDBFyHyc3Aa8v2MVyDQkWczEGHtH5TNscT7xtg+s /ggmO/+E5C9G+fbqZzz4ddVBNciHpd3M4l3bGKd+ZGltlQr3KeC6jYI4/LCR+zYCG1JY vtuQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of arunks@qualcomm.com designates 103.229.18.197 as permitted sender) smtp.mailfrom=arunks@qualcomm.com Received: from alexa-out-blr-01.qualcomm.com (alexa-out-blr-01.qualcomm.com. [103.229.18.197]) by mx.google.com with ESMTPS id y27si11829553pga.459.2018.11.05.22.03.34 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 05 Nov 2018 22:03:35 -0800 (PST) Received-SPF: pass (google.com: domain of arunks@qualcomm.com designates 103.229.18.197 as permitted sender) client-ip=103.229.18.197; Authentication-Results: mx.google.com; spf=pass (google.com: domain of arunks@qualcomm.com designates 103.229.18.197 as permitted sender) smtp.mailfrom=arunks@qualcomm.com X-IronPort-AV: E=Sophos;i="5.54,470,1534789800"; d="scan'208";a="276569" Received: from ironmsg01-blr.qualcomm.com ([10.86.208.130]) by alexa-out-blr-01.qualcomm.com with ESMTP/TLS/AES256-SHA; 06 Nov 2018 11:33:34 +0530 X-IronPort-AV: E=McAfee;i="5900,7806,9068"; a="5671283" Received: from blr-ubuntu-104.ap.qualcomm.com (HELO blr-ubuntu-104.qualcomm.com) ([10.79.40.64]) by ironmsg01-blr.qualcomm.com with ESMTP; 06 Nov 2018 11:33:33 +0530 Received: by blr-ubuntu-104.qualcomm.com (Postfix, from userid 346745) id 67FC831C6; Tue, 6 Nov 2018 11:33:33 +0530 (IST) From: Arun KS To: arunks.linux@gmail.com, akpm@linux-foundation.org, mhocko@kernel.org, vbabka@suse.cz, osalvador@suse.de, linux-kernel@vger.kernel.org, linux-mm@kvack.org Cc: getarunks@gmail.com, Arun KS Subject: [PATCH v6 2/2] mm/page_alloc: remove software prefetching in __free_pages_core Date: Tue, 6 Nov 2018 11:33:14 +0530 Message-Id: <1541484194-1493-2-git-send-email-arunks@codeaurora.org> X-Mailer: git-send-email 1.9.1 In-Reply-To: <1541484194-1493-1-git-send-email-arunks@codeaurora.org> References: <1541484194-1493-1-git-send-email-arunks@codeaurora.org> X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP They not only increase the code footprint, they actually make things slower rather than faster. Remove them as contemporary hardware doesn't need any hint. Suggested-by: Dan Williams Signed-off-by: Arun KS --- mm/page_alloc.c | 6 +----- 1 file changed, 1 insertion(+), 5 deletions(-) diff --git a/mm/page_alloc.c b/mm/page_alloc.c index 7cf503f..a1b9a6a 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -1270,14 +1270,10 @@ void __free_pages_core(struct page *page, unsigned int order) struct page *p = page; unsigned int loop; - prefetchw(p); - for (loop = 0; loop < (nr_pages - 1); loop++, p++) { - prefetchw(p + 1); + for (loop = 0; loop < nr_pages ; loop++, p++) { __ClearPageReserved(p); set_page_count(p, 0); } - __ClearPageReserved(p); - set_page_count(p, 0); page_zone(page)->managed_pages += nr_pages; set_page_refcounted(page);