From patchwork Wed Sep 26 23:28:20 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Alexander Duyck X-Patchwork-Id: 10617031 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 4F109175A for ; Wed, 26 Sep 2018 23:29:13 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 360632B1E5 for ; Wed, 26 Sep 2018 23:29:13 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 2A0242B1EB; Wed, 26 Sep 2018 23:29:13 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id BCDC42B1E5 for ; Wed, 26 Sep 2018 23:29:12 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 7E4F18E0002; Wed, 26 Sep 2018 19:29:11 -0400 (EDT) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id 793568E0001; Wed, 26 Sep 2018 19:29:11 -0400 (EDT) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6AB9C8E0002; Wed, 26 Sep 2018 19:29:11 -0400 (EDT) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-pf1-f200.google.com (mail-pf1-f200.google.com [209.85.210.200]) by kanga.kvack.org (Postfix) with ESMTP id 2D0068E0001 for ; Wed, 26 Sep 2018 19:29:11 -0400 (EDT) Received: by mail-pf1-f200.google.com with SMTP id u13-v6so746280pfm.8 for ; Wed, 26 Sep 2018 16:29:11 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-original-authentication-results:x-gm-message-state:subject:from :to:cc:date:message-id:user-agent:mime-version :content-transfer-encoding; bh=6q14x3QCWJcyVstPnRZCPTTsbUrH2Tk8hABCRdXx05I=; b=GCB3ARFWvZsEhhe0PE++RrXbc6hILNscttpWkIjxW5bpA8Q+pvxoDJ6JZ2rSMrsSSz FJNRaqmVXMmiT9jOV7tVVYcSOI5UvcRW8wc36jmX/Mc8zGYCm8pxvcfzvArrpYFUkTiU pouHOxmTXpwsUdhkrtO3kMGs6SSmiDc/efu40RdV/THKVN5XMcAfiU+1QthWgXRuYBVY vyiJdmPT/Rszhn15kvObpkyX7EwBR63y65Rwb/La0qxe6jr0Q5mRkHV2CxvJQUaEmbqS 2CFjpk69Iaz+ojmBtvsHT/8WP9SVNvv78vkO1SLL/Rv+1kvqVk3SwP2cjWLHQsMbBp8g HePQ== X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of alexander.h.duyck@linux.intel.com designates 192.55.52.136 as permitted sender) smtp.mailfrom=alexander.h.duyck@linux.intel.com; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com X-Gm-Message-State: ABuFfojfOMCdNFHhPvFlrdLs4G4ROs/xfpliv47NjnqbXZ/yz1qRbrKp m6BGgY5Ok5AcyuR4Msc1+tm72QfPbIi1FI/i/5Sq3I9xkffSfUp2fgiXp/ni1rN/ubUDggxtMR8 MSxH+AVYqJ/2c/AAlpyK3VyOqDI7jICht1+CD/iIAKCWhzzfV5sLySTnlHlBjunLXuQ== X-Received: by 2002:a17:902:7402:: with SMTP id g2-v6mr7973383pll.321.1538004550720; Wed, 26 Sep 2018 16:29:10 -0700 (PDT) X-Google-Smtp-Source: ACcGV63qc4M8l+hjsyDYjvYoQbwOKNd8nn7FGh6F58GQ2jeaPxyALfRzyY7xYIdhss1aOHvwIXnS X-Received: by 2002:a17:902:7402:: with SMTP id g2-v6mr7973341pll.321.1538004549900; Wed, 26 Sep 2018 16:29:09 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1538004549; cv=none; d=google.com; s=arc-20160816; b=XBfIdQ+7B5mmPTUgshZz9/RLTtr7JT4pbNGFM8U/EVOZrT8KxUbHShP5cRC1Rx8uij E41UgasD8MVPni0tpu3se6HRoIIYmH3azOdwc+nWYbNpMJbe86KzrPmJCqiswV2oCAyP Ca+BVLLFY67aoG79z3sXsheXLdouVhuxamMvhNPwguZ4lAw7T2KnEu6wgOWjTMtaaRHr jFAYJiea1Nr97BZfCK66T+D1GheHsWz3vPvg/YdYuDkCJTd39qkZvxYr6UFi77Y4gfEJ Y36IlRrI1J8dHl4Yic590hUYCM8Q2fw4JHWH5MkJAWgTOKs6Du1OM0gFbaRMJueQd+hX sCKw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:user-agent:message-id:date :cc:to:from:subject; bh=6q14x3QCWJcyVstPnRZCPTTsbUrH2Tk8hABCRdXx05I=; b=k1oCn9dSZsYL4qMS1y+reoeVKt4gOj7n6dbFD4InU0k1Cb6reHmGjt+ZWNY7BHcKiP stxEpUWuSIOeeOD4WO/IXtzllE7pGruuo8yB6/gsmvFTGuFRMEwnwpfChyJGmQeB2nib HjZkdWkwkMDlHceq7eNndhSrOmup2+FSoZa9T2DZzqDJUnZ4Mhb81pYvz14yhXU26VEI 5wF55UnW3X0vboWROa7hYr8QrEPvGK0y9RWJWXzt/03Ab1oTz/1JGXHCqCfKjqJ3k3JD kQ2R0hRNSgGmv2fe//LVAw/KzkLP+Ja93ijDxQDsDh1AgjGWqYaNHWI8ntfCxcQhP0fJ Uhpg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of alexander.h.duyck@linux.intel.com designates 192.55.52.136 as permitted sender) smtp.mailfrom=alexander.h.duyck@linux.intel.com; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: from mga12.intel.com (mga12.intel.com. [192.55.52.136]) by mx.google.com with ESMTPS id d7-v6si360746pln.68.2018.09.26.16.29.09 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 26 Sep 2018 16:29:09 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of alexander.h.duyck@linux.intel.com designates 192.55.52.136 as permitted sender) client-ip=192.55.52.136; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of alexander.h.duyck@linux.intel.com designates 192.55.52.136 as permitted sender) smtp.mailfrom=alexander.h.duyck@linux.intel.com; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga003.jf.intel.com ([10.7.209.27]) by fmsmga106.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 26 Sep 2018 16:29:08 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.54,308,1534834800"; d="scan'208";a="86873123" Received: from ahduyck-mobl.amr.corp.intel.com (HELO localhost.localdomain) ([10.7.198.154]) by orsmga003.jf.intel.com with ESMTP; 26 Sep 2018 16:28:20 -0700 Subject: [RFC mm PATCH 0/5] mm: Deferred page init improvements From: Alexander Duyck To: sparclinux@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org Cc: pavel.tatashin@microsoft.com, mhocko@suse.com, dave.jiang@intel.com, alexander.h.duyck@linux.intel.com, dan.j.williams@intel.com, willy@infradead.org, mingo@kernel.org, khalid.aziz@oracle.com, rppt@linux.vnet.ibm.com, vbabka@suse.cz, akpm@linux-foundation.org, ldufour@linux.vnet.ibm.com, davem@davemloft.net, kirill.shutemov@linux.intel.com Date: Wed, 26 Sep 2018 16:28:20 -0700 Message-ID: <20180926232117.17365.72207.stgit@localhost.localdomain> User-Agent: StGit/0.17.1-dirty MIME-Version: 1.0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP This patchset is essentially a refactor of the page initialization logic to provide for better code reuse while providing a significant improvement in deferred page initialization performance. In my testing I have seen a 3:1 reduction in the time needed for deferred memory initialization on two different x86_64 based test systems I have. In addition this provides a very slight improvement for the hotplug memory initialization, although the improvement doesn't exceed 5% from what I can tell and that is to be expected since most of the changes related to hotplug initialization are just code clean-up to allow for reuse. I had been considering using a large memset for the entire pageblock I was initializing which showed a significant speedup for persistent memory init however that showed no improvements to a slight regression for regular deferred initialization of standard memory. --- Alexander Duyck (5): mm: Use mm_zero_struct_page from SPARC on all 64b architectures mm: Drop meminit_pfn_in_nid as it is redundant mm: Use memblock/zone specific iterator for handling deferred page init mm: Move hot-plug specific memory init into separate functions and optimize mm: Use common iterator for deferred_init_pages and deferred_free_pages arch/sparc/include/asm/pgtable_64.h | 30 -- include/linux/memblock.h | 58 ++++ include/linux/mm.h | 33 ++ mm/memblock.c | 63 ++++ mm/page_alloc.c | 555 +++++++++++++++++++++-------------- 5 files changed, 485 insertions(+), 254 deletions(-) --