From patchwork Tue Sep 25 20:18:08 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Alexander Duyck X-Patchwork-Id: 10614777 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 1235E913 for ; Tue, 25 Sep 2018 20:18:14 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id F3D5B29C5E for ; Tue, 25 Sep 2018 20:18:13 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id E4D17298E8; Tue, 25 Sep 2018 20:18:13 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 8378029805 for ; Tue, 25 Sep 2018 20:18:13 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 703AE8E00BA; Tue, 25 Sep 2018 16:18:12 -0400 (EDT) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id 6B1398E00A4; Tue, 25 Sep 2018 16:18:12 -0400 (EDT) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5C7D18E00BA; Tue, 25 Sep 2018 16:18:12 -0400 (EDT) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-pg1-f199.google.com (mail-pg1-f199.google.com [209.85.215.199]) by kanga.kvack.org (Postfix) with ESMTP id 205978E00A4 for ; Tue, 25 Sep 2018 16:18:12 -0400 (EDT) Received: by mail-pg1-f199.google.com with SMTP id e6-v6so3212469pge.5 for ; Tue, 25 Sep 2018 13:18:12 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-original-authentication-results:x-gm-message-state:subject:from :to:cc:date:message-id:user-agent:mime-version :content-transfer-encoding; bh=+2lQG2iX6G50adFDxT+MRNYYD2Lx9JOBZKY6aDFawTQ=; b=R7GIk9UW8ukGp60EhtcSvPd1Ysh6Me1XnhWWOYytcd15LlvioXwsmVZPN94Vo/pWLn GU6cMRnS/TIMYzFR++7RzTLnG8HP8dwk9c4AzU6u3pxfPJyUQyRiULubb9RqN2G9n8Ki djDY/QqmkbvnQmEkCaFG/MzW04QTWBdcsbZ9Y9wFMCMfj4QVrKjjvo7LeCgRGiOH6zfC f2H+5uiXyW1gVxb6zDtsc2qDU4gSrG+LOWzYoIlO41scsXOK4CSr3ZxW2AAjOd/VUIno jfrpvFKXdUJLkAYX5lJIba/9xblGtK3RLgq+F4BEUuuxqKNo0KkgMi15TNIMOAdVqCD6 8UPw== X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of alexander.h.duyck@linux.intel.com designates 192.55.52.88 as permitted sender) smtp.mailfrom=alexander.h.duyck@linux.intel.com; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com X-Gm-Message-State: ABuFfogYamQ6tkpq+IjyVATuqWrq2UuGASP41BtHyo080Yvm8FinfjA9 TDTPjfs3KLSMvKI8VQR9gIy5mYjsEerx4XtnUq1LzICOEgPtMZrByBvYPtdtFPJPWnq55je1zvD 17K6BYALQc2Awv4a5rjuqj1ZhI/3cBN/AKzEALh0Qml4IyR2BFIl4U4L4Wk/6yuLSYQ== X-Received: by 2002:a17:902:2ac3:: with SMTP id j61-v6mr2703878plb.172.1537906691748; Tue, 25 Sep 2018 13:18:11 -0700 (PDT) X-Google-Smtp-Source: ACcGV61ZvuCs+re+JOksXCWcT+mLh2LQftVnAt1KYVznYeIyiKteFXaPkkDL9ypwPMUIkF/T/KC6 X-Received: by 2002:a17:902:2ac3:: with SMTP id j61-v6mr2703824plb.172.1537906690770; Tue, 25 Sep 2018 13:18:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1537906690; cv=none; d=google.com; s=arc-20160816; b=A0tifV5crfuK9fpakmK9WVV4k498oVxtXIcz2MYHCpajwMJvp4BhS8bjhnoKPXoOGM yDH5fWk8Zh9cY2iko4pb77drh+h0GNw3YAWZkHeZmI4WL4mb1VAdbD2/dBxrgtCxFy00 bgeM/txRSpOjq6JYEPoGwF/udxHSzqqHwPEIBfU4h7IX7PQsj1O2qAf3HBXE0LeKhkIq ESAqJqwJhBK0j3k+9sqTVHwfR08Zjzjh65T+ENdmQf8oxQy9Q6AAj6lavk/td9t/ML67 s1ZSMKUMP9Vzhpzjw23yhiYyynV9WTXnCt2ODQ2ZkO5PHLW2D+4nzb+vpqJNWD+Sa/MA d1dQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:user-agent:message-id:date :cc:to:from:subject; bh=+2lQG2iX6G50adFDxT+MRNYYD2Lx9JOBZKY6aDFawTQ=; b=xwVrmqeSePwMq0RuqrW5jJEVo/PiG7iFK870e+ZkLZkMAuxAoqR1YT51snOtbXM4X0 Ww+59msfXPk7mYJ20rJfkZCSlxcV0KRXMmy2uL8rRvv5zhDK9PBN4Eys+ZcUVHtunsOc 4ysxbWv5Qm5/knVtjK1FBbEaW2j/O6y5m+LT3U4mrWsHF+YjsoIfHyHdWSJ0iC2C1Aio xYyHG/JabDAlNIOeNrOoPsmKySOMp1BKlluErrVzVY83p5CWL/3Mpq9nl6K6lijmVZmb 7KPlA+Y5VxyrJY/PZT6LzmZYrYGgjQL4SJL+Hxz07JDfzgmfwsBVcEJ8JbOzs8qeHdYS u2UQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of alexander.h.duyck@linux.intel.com designates 192.55.52.88 as permitted sender) smtp.mailfrom=alexander.h.duyck@linux.intel.com; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: from mga01.intel.com (mga01.intel.com. [192.55.52.88]) by mx.google.com with ESMTPS id o11-v6si3282044pls.76.2018.09.25.13.18.10 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 25 Sep 2018 13:18:10 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of alexander.h.duyck@linux.intel.com designates 192.55.52.88 as permitted sender) client-ip=192.55.52.88; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of alexander.h.duyck@linux.intel.com designates 192.55.52.88 as permitted sender) smtp.mailfrom=alexander.h.duyck@linux.intel.com; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga006.jf.intel.com ([10.7.209.51]) by fmsmga101.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 25 Sep 2018 13:18:09 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.54,303,1534834800"; d="scan'208";a="77229927" Received: from ahduyck-mobl.amr.corp.intel.com (HELO localhost.localdomain) ([10.7.198.152]) by orsmga006.jf.intel.com with ESMTP; 25 Sep 2018 13:18:09 -0700 Subject: [PATCH v5 0/4] Address issues slowing persistent memory initialization From: Alexander Duyck To: linux-mm@kvack.org, akpm@linux-foundation.org, linux-kernel@vger.kernel.org, linux-nvdimm@lists.01.org Cc: pavel.tatashin@microsoft.com, mhocko@suse.com, dave.jiang@intel.com, dave.hansen@intel.com, jglisse@redhat.com, rppt@linux.vnet.ibm.com, dan.j.williams@intel.com, logang@deltatee.com, mingo@kernel.org, kirill.shutemov@linux.intel.com Date: Tue, 25 Sep 2018 13:18:08 -0700 Message-ID: <20180925200551.3576.18755.stgit@localhost.localdomain> User-Agent: StGit/0.17.1-dirty MIME-Version: 1.0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP This patch set is meant to be a v5 of my earlier submission with the same title[1]. The main changes from the previous version are that I have added a new patch to address an issue that had disabled deferred memory init on my system due to recent config changes related to CONFIG_NO_BOOTMEM. In addition I dropped the original patches 4 and 5 from the previous set as that is going to need to be a separate set of patches. The main thing this patch set achieves is that it allows us to initialize each node worth of persistent memory independently. As a result we reduce page init time by about 2 minutes because instead of taking 30 to 40 seconds per node and going through each node one at a time, we process all 4 nodes in parallel in the case of a 12TB persistent memory setup spread evenly over 4 nodes. [1]: https://lkml.org/lkml/2018/9/21/4 --- Alexander Duyck (4): mm: Remove now defunct NO_BOOTMEM from depends list for deferred init mm: Provide kernel parameter to allow disabling page init poisoning mm: Create non-atomic version of SetPageReserved for init use mm: Defer ZONE_DEVICE page initialization to the point where we init pgmap Documentation/admin-guide/kernel-parameters.txt | 12 +++ arch/csky/Kconfig | 1 include/linux/mm.h | 2 include/linux/page-flags.h | 9 ++ kernel/memremap.c | 24 ++--- mm/Kconfig | 1 mm/debug.c | 46 ++++++++++ mm/hmm.c | 12 ++- mm/memblock.c | 5 - mm/page_alloc.c | 101 ++++++++++++++++++++++- mm/sparse.c | 4 - 11 files changed, 184 insertions(+), 33 deletions(-) --