From patchwork Sat Nov 3 04:00:38 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Joel Fernandes X-Patchwork-Id: 10666491 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 023C6175A for ; Sat, 3 Nov 2018 04:00:53 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id D047F2B3D2 for ; Sat, 3 Nov 2018 04:00:52 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id C256D2B3D8; Sat, 3 Nov 2018 04:00:52 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.0 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 1ED6D2B3D2 for ; Sat, 3 Nov 2018 04:00:51 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 89CBA6B0003; Sat, 3 Nov 2018 00:00:50 -0400 (EDT) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id 873136B0005; Sat, 3 Nov 2018 00:00:50 -0400 (EDT) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 763A56B0006; Sat, 3 Nov 2018 00:00:50 -0400 (EDT) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-pl1-f197.google.com (mail-pl1-f197.google.com [209.85.214.197]) by kanga.kvack.org (Postfix) with ESMTP id 33C7B6B0003 for ; Sat, 3 Nov 2018 00:00:50 -0400 (EDT) Received: by mail-pl1-f197.google.com with SMTP id e97-v6so3636108plb.10 for ; Fri, 02 Nov 2018 21:00:50 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:dkim-signature:from:to:cc:subject:date :message-id:mime-version:content-transfer-encoding; bh=wauWrsOYZ4NO7yzxN9r9ffJEchMQCnKRjhBqfvcq730=; b=FDzIGxMwwXope6sRZOgvq1qjy3w5ZNn+vPmHjtfJjdYurWcLTWnklFJYqdZBBOCjhf lfB1/DUb2YlBKP/xqynA1bOlfEVez+hGSSLnLHMg+48LwLzPxy0xkLF12ih3ApC7kljm T88YehrzvKgFiw18BMoqmHsYa/fS+tqTu9XnPvht2BYaTFhcXbARHZYw+7BuljRTOweM /P+05KH0mvBNhJSLCBxZbz1YTpw7fQ7x9NjeRAu0fL5n2/MISufEOl+DhJhroNTUT5qk f3xOa2BsfTy59enp6OmRaLtx7itT3oMWjOiipN3OtXngZ1fcDffmfW+EYDWmvlDm1u6R 1G8Q== X-Gm-Message-State: AGRZ1gIF9mRUudz9r7mfqZqQpBry7sJFPFBs+cVvGgzvB+P7ogerWClK csS/l3P3HC303gb7ye0fcIUKlGDusRx0WxN5tS/MEPRjVgRxVjYbbGj1+xWdyWpTtxakXk9xGnd bk4jVIPO3z6R+QTAIn0pz7erl1WBl7KvsaujmuLRcS17zT+z15zPR6buvkiVmwVzDj7v7yr+puv Rc3cKn+8EXsiOLMASOhyvc2kuCLM++zhWLUkb7VXMuqzmvtFfZjDNwUnq7sN9sENxo+w/FvyPzI RhSrFqK5ZWV33pkpZzwaJghu3o9Eeqs9oNntzGe4EJ2s4di+zuPwTyok+zhm8tmeKE20lg8dWpq i3cg7wq/FMrkYk7YXGUB/L0Xe88o9f6jM/ODCZluIWyFW0y8HM1j069wSVZx6LizGmHy4EcesBY n X-Received: by 2002:a63:5407:: with SMTP id i7mr13099044pgb.413.1541217649833; Fri, 02 Nov 2018 21:00:49 -0700 (PDT) X-Received: by 2002:a63:5407:: with SMTP id i7mr13099003pgb.413.1541217649003; Fri, 02 Nov 2018 21:00:49 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1541217648; cv=none; d=google.com; s=arc-20160816; b=mxzTaqN4b1jmr6+qMYE0H8ZRqvw0mQsyqyR2Z3UZdPfuYgGDDH63hnOugJ4KSlSJz0 AKS6M4qcl3ptcm5XJi1zT3Qg5Z0KTf5E5kibWnYWcpC92rspfMjKMLh054ifjfgU1RAo +jJhk3GjpRpcFwosNl7X4BppYNqBy+P9wFqwtAhBHnn6TXLTQK513hXJb7ImAITy34GU wSZvuAoTQVd7kxZbmxuEij6F74Cttvnw/28/7WFiKHGEj5ZofCR/DqAjyTh2dz1Z5iiN IC6wH2S+IBsW93qQJFNsgfn6oFn/oCyT4C+shvyoN5IyWNKUax2COux3sXbGx+H4x1sC K8cQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:dkim-signature; bh=wauWrsOYZ4NO7yzxN9r9ffJEchMQCnKRjhBqfvcq730=; b=isNpzzRmEYpF57jiHx1Xo8PnBMJ6Z8C7OktDhyGgKEiPjzeF6XKGGArz6fyoCpJrvu qNQULSdRLHg8kFus/fNLQV1iAHkmU4UU2PWFDT/MOoRov5eV1u9p8HUHvmXQRJF2kPrK 75XVEGXbAaze9clWhee6EVgO9TO4dOjg9c3Hk3/koomKoMY1pOKkmvvqyShSaI9J0wRm Lq7er0X1nIfkafo6QnvSkkAMvrd4Ma7wA9zs4axiECGRzrnZmI7FTY3mxH7XZ22MqnAi +BkoF7ivfvrvQ9HjmjiLJ/2PC9wGNvTTK816uEwTgt9ZWXyGNBREf+ZpGH3jYyK+ryK3 WU2g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b="hQZEI/5I"; spf=pass (google.com: domain of joel@joelfernandes.org designates 209.85.220.65 as permitted sender) smtp.mailfrom=joel@joelfernandes.org Received: from mail-sor-f65.google.com (mail-sor-f65.google.com. [209.85.220.65]) by mx.google.com with SMTPS id x9-v6sor13414416pgj.71.2018.11.02.21.00.48 for (Google Transport Security); Fri, 02 Nov 2018 21:00:48 -0700 (PDT) Received-SPF: pass (google.com: domain of joel@joelfernandes.org designates 209.85.220.65 as permitted sender) client-ip=209.85.220.65; Authentication-Results: mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b="hQZEI/5I"; spf=pass (google.com: domain of joel@joelfernandes.org designates 209.85.220.65 as permitted sender) smtp.mailfrom=joel@joelfernandes.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=joelfernandes.org; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=wauWrsOYZ4NO7yzxN9r9ffJEchMQCnKRjhBqfvcq730=; b=hQZEI/5IkmDKiwTPcEpeRj5mdJ5f2khCIYUC+tRjECkBSTU7A0nmPfUa+oKun3ZvpC QBKK3UGjzZVXQ1U3TcxSBsjIIEAUExiO5kioNqzsBdpusaZSc1GEsUpTdFXIZs++dzNb Oce3FxvhzDGCV4UEuF2dXGfauQd44vDoSo9M4= X-Google-Smtp-Source: AJdET5cSoldQI3hr9VnkPhkTOPGPi4e4hyOBk5/0PfLyEPfalVwQIW1MKjDzIap7cLOClQG72ynqpQ== X-Received: by 2002:a63:a441:: with SMTP id c1-v6mr13210874pgp.49.1541217647914; Fri, 02 Nov 2018 21:00:47 -0700 (PDT) Received: from joelaf.mtv.corp.google.com ([2620:0:1000:1601:3aef:314f:b9ea:889f]) by smtp.gmail.com with ESMTPSA id x36-v6sm35836232pgl.43.2018.11.02.21.00.45 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 02 Nov 2018 21:00:46 -0700 (PDT) From: Joel Fernandes X-Google-Original-From: Joel Fernandes To: linux-kernel@vger.kernel.org Cc: kernel-team@android.com, Joel Fernandes , akpm@linux-foundation.org, Andrey Ryabinin , Andy Lutomirski , anton.ivanov@kot-begemot.co.uk, Borislav Petkov , Catalin Marinas , Chris Zankel , dancol@google.com, Dave Hansen , "David S. Miller" , elfring@users.sourceforge.net, Fenghua Yu , Geert Uytterhoeven , Guan Xuetao , Helge Deller , hughd@google.com, Ingo Molnar , "James E.J. Bottomley" , Jeff Dike , Jonas Bonn , Julia Lawall , kasan-dev@googlegroups.com, kirill@shutemov.name, kvmarm@lists.cs.columbia.edu, Ley Foon Tan , linux-alpha@vger.kernel.org, linux-hexagon@vger.kernel.org, linux-ia64@vger.kernel.org, linux-m68k@lists.linux-m68k.org, linux-mips@linux-mips.org, linux-mm@kvack.org, linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-riscv@lists.infradead.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, linux-snps-arc@lists.infradead.org, linux-um@lists.infradead.org, linux-xtensa@linux-xtensa.org, lokeshgidra@google.com, Max Filippov , Michal Hocko , minchan@kernel.org, nios2-dev@lists.rocketboards.org, pantin@google.com, Peter Zijlstra , Richard Weinberger , Rich Felker , Sam Creasey , sparclinux@vger.kernel.org, Stafford Horne , Stefan Kristiansson , Thomas Gleixner , Tony Luck , Will Deacon , x86@kernel.org (maintainer:X86 ARCHITECTURE (32-BIT AND 64-BIT)), Yoshinori Sato Subject: [PATCH -next 0/3] Add support for fast mremap Date: Fri, 2 Nov 2018 21:00:38 -0700 Message-Id: <20181103040041.7085-1-joelaf@google.com> X-Mailer: git-send-email 2.19.1.930.g4563a0d9d0-goog MIME-Version: 1.0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP Hi, Here is the latest "fast mremap" series. This just a repost with Kirill's Acked-bys added. I would like this to be considered for linux -next. I also dropped the CONFIG enablement patch for arm64 since I am yet to test it with the new TLB flushing code that is in very recent kernel releases. (None of my arm64 devices run mainline right now.) so I will post the arm64 enablement once I get to that. The performance numbers in the series are for x86. List of patches in series: (1) mm: select HAVE_MOVE_PMD in x86 for faster mremap (2) mm: speed up mremap by 20x on large regions (v4) v1->v2: Added support for per-arch enablement (Kirill Shutemov) v2->v3: Updated commit message to state the optimization may also run for non-thp type of systems (Daniel Col). v3->v4: Remove useless pmd_lock check (Kirill Shutemov) Rebased ontop of Linus's master, updated perf results based on x86 testing. Added Kirill's Acks. (3) mm: treewide: remove unused address argument from pte_alloc functions (v2) v1->v2: fix arch/um/ prototype which was missed in v1 (Anton Ivanov) update changelog with manual fixups for m68k and microblaze. not included - (4) mm: select HAVE_MOVE_PMD in arm64 for faster mremap This patch is dropped since last posting pending further performance testing on arm64 with new TLB gather updates. See notes in patch titled "mm: speed up mremap by 500x on large regions" for more details. Joel Fernandes (Google) (3): mm: treewide: remove unused address argument from pte_alloc functions (v2) mm: speed up mremap by 20x on large regions (v4) mm: select HAVE_MOVE_PMD in x86 for faster mremap arch/Kconfig | 5 ++ arch/alpha/include/asm/pgalloc.h | 6 +- arch/arc/include/asm/pgalloc.h | 5 +- arch/arm/include/asm/pgalloc.h | 4 +- arch/arm64/include/asm/pgalloc.h | 4 +- arch/hexagon/include/asm/pgalloc.h | 6 +- arch/ia64/include/asm/pgalloc.h | 5 +- arch/m68k/include/asm/mcf_pgalloc.h | 8 +-- arch/m68k/include/asm/motorola_pgalloc.h | 4 +- arch/m68k/include/asm/sun3_pgalloc.h | 6 +- arch/microblaze/include/asm/pgalloc.h | 19 +----- arch/microblaze/mm/pgtable.c | 3 +- arch/mips/include/asm/pgalloc.h | 6 +- arch/nds32/include/asm/pgalloc.h | 5 +- arch/nios2/include/asm/pgalloc.h | 6 +- arch/openrisc/include/asm/pgalloc.h | 5 +- arch/openrisc/mm/ioremap.c | 3 +- arch/parisc/include/asm/pgalloc.h | 4 +- arch/powerpc/include/asm/book3s/32/pgalloc.h | 4 +- arch/powerpc/include/asm/book3s/64/pgalloc.h | 12 ++-- arch/powerpc/include/asm/nohash/32/pgalloc.h | 4 +- arch/powerpc/include/asm/nohash/64/pgalloc.h | 6 +- arch/powerpc/mm/pgtable-book3s64.c | 2 +- arch/powerpc/mm/pgtable_32.c | 4 +- arch/riscv/include/asm/pgalloc.h | 6 +- arch/s390/include/asm/pgalloc.h | 4 +- arch/sh/include/asm/pgalloc.h | 6 +- arch/sparc/include/asm/pgalloc_32.h | 5 +- arch/sparc/include/asm/pgalloc_64.h | 6 +- arch/sparc/mm/init_64.c | 6 +- arch/sparc/mm/srmmu.c | 4 +- arch/um/include/asm/pgalloc.h | 4 +- arch/um/kernel/mem.c | 4 +- arch/unicore32/include/asm/pgalloc.h | 4 +- arch/x86/Kconfig | 1 + arch/x86/include/asm/pgalloc.h | 4 +- arch/x86/mm/pgtable.c | 4 +- arch/xtensa/include/asm/pgalloc.h | 8 +-- include/linux/mm.h | 13 ++-- mm/huge_memory.c | 8 +-- mm/kasan/kasan_init.c | 2 +- mm/memory.c | 17 +++--- mm/migrate.c | 2 +- mm/mremap.c | 62 +++++++++++++++++++- mm/userfaultfd.c | 2 +- virt/kvm/arm/mmu.c | 2 +- 46 files changed, 163 insertions(+), 147 deletions(-)