From patchwork Wed Jan 23 22:23:06 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Jerome Glisse X-Patchwork-Id: 10777965 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id B95DE1390 for ; Wed, 23 Jan 2019 22:23:33 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id A93422D368 for ; Wed, 23 Jan 2019 22:23:33 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 9B75F2D396; Wed, 23 Jan 2019 22:23:33 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id E31A62D37E for ; Wed, 23 Jan 2019 22:23:32 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id CF0F08E004E; Wed, 23 Jan 2019 17:23:31 -0500 (EST) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id CC7B68E0047; Wed, 23 Jan 2019 17:23:31 -0500 (EST) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BE0568E004E; Wed, 23 Jan 2019 17:23:31 -0500 (EST) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-qk1-f197.google.com (mail-qk1-f197.google.com [209.85.222.197]) by kanga.kvack.org (Postfix) with ESMTP id 935DF8E0047 for ; Wed, 23 Jan 2019 17:23:31 -0500 (EST) Received: by mail-qk1-f197.google.com with SMTP id p79so3455608qki.15 for ; Wed, 23 Jan 2019 14:23:31 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-original-authentication-results:x-gm-message-state:from:to:cc :subject:date:message-id:mime-version:content-transfer-encoding; bh=R9Y73dA5zfcuQhRWdQd+Zs6GLcZnKQfxEq7znl2+rhM=; b=GH4SyZLowsPpNYuOemsN540WOtw6pne1Ap4jxeSFKkKafYQBytglPPsJc8PsYVWWyk GD9rKVPqS/k8ExJ8tY+dEtkvDnUdRijG3ZmoGhN3BgdzzRdX1Qwk9jiPb0Wr/Y3F4U5y cA67OQtqngs4oCe/XU+FaLgGV6Xu3kTJ9eUAEkje6puY4zK7R97XFJH3rojpLA++DBa1 6a6p1uRZ5/9ASdYUkC3Aa+lnnOSVIrFQ40W3YSCpp/k1wjYZ/7ZdNlLdLU8oyt5/kxFJ 26njfnLfJQX8nmvy+RD98HfJJ8ljg5CAf3+uxSIuHUJV/hY66PAJC1sth6Ui6JmDsION fIew== X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: domain of jglisse@redhat.com designates 209.132.183.28 as permitted sender) smtp.mailfrom=jglisse@redhat.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com X-Gm-Message-State: AJcUukeK9QfDYgf1o3WKpN3uurUgyt/4WA454IhEqSWbgmxlXch5jW8D e57zGWeK+iD7lU5jbcQuVlFEjQY9MyTCA86hWT+4cUrAoNrVdSm05nmH6iUOE5mJNQTbK2wP0+B nW4r/MOm2ZzNNcqSNoomzCTos70DzeYW1gHWb76v/SvWLACu0DCXvaK1DCKulbdxfMQ== X-Received: by 2002:a37:5257:: with SMTP id g84mr3497195qkb.76.1548282211297; Wed, 23 Jan 2019 14:23:31 -0800 (PST) X-Google-Smtp-Source: ALg8bN5r+dzikyf1bzZlDKHP9HpcEWwozRSGpXFHgzcXfD166Du3Su7LhgnAx4Gc3nR34xc0Ow1D X-Received: by 2002:a37:5257:: with SMTP id g84mr3497163qkb.76.1548282210546; Wed, 23 Jan 2019 14:23:30 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1548282210; cv=none; d=google.com; s=arc-20160816; b=Q9TqNza491oj6w9R0Q0UUMhTs90ASLjPSgvW4LF757Bh3wnymxyZoSfpd/HwLdZVNG Vfja/N31QDrX1zLFw7g/Y9SK0yHj4L2vlb42z/CDKkF1m7GJrthOjPdK7PnFcMwWnAcw dbXFlzV8hdL75KfG+K8TQA1hzvu3Rp1zG+2r31hq9r4TCnspMstMb1egEEKcOxazKluO U3FP3UeuRDd2j94KswA+cAHw4yaaf1rMAKIiYgxIBQZB4ksHU6+c5VxTYT2MDnM18YON sxhb2p3Sek3YSLL/7XHuG5cE4mxHgLANbamMvqHTer+537JHoXkGZdmrY5/j+pupYpi3 kWUQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=R9Y73dA5zfcuQhRWdQd+Zs6GLcZnKQfxEq7znl2+rhM=; b=N0xk4RkuAw8Zg6esx01YvJgRp8OOHHPSGjcbAnTKVjbErwHjcqOlG6PL4bTmz1bk/D aPcIyvP988Eg34AkaAZTNgZ4Y+mmoa3OIfcL/x6svNG9CY7abouXuc94Yc8z36Xh9hPM JIegumUfUJEd3tLailvqWvRKNu8otO3MvSFESTkJEumi4ZDM+B0foucEu5R6ykb/lZdG fqe8sDOpvgAThj+MzBl+ghEPBvPzXJ90ulHTPrt1nXjQmwIGop08N4/354T3UaoLyLZA VMgybdPxvtVoOd//rrVzmIBRP29HoW0GCNPYIQx1M7iYdIIhbm3eAIwzj3OvUq/I1S+k l76Q== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of jglisse@redhat.com designates 209.132.183.28 as permitted sender) smtp.mailfrom=jglisse@redhat.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from mx1.redhat.com (mx1.redhat.com. [209.132.183.28]) by mx.google.com with ESMTPS id q25si682121qtq.186.2019.01.23.14.23.30 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 23 Jan 2019 14:23:30 -0800 (PST) Received-SPF: pass (google.com: domain of jglisse@redhat.com designates 209.132.183.28 as permitted sender) client-ip=209.132.183.28; Authentication-Results: mx.google.com; spf=pass (google.com: domain of jglisse@redhat.com designates 209.132.183.28 as permitted sender) smtp.mailfrom=jglisse@redhat.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 51D88C7E6F; Wed, 23 Jan 2019 22:23:29 +0000 (UTC) Received: from localhost.localdomain.com (ovpn-120-127.rdu2.redhat.com [10.10.120.127]) by smtp.corp.redhat.com (Postfix) with ESMTP id 3AE056C202; Wed, 23 Jan 2019 22:23:26 +0000 (UTC) From: jglisse@redhat.com To: linux-mm@kvack.org Cc: Andrew Morton , linux-kernel@vger.kernel.org, =?utf-8?b?SsOpcsO0bWUgR2xpc3Nl?= , =?utf-8?q?Christian_?= =?utf-8?q?K=C3=B6nig?= , Jan Kara , Felix Kuehling , Jason Gunthorpe , Matthew Wilcox , Ross Zwisler , Dan Williams , Paolo Bonzini , =?utf-8?b?UmFkaW0gS3LEjW3DocWZ?= , Michal Hocko , Ralph Campbell , John Hubbard , kvm@vger.kernel.org, dri-devel@lists.freedesktop.org, linux-rdma@vger.kernel.org, linux-fsdevel@vger.kernel.org, Arnd Bergmann Subject: [PATCH v4 0/9] mmu notifier provide context informations Date: Wed, 23 Jan 2019 17:23:06 -0500 Message-Id: <20190123222315.1122-1-jglisse@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.39]); Wed, 23 Jan 2019 22:23:29 +0000 (UTC) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP From: Jérôme Glisse Hi Andrew, i see that you still have my event patch in you queue [1]. This patchset replace that single patch and is broken down in further step so that it is easier to review and ascertain that no mistake were made during mechanical changes. Here are the step: Patch 1 - add the enum values Patch 2 - coccinelle semantic patch to convert all call site of mmu_notifier_range_init to default enum value and also to passing down the vma when it is available Patch 3 - update many call site to more accurate enum values Patch 4 - add the information to the mmu_notifier_range struct Patch 5 - helper to test if a range is updated to read only All the remaining patches are update to various driver to demonstrate how this new information get use by device driver. I build tested with make all and make all minus everything that enable mmu notifier ie building with MMU_NOTIFIER=no. Also tested with some radeon,amd gpu and intel gpu. If they are no objections i believe best plan would be to merge the the first 5 patches (all mm changes) through your queue for 5.1 and then to delay driver update to each individual driver tree for 5.2. This will allow each individual device driver maintainer time to more thouroughly test this more then my own testing. Note that i also intend to use this feature further in nouveau and HMM down the road. I also expect that other user like KVM might be interested into leveraging this new information to optimize some of there secondary page table invalidation. Here is an explaination on the rational for this patchset: CPU page table update can happens for many reasons, not only as a result of a syscall (munmap(), mprotect(), mremap(), madvise(), ...) but also as a result of kernel activities (memory compression, reclaim, migration, ...). This patch introduce a set of enums that can be associated with each of the events triggering a mmu notifier. Latter patches take advantages of those enum values. - UNMAP: munmap() or mremap() - CLEAR: page table is cleared (migration, compaction, reclaim, ...) - PROTECTION_VMA: change in access protections for the range - PROTECTION_PAGE: change in access protections for page in the range - SOFT_DIRTY: soft dirtyness tracking Being able to identify munmap() and mremap() from other reasons why the page table is cleared is important to allow user of mmu notifier to update their own internal tracking structure accordingly (on munmap or mremap it is not longer needed to track range of virtual address as it becomes invalid). [1] https://www.ozlabs.org/~akpm/mmotm/broken-out/mm-mmu_notifier-contextual-information-for-event-triggering-invalidation-v2.patch Cc: Christian König Cc: Jan Kara Cc: Felix Kuehling Cc: Jason Gunthorpe Cc: Andrew Morton Cc: Matthew Wilcox Cc: Ross Zwisler Cc: Dan Williams Cc: Paolo Bonzini Cc: Radim Krčmář Cc: Michal Hocko Cc: Ralph Campbell Cc: John Hubbard Cc: kvm@vger.kernel.org Cc: dri-devel@lists.freedesktop.org Cc: linux-rdma@vger.kernel.org Cc: linux-fsdevel@vger.kernel.org Cc: Arnd Bergmann Jérôme Glisse (9): mm/mmu_notifier: contextual information for event enums mm/mmu_notifier: contextual information for event triggering invalidation mm/mmu_notifier: use correct mmu_notifier events for each invalidation mm/mmu_notifier: pass down vma and reasons why mmu notifier is happening mm/mmu_notifier: mmu_notifier_range_update_to_read_only() helper gpu/drm/radeon: optimize out the case when a range is updated to read only gpu/drm/amdgpu: optimize out the case when a range is updated to read only gpu/drm/i915: optimize out the case when a range is updated to read only RDMA/umem_odp: optimize out the case when a range is updated to read only drivers/gpu/drm/amd/amdgpu/amdgpu_mn.c | 13 ++++++++ drivers/gpu/drm/i915/i915_gem_userptr.c | 16 ++++++++++ drivers/gpu/drm/radeon/radeon_mn.c | 13 ++++++++ drivers/infiniband/core/umem_odp.c | 22 +++++++++++-- fs/proc/task_mmu.c | 3 +- include/linux/mmu_notifier.h | 42 ++++++++++++++++++++++++- include/rdma/ib_umem_odp.h | 1 + kernel/events/uprobes.c | 3 +- mm/huge_memory.c | 14 +++++---- mm/hugetlb.c | 11 ++++--- mm/khugepaged.c | 3 +- mm/ksm.c | 6 ++-- mm/madvise.c | 3 +- mm/memory.c | 25 +++++++++------ mm/migrate.c | 5 ++- mm/mmu_notifier.c | 10 ++++++ mm/mprotect.c | 4 ++- mm/mremap.c | 3 +- mm/oom_kill.c | 3 +- mm/rmap.c | 6 ++-- 20 files changed, 171 insertions(+), 35 deletions(-)