From patchwork Thu Feb 2 11:29:09 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Muhammad Usama Anjum X-Patchwork-Id: 13125834 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C3F90C61DA4 for ; Thu, 2 Feb 2023 11:30:21 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 167576B0071; Thu, 2 Feb 2023 06:30:21 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 118536B0072; Thu, 2 Feb 2023 06:30:21 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id EFAE46B0078; Thu, 2 Feb 2023 06:30:20 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id DD4AF6B0071 for ; Thu, 2 Feb 2023 06:30:20 -0500 (EST) Received: from smtpin01.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id B1373140E48 for ; Thu, 2 Feb 2023 11:30:20 +0000 (UTC) X-FDA: 80422133400.01.9E2B66C Received: from madras.collabora.co.uk (madras.collabora.co.uk [46.235.227.172]) by imf05.hostedemail.com (Postfix) with ESMTP id D73AB100004 for ; Thu, 2 Feb 2023 11:30:18 +0000 (UTC) Authentication-Results: imf05.hostedemail.com; dkim=pass header.d=collabora.com header.s=mail header.b=bArOUvQD; dmarc=pass (policy=reject) header.from=collabora.com; spf=pass (imf05.hostedemail.com: domain of usama.anjum@collabora.com designates 46.235.227.172 as permitted sender) smtp.mailfrom=usama.anjum@collabora.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1675337419; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:references:dkim-signature; bh=s8gwkcsWqgV12BWRg/4c+3fGkWYpWCS17XL94D3K9DU=; b=lG8D/ckGqosg+R1bzLQS9MKDXCDPrUJ0GgceewRNdNJhg3RZSjskXKQNRAKVrsJXTSUf/i BoHBMt2elgVhrr1x+UZKbRut2sws02CxLeES0eigFav4tJw8LMBj42LhbFzeQDCsRF9X3L tg/BBvWSdJCuIwItNVUP5iUywZfHs3s= ARC-Authentication-Results: i=1; imf05.hostedemail.com; dkim=pass header.d=collabora.com header.s=mail header.b=bArOUvQD; dmarc=pass (policy=reject) header.from=collabora.com; spf=pass (imf05.hostedemail.com: domain of usama.anjum@collabora.com designates 46.235.227.172 as permitted sender) smtp.mailfrom=usama.anjum@collabora.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1675337419; a=rsa-sha256; cv=none; b=pWCNA7jG1WY0r1wtF0tYWv+/Id0HwHW+eamb0fD1aeY90UNtsXc4TcH5+klHS4vSLKV51O Yxf2vcoaNqFYqBFl/VPhoVqMYoKe9Sk93/hwZ+pifz3Un0dwi/ujdWqr9nngThPumSYRTQ ylnXKd/JPPm8RdU0HO569dkoo48Y3To= Received: from localhost.localdomain (unknown [39.45.165.226]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: usama.anjum) by madras.collabora.co.uk (Postfix) with ESMTPSA id A12A06602EEC; Thu, 2 Feb 2023 11:30:10 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1675337417; bh=Sn+J0//GD2CYqCQj0kwKHZnA2YvZMjkhZsSKlASriXE=; h=From:To:Cc:Subject:Date:From; b=bArOUvQDo1a2QC/uD++fyi8LTz5T8YI4L7hklX6CDeaqKOTpMBNiwIJh1mNk6Sjl2 htDi4LEbgvzCxFX5/dDW9nH57XllueUE9gwOdTAQMZUyqj1HJk74mBkpydA3d+sABb CMNCkhRqczIZQR5TaAV9kPhsMJ4Vu8dYBDG7k9gU/BTXfardEnsTLUlBOcmG2mlCVv +NpunAgqOa163lgu54S99JDyv9VkAQQ3ohh56Xlwm3XqMXmegBI11aPJg0OnMqVKOj I5wDdksAuEo/uycQ6wAtqkLbL7xSBKSRhulvTn6Q55mgcVieCUBFrtsO9ZogCjoRAw ofclkVCieYepg== From: Muhammad Usama Anjum To: Peter Xu , David Hildenbrand , Andrew Morton , =?utf-8?b?TWljaGHFgiBNaXJvc8WC?= =?utf-8?b?YXc=?= , Andrei Vagin , Danylo Mocherniuk , Paul Gofman , Cyrill Gorcunov Cc: Alexander Viro , Shuah Khan , Christian Brauner , Yang Shi , Vlastimil Babka , "Liam R . Howlett" , Yun Zhou , Suren Baghdasaryan , Alex Sierra , Muhammad Usama Anjum , Matthew Wilcox , Pasha Tatashin , Mike Rapoport , Nadav Amit , Axel Rasmussen , "Gustavo A . R . Silva" , Dan Williams , linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, linux-kselftest@vger.kernel.org, Greg KH , kernel@collabora.com Subject: [PATCH v10 0/6] Implement IOCTL to get and/or the clear info about PTEs Date: Thu, 2 Feb 2023 16:29:09 +0500 Message-Id: <20230202112915.867409-1-usama.anjum@collabora.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 X-Rspamd-Queue-Id: D73AB100004 X-Rspamd-Server: rspam09 X-Rspam-User: X-Stat-Signature: 7xkq58xxc6enb1gsd83k5y5ntbt3s9co X-HE-Tag: 1675337418-55414 X-HE-Meta: U2FsdGVkX18k266VP1g72/d2JFNYIexj2N2ZYjj9F5PseI7Wv2cSHI/u9/SDy1ttbCP1TvKQVVTLVa+7oeYoQPbCZmEWCoNLANg112B+sDCMemDDIOSNt7aapJp9CpX8zN2sZjEof/V0Wth/cqBxBtpEjsTBFucSl2xGiseXLwmlqrisw+CPf+wf2/VKp2fXUrVRDPfW1ZmYFNvAMR5ZQ1K75SmnxbLBbbsMkuqJAa011f48XE3q6+lHTcFxbfkDzMigNgQMyFGlSZyZfO8k083I3HyFGquAKpYo+k8/oZVVK0qr8/dtgYkvd+aDFsugeU2jhhTroGYreyeZqL5NjBeWnrdt/bLx2zagpAqWeJrx/c8vvp9MtAT7r2DL8USyUmtOvqkdKdiH8Jaiq1FCG86r5Ft4oX1pRxZIb7yI5Wxb5yY64zpD6S/cROK2yDiUAyOzZ/QuOW1MnT4KqZWb08yw/Jqcgm+ELxQuzj04Nxj3sqUZ8XZJU+YVeUpNL02BkoOU3iGvAF98OUK/wwDxB+PZMr1ov7P041kUPHbuM+1Zaap1AFQVyye0vC5KOHnlIR1+1FSPMcO3i40NL5oFVNTLIwiV5xS2ccs4hzpitdsgQZTP4NloqNnabYvXiTmI3DlRwxJzlEBgCnfaqjMcNbDyLg7d7Dq9GYwJ5CkhgDT0byZm+wT2epDJg43kcrkTiO94Bf9PdIv26mj5JElygt2h3Un3NqqCe6388ep8GNeWJDXbzFICqs9GuX2gxuomGTX7jEjKrRWuIOH582+XpTPDs3HIo/rp0nvLAh1u9AE9g5fhXRWuL6XJexQopa7Ijf3nz5JYfABVZYsPkinrkpOcZQ6h9TlQM44AOI4o13hNt2R40FjRALZjp817ufRUcpZFMVSwjsbup3fhW3eQBmdJjwpLyMTz5pE35GvxG4WRe/vy7FTyiT+hb6insBithsfO9u9z0UfaLTgY6oy +X1dkMaK utzpKliZ52qUfyJz4wBh8FLdOTLKdkorCXWEys31zSbeG0jI8smm1Q1jRQgfx6vsNtPGucjTdQN0Mx4Tcu4GcXqsW0Adwf6BYhYo3s4UfQT4fIJDJTZE+NKh4KqhwAdQ2RHgITV5T+p4mYcdJbbITMRXqSUdSO4gJwtD8tJ8VC9JXukx9Le8WP6YjyCsdg59HHtUVDY51GrrfU55n/kf6jugL4qgo7kW7FHoZT2cPjguZEgIkVzQ9WHuWhAlxz29HK1v7cYVcLNm6xCa/kJ7eWHq35J3hJUMY+a6TMdUTTcvdVJXUe1TonUhV+Uy0ZhNBw94JX5L584L4TS7vbcotpHYEl/wkpcn0M7TnKr+GTpdlYpEpnoGI4T5uRw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: *Changes in v10* - Add specific condition to return error if hugetlb is used with wp async - Move changes in tools/include/uapi/linux/fs.h to separate patch - Add documentation *Changes in v9:* - Correct fault resolution for userfaultfd wp async - Fix build warnings and errors which were happening on some configs - Simplify pagemap ioctl's code *Changes in v8:* - Update uffd async wp implementation - Improve PAGEMAP_IOCTL implementation *Changes in v7:* - Add uffd wp async - Update the IOCTL to use uffd under the hood instead of soft-dirty flags Hello, Note: Soft-dirty pages and pages which have been written-to are synonyms. As kernel already has soft-dirty feature inside which we have given up to use, we are using written-to terminology while using UFFD async WP under the hood. This IOCTL, PAGEMAP_SCAN on pagemap file can be used to get and/or clear the info about page table entries. The following operations are supported in this ioctl: - Get the information if the pages have been written-to (PAGE_IS_WRITTEN), file mapped (PAGE_IS_FILE), present (PAGE_IS_PRESENT) or swapped (PAGE_IS_SWAPPED). - Write-protect the pages (PAGEMAP_WP_ENGAGE) to start finding which pages have been written-to. - Find pages which have been written-to and write protect the pages (atomic PAGE_IS_WRITTEN + PAGEMAP_WP_ENGAGE) It is possible to find and clear soft-dirty pages entirely in userspace. But it isn't efficient: - The mprotect and SIGSEGV handler for bookkeeping - The userfaultfd wp (synchronous) with the handler for bookkeeping Some benchmarks can be seen here[1]. This series adds features that weren't present earlier: - There is no atomic get soft-dirty/Written-to status and clear present in the kernel. - The pages which have been written-to can not be found in accurate way. (Kernel's soft-dirty PTE bit + sof_dirty VMA bit shows more soft-dirty pages than there actually are.) Historically, soft-dirty PTE bit tracking has been used in the CRIU project. The procfs interface is enough for finding the soft-dirty bit status and clearing the soft-dirty bit of all the pages of a process. We have the use case where we need to track the soft-dirty PTE bit for only specific pages on-demand. We need this tracking and clear mechanism of a region of memory while the process is running to emulate the getWriteWatch() syscall of Windows. *(Moved to using UFFD instead of soft-dirtyi feature to find pages which have been written-to from v7 patch series)*: Stop using the soft-dirty flags for finding which pages have been written to. It is too delicate and wrong as it shows more soft-dirty pages than the actual soft-dirty pages. There is no interest in correcting it [2][3] as this is how the feature was written years ago. It shouldn't be updated to changed behaviour. Peter Xu has suggested using the async version of the UFFD WP [4] as it is based inherently on the PTEs. So in this patch series, I've added a new mode to the UFFD which is asynchronous version of the write protect. When this variant of the UFFD WP is used, the page faults are resolved automatically by the kernel. The pages which have been written-to can be found by reading pagemap file (!PM_UFFD_WP). This feature can be used successfully to find which pages have been written to from the time the pages were write protected. This works just like the soft-dirty flag without showing any extra pages which aren't soft-dirty in reality. The information related to pages if the page is file mapped, present and swapped is required for the CRIU project [5][6]. The addition of the required mask, any mask, excluded mask and return masks are also required for the CRIU project [5]. The IOCTL returns the addresses of the pages which match the specific masks. The page addresses are returned in struct page_region in a compact form. The max_pages is needed to support a use case where user only wants to get a specific number of pages. So there is no need to find all the pages of interest in the range when max_pages is specified. The IOCTL returns when the maximum number of the pages are found. The max_pages is optional. If max_pages is specified, it must be equal or greater than the vec_size. This restriction is needed to handle worse case when one page_region only contains info of one page and it cannot be compacted. This is needed to emulate the Windows getWriteWatch() syscall. The patch series include the detailed selftest which can be used as an example for the uffd async wp test and PAGEMAP_IOCTL. It shows the interface usages as well. [1] https://lore.kernel.org/lkml/54d4c322-cd6e-eefd-b161-2af2b56aae24@collabora.com/ [2] https://lore.kernel.org/all/20221220162606.1595355-1-usama.anjum@collabora.com [3] https://lore.kernel.org/all/20221122115007.2787017-1-usama.anjum@collabora.com [4] https://lore.kernel.org/all/Y6Hc2d+7eTKs7AiH@x1n [5] https://lore.kernel.org/all/YyiDg79flhWoMDZB@gmail.com/ [6] https://lore.kernel.org/all/20221014134802.1361436-1-mdanylo@google.com/ Regards, Muhammad Usama Anjum Muhammad Usama Anjum (6): userfaultfd: Add UFFD WP Async support userfaultfd: update documentation to describe UFFD_FEATURE_WP_ASYNC fs/proc/task_mmu: Implement IOCTL to get and/or the clear info about PTEs tools headers UAPI: Update linux/fs.h with the kernel sources mm/pagemap: add documentation of PAGEMAP_SCAN IOCTL selftests: vm: add pagemap ioctl tests Documentation/admin-guide/mm/pagemap.rst | 24 + Documentation/admin-guide/mm/userfaultfd.rst | 7 + fs/proc/task_mmu.c | 290 ++++++ fs/userfaultfd.c | 20 +- include/linux/userfaultfd_k.h | 11 + include/uapi/linux/fs.h | 50 ++ include/uapi/linux/userfaultfd.h | 10 +- mm/memory.c | 23 +- tools/include/uapi/linux/fs.h | 50 ++ tools/testing/selftests/vm/.gitignore | 1 + tools/testing/selftests/vm/Makefile | 5 +- tools/testing/selftests/vm/pagemap_ioctl.c | 881 +++++++++++++++++++ 12 files changed, 1364 insertions(+), 8 deletions(-) create mode 100644 tools/testing/selftests/vm/pagemap_ioctl.c