From patchwork Tue Jun 18 01:08:59 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mike Snitzer X-Patchwork-Id: 13701659 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id E12594C6D for ; Tue, 18 Jun 2024 01:09:18 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1718672959; cv=none; b=afvXcbj4Qd6pvaW8gYebUGJpWSguj9h/6uCh4AOlGh/sk7Bo4pxITvrL+zpLX8gohgDr+SpvomALmlwa+0LN4C9qYULjay3eoln0H1tsT+odkHvVBH1C2D4QzVlHtsF7+ChuUbxgdQaLfQSnuLt1KlRb8pJ0/RSHlsPoHJogjLY= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1718672959; c=relaxed/simple; bh=UooQFJ27BZLQiG4U4/ysamM6S9EzxvqmphIyiXnNHiE=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=cCPs/mKBvTyc4mxeCabmBdkDVs5AbUM4ag2zgUYPk1uQm2OrjKYmC60k7BvbsS8oLgwg9p+JMsYg1RtEzNIV62sTyQVjCkrpwum601OZ7V4h5HAGSL6lnD2+TqfwYl0aScF1PY2Zk3JRRTfZK1oLW9IzENnnvLX765xp3RrQxvA= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=VAPz69sx; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="VAPz69sx" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 3E3C5C2BD10; Tue, 18 Jun 2024 01:09:18 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1718672958; bh=UooQFJ27BZLQiG4U4/ysamM6S9EzxvqmphIyiXnNHiE=; h=From:To:Cc:Subject:Date:From; b=VAPz69sxMJLhIFnL7xtpjD7W707ziEXw/FhicWKBijpUUlOgEWSVql7OJdm0YQl1Q Lp/Lum41QzwukxBJ94KmysGTk2sI8opS2eldHSHuLod5BsyYVMonS/Q8fRP1+uy25a ExVfbBVcwSzXABMrtJas7XIyeJJTuMF1O2PzJVBURhOOlyp0hMMIR6wsjz6P7SsPQi b8HaY/iU4uluXGpQwSrNcc7uW8a0KwVosLFk48OCJiAsYqHrwEgIMQaPt6teQi9dqR oGDSF5NAVKtRDHXz2RDnysaTWIJd8yDUIf1caKQq918EiamM8Pd0ShOKJunpG1I57k lSuFHPdhJGCQQ== From: Mike Snitzer To: linux-nfs@vger.kernel.org Cc: Jeff Layton , Chuck Lever , Trond Myklebust , NeilBrown , snitzer@hammerspace.com, axboe@kernel.dk Subject: [PATCH v4 00/18] nfs/nfsd: add support for localio Date: Mon, 17 Jun 2024 21:08:59 -0400 Message-ID: <20240618010917.23385-1-snitzer@kernel.org> X-Mailer: git-send-email 2.44.0 Precedence: bulk X-Mailing-List: linux-nfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Hi, This v4 fixes a few bugs in v3, reorders patches and improves patch headers and code documentation. Please pay particular attention to patches 17 and 18. If all looks good to others, for v5 I can rebase to the -next trees for nfs and nfsd. My git tree is here: https://git.kernel.org/pub/scm/linux/kernel/git/snitzer/linux.git/ This v4 is both branch nfs-localio-for-6.11 (always tracks latest) and nfs-localio-for-6.11.v4 nfs-localio-for-6.11.v3, nfs-localio-for-6.11.v2 and nfs-localio-for-6.11.v1 are also there. To see the changes from v3 to v4 please do: git remote add snitzer git://git.kernel.org/pub/scm/linux/kernel/git/snitzer/linux.git git remote update snitzer git diff snitzer/nfs-localio-for-6.11.v3 snitzer/nfs-localio-for-6.11.v4 These changes have proven stable against various test scenarios: 1) client and server both on localhost (for both v3 and v4.2) 2) various permutations of client and server support enablement for both local and remote client and server. 3) client on host, server within a container (for both v3 and v4.2) My container testing was in terms of podman managed containers. 4) container stop/restart scenario documented in the last patch All review and comments are welcome! Thanks, Mike Mike Snitzer (10): nfs_common: add NFS LOCALIO protocol extension enablement nfs: implement v3 and v4 client support for NFS_LOCALIO_PROGRAM nfsd: implement v3 and v4 server support for NFS_LOCALIO_PROGRAM nfs/nfsd: consolidate {encode,decode}_opaque_fixed in nfs_xdr.h nfs/localio: move managing nfsd_open_local_fh symbol to nfs_common nfs/nfsd: ensure localio server always uses its network namespace nfsd/localio: manage netns reference in nfsd_open_local_fh nfsd: prepare to use SRCU to dereference nn->nfsd_serv nfsd: use SRCU to dereference nn->nfsd_serv nfsd/localio: use SRCU to dereference nn->nfsd_serv in nfsd_open_local_fh Trond Myklebust (3): NFS: Enable localio for non-pNFS I/O pnfs/flexfiles: Enable localio for flexfiles I/O nfs/localio: use dedicated workqueues for filesystem read and write Weston Andros Adamson (5): nfs: pass nfs_client to nfs_initiate_pgio nfs: pass descriptor thru nfs_initiate_pgio path nfs: pass struct file to nfs_init_pgio and nfs_init_commit sunrpc: add rpcauth_map_to_svc_cred_local nfs/nfsd: add "localio" support fs/Kconfig | 3 + fs/nfs/Kconfig | 30 + fs/nfs/Makefile | 1 + fs/nfs/blocklayout/blocklayout.c | 6 +- fs/nfs/client.c | 15 +- fs/nfs/filelayout/filelayout.c | 16 +- fs/nfs/flexfilelayout/flexfilelayout.c | 131 +++- fs/nfs/flexfilelayout/flexfilelayout.h | 2 + fs/nfs/flexfilelayout/flexfilelayoutdev.c | 6 + fs/nfs/inode.c | 61 +- fs/nfs/internal.h | 88 ++- fs/nfs/localio.c | 850 ++++++++++++++++++++++ fs/nfs/nfs3_fs.h | 1 + fs/nfs/nfs3client.c | 25 + fs/nfs/nfs3proc.c | 3 + fs/nfs/nfs3xdr.c | 58 ++ fs/nfs/nfs4_fs.h | 2 + fs/nfs/nfs4client.c | 23 + fs/nfs/nfs4proc.c | 3 + fs/nfs/nfs4xdr.c | 65 +- fs/nfs/nfstrace.h | 61 ++ fs/nfs/pagelist.c | 32 +- fs/nfs/pnfs.c | 24 +- fs/nfs/pnfs.h | 6 +- fs/nfs/pnfs_nfs.c | 2 +- fs/nfs/write.c | 13 +- fs/nfs_common/Makefile | 3 + fs/nfs_common/nfslocalio.c | 71 ++ fs/nfsd/Kconfig | 30 + fs/nfsd/Makefile | 1 + fs/nfsd/filecache.c | 15 +- fs/nfsd/localio.c | 398 ++++++++++ fs/nfsd/netns.h | 16 +- fs/nfsd/nfs4state.c | 25 +- fs/nfsd/nfsctl.c | 28 +- fs/nfsd/nfsd.h | 11 + fs/nfsd/nfssvc.c | 176 ++++- fs/nfsd/trace.h | 3 +- fs/nfsd/vfs.h | 9 + fs/nfsd/xdr.h | 6 + include/linux/nfs.h | 2 + include/linux/nfs_fs.h | 2 + include/linux/nfs_fs_sb.h | 9 + include/linux/nfs_xdr.h | 31 +- include/linux/nfslocalio.h | 61 ++ include/linux/sunrpc/auth.h | 4 + include/uapi/linux/nfs.h | 4 + net/sunrpc/auth.c | 15 + 48 files changed, 2305 insertions(+), 142 deletions(-) create mode 100644 fs/nfs/localio.c create mode 100644 fs/nfs_common/nfslocalio.c create mode 100644 fs/nfsd/localio.c create mode 100644 include/linux/nfslocalio.h