From patchwork Thu Oct 17 21:14:10 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Andr=C3=A9_Almeida?= X-Patchwork-Id: 13840839 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7A478D3C537 for ; Thu, 17 Oct 2024 21:15:13 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 165436B0082; Thu, 17 Oct 2024 17:15:12 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 033DB6B0089; Thu, 17 Oct 2024 17:15:11 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id DC7C66B0085; Thu, 17 Oct 2024 17:15:11 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id B48F06B0083 for ; Thu, 17 Oct 2024 17:15:11 -0400 (EDT) Received: from smtpin04.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id BB0021416E2 for ; Thu, 17 Oct 2024 21:14:59 +0000 (UTC) X-FDA: 82684349412.04.54D103E Received: from fanzine2.igalia.com (fanzine.igalia.com [178.60.130.6]) by imf14.hostedemail.com (Postfix) with ESMTP id 76EF910000D for ; Thu, 17 Oct 2024 21:14:57 +0000 (UTC) Authentication-Results: imf14.hostedemail.com; dkim=pass header.d=igalia.com header.s=20170329 header.b="ETMR5/qn"; dmarc=pass (policy=none) header.from=igalia.com; spf=pass (imf14.hostedemail.com: domain of andrealmeid@igalia.com designates 178.60.130.6 as permitted sender) smtp.mailfrom=andrealmeid@igalia.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1729199676; a=rsa-sha256; cv=none; b=Snn7+qRKi2NKyLvftaHZuAlnswAsrCZKaij9SziR+n2Wk5NIh2WXJui43yBGYjzQdVCklv z6aYplmb3quihkYzMgQBIwAYsv8env1MDH42DKhzgRWDVopkFNyNhOoMWhbQ0Uf+p/kR/X EIOFsfuz3VsRL7hW25MKMCTEyWipv2M= ARC-Authentication-Results: i=1; imf14.hostedemail.com; dkim=pass header.d=igalia.com header.s=20170329 header.b="ETMR5/qn"; dmarc=pass (policy=none) header.from=igalia.com; spf=pass (imf14.hostedemail.com: domain of andrealmeid@igalia.com designates 178.60.130.6 as permitted sender) smtp.mailfrom=andrealmeid@igalia.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1729199676; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=yFvxl4u+NrwsH3O0LylcV+g04T8CwH6ZqZznLnPwQMM=; b=ivaqVfsO0T3FzKedw22Y6Up6U5eXmM9dnKXOvAEjoomEC2fIOdbmfDtQbHYb4Ue8VlyXAe bfTwTQzvjDjuQSBHiocr1Y2j7E6tqzEKPP/+jwxRScIqXcfERoimBtplc52aG1flQPi4Dr snhm1MIKzp6NPhoebQO739V8GRIL8QE= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=igalia.com; s=20170329; h=Cc:To:Content-Transfer-Encoding:Content-Type:MIME-Version: Message-Id:Date:Subject:From:Sender:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=yFvxl4u+NrwsH3O0LylcV+g04T8CwH6ZqZznLnPwQMM=; b=ETMR5/qn2EaBzFFbY1yveMqK8Q 8gsXVkYI6j9dPZGqD4JB1BihEKrAiWxem9SlIdHxqjTVUpv29ZLuoEtYArbaD7nSYBZlUReJPQ5bY d7y46CJNDnsTh++L7X9t3Bo9iW5TeahDjNYBVlnnRCzMnQ6ng1KIMx1u8xiQ0TihOLWaSoaU55jJX WdEtbLNvcvB64HMQi/glH65pXcvG1BKk9Q1DGufAvKm5a1ZoImrmOXrCzrmUzY7ZurGeO5tE2dNeJ VBY58GE5un1NGeLqWe9vB9J0Zd4J7GOApTj9L7rc3d6UT3qZO4JydU3o8HlpUjlkzGul83r/mFk7k 2aPvKI9Q==; Received: from [179.118.186.49] (helo=[192.168.15.100]) by fanzine2.igalia.com with esmtpsa (Cipher TLS1.3:ECDHE_X25519__RSA_PSS_RSAE_SHA256__AES_256_GCM:256) (Exim) id 1t1XpQ-00Bnlc-MA; Thu, 17 Oct 2024 23:14:40 +0200 From: =?utf-8?q?Andr=C3=A9_Almeida?= Subject: [PATCH v7 0/9] tmpfs: Add case-insensitive support for tmpfs Date: Thu, 17 Oct 2024 18:14:10 -0300 Message-Id: <20241017-tonyk-tmpfs-v7-0-a9c056f8391f@igalia.com> MIME-Version: 1.0 X-B4-Tracking: v=1; b=H4sIACJ+EWcC/23MSwrDIBSF4a2EO65FreTRUfdRMhC9Jpc2MahIQ 3DvtRl3+B843wERA2GEe3NAwEyR/FqjuzRgZr1OyMjWBsmlElxwlvy6v1haNheZswpFLwZxsxL qYwvo6HNqz7H2TDH5sJ94bn/rfye3jLNucFwjl6hM/6BJv0lfjV9gLKV8AS/4StKnAAAA X-Change-ID: 20241010-tonyk-tmpfs-fd4e181913d2 To: Gabriel Krisman Bertazi , Alexander Viro , Christian Brauner , Jan Kara , Theodore Ts'o , Andreas Dilger , Hugh Dickins , Andrew Morton , Jonathan Corbet , smcv@collabora.com Cc: kernel-dev@igalia.com, linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-ext4@vger.kernel.org, linux-mm@kvack.org, linux-doc@vger.kernel.org, Gabriel Krisman Bertazi , =?utf-8?q?Andr=C3=A9_Almeida?= X-Mailer: b4 0.14.2 X-Rspam-User: X-Stat-Signature: 8mraognhkw5b7xtdtppdq4pwzb3tfieb X-Rspamd-Queue-Id: 76EF910000D X-Rspamd-Server: rspam02 X-HE-Tag: 1729199697-12083 X-HE-Meta: U2FsdGVkX182anHV5I3wA7T3PD31BIHaypIYBYyIjjfJiencF26ZqswC8j2C1j3PZdt+CQvt2BAZWfBamStVUpDHPXjE74aFtFhZu/FGrgnecdWFcuOIsUN3nkIWSlrAZeo7ZJDijcjbMI2RTK1ADs81HlX4G82/shHGW1ia+DEH8U1heME+I1109vxinml/KPZ3haEv0+FKvY2WU2atgr+v90+JfWbPKVeSky3TnUubOSVR/S9OhYS5Rns2NlbTOEWUyeKIpnOxype2r7FJn3xDbjtWv/BpmmjgQACtZVD/2LByNYuwQ24RHtp8q7si5Fb6NADgR6J7/9isfBm1gi5PiA9/2CWzHOfli9pYd0gu14t7NQSvUmsnWEC8mBQ5mz9/mMZNKtbabMNQBV5h4v/rFea7R/zLw7rep7VZX6xA241r4lpF6oYvvaqQGH73atBT2UZW3RPmVnTrSnBWEE7MKPQoZxQYDjjPDZO52fnVksHyUysVJ9B/TGsfNSzm+anAsdcxdDAdOgYNinOgA6xUfI6YU9ssMesJA99qUtUeKpbmNuk44kFDa4WmLHq6gmXV8u6u5KODMHDzQn4IOPod3LhtekYQhlBRvdl2jPfQghQ+IE7VTWILk/39oh/xdIobok5fbXJNm95VfTGuU0tKW/FyZ3z5mkfJwDwUypp/dLhmgEMfFf8WPnR6PDDJ7fx0arHfKmS8ICkc7xA79Kr8gEwqs+nYWr2+khob4j6e9i659rRxLnn0xt8fSpfYjcZZWS/3Fe8RmddWnUiHHG/LE5OyayWI15Er9RIW11yJdl1niSA3K+h5cE/QwY1vCUZRAHyxBvzrvIl394NQ1gwG4E2X0E2Fuq85ukmk+hnrLdAaSBuWEWj8cQJuUxPBZNoeyVVaC0RbUrewHViXKLe9Fxbumc+qzg1g5XI3HRVFPFBTvviQAiWRDzBeJWaHYgrtN9QD7g1AaQCqak7 eEmsCj5B rDO4BBfKmD/JjKUMVLklnNGFLulV+bYLL8henfKMJc2+qDEUyLIdhjeoANdssKqyDXK9UesZ6vUPeySOMS5axhQ9Neba2zvoP0MC3yi85U/Z4KPp5EjQpmDwMl9AXnPUVERP2InEynNdrDDvN9lia90Le3TlIAFBOwsh0cL1uxqKeisn3kWUFPOCrhtEyxBMJgapr+1imrqJaQ18zFUi09gvYzqpo8ft3coNxB8Ff2PKGCEIvpLBKLGy0b+2Ohz59pp/gz0NqmJKAM0sIBrsh5VDgQAUrmnEQ5whh2VT+CJSSlbuhrGjvI2ONBV5h87hDQkl86wRBu1Fcpb/VHbcfaqUUZxyuFjwJ9v++V4q1rYV57Kk= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi, This patchset adds support for case-insensitive file names lookups in tmpfs. The main difference from other casefold filesystems is that tmpfs has no information on disk, just on RAM, so we can't use mkfs to create a case-insensitive tmpfs. For this implementation, I opted to have a mount option for casefolding. The rest of the patchset follows a similar approach as ext4 and f2fs. * Use case (from the original cover letter) The use case for this feature is similar to the use case for ext4, to better support compatibility layers (like Wine), particularly in combination with sandboxing/container tools (like Flatpak). Those containerization tools can share a subset of the host filesystem with an application. In the container, the root directory and any parent directories required for a shared directory are on tmpfs, with the shared directories bind-mounted into the container's view of the filesystem. If the host filesystem is using case-insensitive directories, then the application can do lookups inside those directories in a case-insensitive way, without this needing to be implemented in user-space. However, if the host is only sharing a subset of a case-insensitive directory with the application, then the parent directories of the mount point will be part of the container's root tmpfs. When the application tries to do case-insensitive lookups of those parent directories on a case-sensitive tmpfs, the lookup will fail. For example, if /srv/games is a case-insensitive directory on the host, then applications will expect /srv/games/Steam/Half-Life and /srv/games/steam/half-life to be interchangeable; but if the container framework is only sharing /srv/games/Steam/Half-Life and /srv/games/Steam/Portal (and not the rest of /srv/games) with the container, with /srv, /srv/games and /srv/games/Steam as part of the container's tmpfs root, then making /srv/games a case-insensitive directory inside the container would be necessary to meet that expectation. * Testing I send a patch for xfstests to enable the casefold test (generic/556) for tmpfs.[1] The test succeed. You can test this patchset using: sudo mount -t tmpfs -o casefold tmpfs mnt/ And making a dir case-insensitive: mkdir mnt/dir chattr +F mnt/dir [1] https://lore.kernel.org/fstests/20240823173008.280917-1-andrealmeid@igalia.com/ Changes in v7: - Fixed generic_ci_validate_strict_name() - Dropped patch "tmpfs: Always set simple_dentry_operations as dentry ops" - Re-place generic_ci_validate_strict_name() before inode creation v6: https://lore.kernel.org/r/20241010-tonyk-tmpfs-v6-0-79f0ae02e4c8@igalia.com Changes in v6: - Fixed kernel bot warning 'shmem_ci_dentry_ops' defined but not used v5: https://lore.kernel.org/lkml/20241002234444.398367-1-andrealmeid@igalia.com/ Changes in v5: - New patch "Always set simple_dentry_operations as dentry ops" - "Squashed libfs: Check for casefold dirs on simple_lookup()" into "tmpfs: Add casefold lookup support" - Fail to mount if strict_encoding is used without encoding - Inlined generic_ci_validate_strict_name() - Added IS_ENABLED(UNICODE) guards to public generic_ci_ funcs - Dropped .d_revalidate = fscrypt_d_revalidate, tmpfs doesn't support it v4: https://lore.kernel.org/lkml/20240911144502.115260-1-andrealmeid@igalia.com/ Changes in v4: - Got rid of shmem_lookup() and changed simple_lookup() to cover casefold use case - Simplified shmem_parse_opt_casefold() and how it handle the lastest_version option - Simplified utf8_parse_version() to return the version in one variable instead of three - Rewrote part of the documentation patch - Make sure that d_sb->s_d_op is set during mount time - Moved `generic_ci_always_del_dentry_ops` to mm/shmem.c as `shmem_ci_dentry_ops` v3: https://lore.kernel.org/lkml/20240905190252.461639-1-andrealmeid@igalia.com/ Changes in v3: - Renamed utf8_check_strict_name() to generic_ci_validate_strict_name(), and reworked the big if(...) to be more clear - Expose the latest UTF-8 version in include/linux/unicode.h - shmem_lookup() now sets d_ops - reworked shmem_parse_opt_casefold() - if `mount -o casefold` has no param, load latest UTF-8 version - using (IS_ENABLED(CONFIG_UNICODE) && IS_CASEFOLDED(dir) when possible - Fixed bug when adding a non-casefold flag in a non-empty dir v2: https://lore.kernel.org/lkml/20240902225511.757831-1-andrealmeid@igalia.com/ Changes in v2: - Found and fixed a bug in utf8_load() - Created a helper for checking strict file names (Krisman) - Merged patch 1/ and 3/ together (Krisman) - Reworded the explanation about d_compare (Krisman) - Removed bool casefold from shmem_sb_info (Krisman) - Reworked d_add(dentry, NULL) to be called as d_add(dentry, inode) (Krisman) - Moved utf8_parse_version to common unicode code - Fixed some smatch/sparse warnings (kernel test bot/Dan Carpenter) v1: https://lore.kernel.org/linux-fsdevel/20240823173332.281211-1-andrealmeid@igalia.com/ --- André Almeida (9): libfs: Create the helper function generic_ci_validate_strict_name() ext4: Use generic_ci_validate_strict_name helper unicode: Export latest available UTF-8 version number unicode: Recreate utf8_parse_version() libfs: Export generic_ci_ dentry functions tmpfs: Add casefold lookup support tmpfs: Add flag FS_CASEFOLD_FL support for tmpfs dirs tmpfs: Expose filesystem features via sysfs docs: tmpfs: Add casefold options Documentation/filesystems/tmpfs.rst | 24 ++++ fs/ext4/namei.c | 5 +- fs/libfs.c | 12 +- fs/unicode/utf8-core.c | 26 +++++ fs/unicode/utf8-selftest.c | 3 - include/linux/fs.h | 49 ++++++++ include/linux/shmem_fs.h | 6 +- include/linux/unicode.h | 4 + mm/shmem.c | 226 ++++++++++++++++++++++++++++++++++-- 9 files changed, 332 insertions(+), 23 deletions(-) --- base-commit: 6efbea77b390604a7be7364583e19cd2d6a1291b change-id: 20241010-tonyk-tmpfs-fd4e181913d2 Best regards,