From patchwork Sat Sep 18 01:31:12 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 12503389 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.4 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A2692C433FE for ; Sat, 18 Sep 2021 01:31:14 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 8EBAC6113A for ; Sat, 18 Sep 2021 01:31:14 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236103AbhIRBcg (ORCPT ); Fri, 17 Sep 2021 21:32:36 -0400 Received: from mail.kernel.org ([198.145.29.99]:37686 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S235837AbhIRBcf (ORCPT ); Fri, 17 Sep 2021 21:32:35 -0400 Received: by mail.kernel.org (Postfix) with ESMTPSA id 7969E6112E; Sat, 18 Sep 2021 01:31:12 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1631928672; bh=dwXjDu+phlqB4nQNRy2B7qsNjeqxx6Rsk+wlMEte3mk=; h=Subject:From:To:Cc:Date:In-Reply-To:References:From; b=sdplwT0LTfyOJzNVQq+giKfA32wbHqeVECf7JBVHmJ+TUbocTvVPnfBRvazXnzJa1 QgW5+NcJGSnAIeQDQSpnZiUBGHxdNFOf/IMSeW6PEaal3Q7WYD+oCcLTV9q+ZtDsB9 F53dzBbGANEHddzN2xnyakFt5M0jkY4wgivcVrLmb6IBhch9DTWDU32cgN7S830I1+ qhatlsQv4XT1WMPy5GGHduYSXppHCHPSAWYeWyOfIt/T0sxs8jlTi5j13hgyfaaN1R 0+ayTBDxj38KRRt3m9pvkrJShXH32fmrSojNDjC6r/p85CFA/03H3m69bSecmog0c3 N+N7jA6fbB8Tg== Subject: [PATCH 5/5] ext4: implement FALLOC_FL_ZEROINIT_RANGE From: "Darrick J. Wong" To: djwong@kernel.org, jane.chu@oracle.com Cc: linux-xfs@vger.kernel.org, hch@infradead.org, dan.j.williams@intel.com, linux-fsdevel@vger.kernel.org Date: Fri, 17 Sep 2021 18:31:12 -0700 Message-ID: <163192867220.417973.4913917281472586603.stgit@magnolia> In-Reply-To: <163192864476.417973.143014658064006895.stgit@magnolia> References: <163192864476.417973.143014658064006895.stgit@magnolia> User-Agent: StGit/0.19 MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org From: Darrick J. Wong Implement this new fallocate mode so that persistent memory users can, upon receipt of a pmem poison notification, cause the pmem to be reinitialized to a known value (zero) and clear any hardware poison state that might be lurking. Signed-off-by: Darrick J. Wong --- fs/ext4/extents.c | 93 +++++++++++++++++++++++++++++++++++++++++++ include/trace/events/ext4.h | 7 +++ 2 files changed, 99 insertions(+), 1 deletion(-) diff --git a/fs/ext4/extents.c b/fs/ext4/extents.c index c0de30f25185..c345002e2da6 100644 --- a/fs/ext4/extents.c +++ b/fs/ext4/extents.c @@ -29,6 +29,7 @@ #include #include #include +#include #include "ext4_jbd2.h" #include "ext4_extents.h" #include "xattr.h" @@ -4475,6 +4476,90 @@ static int ext4_collapse_range(struct inode *inode, loff_t offset, loff_t len); static int ext4_insert_range(struct inode *inode, loff_t offset, loff_t len); +static long ext4_zeroinit_range(struct file *file, loff_t offset, loff_t len) +{ + struct inode *inode = file_inode(file); + struct address_space *mapping = inode->i_mapping; + handle_t *handle = NULL; + loff_t end = offset + len; + long ret; + + trace_ext4_zeroinit_range(inode, offset, len, + FALLOC_FL_ZEROINIT_RANGE | FALLOC_FL_KEEP_SIZE); + + /* We don't support data=journal mode */ + if (ext4_should_journal_data(inode)) + return -EOPNOTSUPP; + + inode_lock(inode); + + /* + * Indirect files do not support unwritten extents + */ + if (!(ext4_test_inode_flag(inode, EXT4_INODE_EXTENTS))) { + ret = -EOPNOTSUPP; + goto out_mutex; + } + + /* Wait all existing dio workers, newcomers will block on i_mutex */ + inode_dio_wait(inode); + + /* + * Prevent page faults from reinstantiating pages we have released from + * page cache. + */ + filemap_invalidate_lock(mapping); + + ret = ext4_break_layouts(inode); + if (ret) + goto out_mmap; + + /* Now release the pages and zero block aligned part of pages */ + truncate_pagecache_range(inode, offset, end - 1); + inode->i_mtime = inode->i_ctime = current_time(inode); + + if (IS_DAX(inode)) + ret = dax_zeroinit_range(inode, offset, len, + &ext4_iomap_report_ops); + else + ret = iomap_zeroout_range(inode, offset, len, + &ext4_iomap_report_ops); + if (ret == -ECANCELED) + ret = -EOPNOTSUPP; + if (ret) + goto out_mmap; + + /* + * In worst case we have to writeout two nonadjacent unwritten + * blocks and update the inode + */ + handle = ext4_journal_start(inode, EXT4_HT_MISC, 1); + if (IS_ERR(handle)) { + ret = PTR_ERR(handle); + ext4_std_error(inode->i_sb, ret); + goto out_mmap; + } + + inode->i_mtime = inode->i_ctime = current_time(inode); + ret = ext4_mark_inode_dirty(handle, inode); + if (unlikely(ret)) + goto out_handle; + ext4_fc_track_range(handle, inode, offset >> inode->i_sb->s_blocksize_bits, + (offset + len - 1) >> inode->i_sb->s_blocksize_bits); + ext4_update_inode_fsync_trans(handle, inode, 1); + + if (file->f_flags & O_SYNC) + ext4_handle_sync(handle); + +out_handle: + ext4_journal_stop(handle); +out_mmap: + filemap_invalidate_unlock(mapping); +out_mutex: + inode_unlock(inode); + return ret; +} + static long ext4_zero_range(struct file *file, loff_t offset, loff_t len, int mode) { @@ -4659,7 +4744,7 @@ long ext4_fallocate(struct file *file, int mode, loff_t offset, loff_t len) /* Return error if mode is not supported */ if (mode & ~(FALLOC_FL_KEEP_SIZE | FALLOC_FL_PUNCH_HOLE | FALLOC_FL_COLLAPSE_RANGE | FALLOC_FL_ZERO_RANGE | - FALLOC_FL_INSERT_RANGE)) + FALLOC_FL_INSERT_RANGE | FALLOC_FL_ZEROINIT_RANGE)) return -EOPNOTSUPP; ext4_fc_start_update(inode); @@ -4687,6 +4772,12 @@ long ext4_fallocate(struct file *file, int mode, loff_t offset, loff_t len) ret = ext4_zero_range(file, offset, len, mode); goto exit; } + + if (mode & FALLOC_FL_ZEROINIT_RANGE) { + ret = ext4_zeroinit_range(file, offset, len); + goto exit; + } + trace_ext4_fallocate_enter(inode, offset, len, mode); lblk = offset >> blkbits; diff --git a/include/trace/events/ext4.h b/include/trace/events/ext4.h index 0ea36b2b0662..282f1208067f 100644 --- a/include/trace/events/ext4.h +++ b/include/trace/events/ext4.h @@ -1407,6 +1407,13 @@ DEFINE_EVENT(ext4__fallocate_mode, ext4_zero_range, TP_ARGS(inode, offset, len, mode) ); +DEFINE_EVENT(ext4__fallocate_mode, ext4_zeroinit_range, + + TP_PROTO(struct inode *inode, loff_t offset, loff_t len, int mode), + + TP_ARGS(inode, offset, len, mode) +); + TRACE_EVENT(ext4_fallocate_exit, TP_PROTO(struct inode *inode, loff_t offset, unsigned int max_blocks, int ret),