mbox series

[GIT,PULL] Btrfs updates for 6.14

Message ID cover.1737393999.git.dsterba@suse.com (mailing list archive)
State New
Headers show
Series [GIT,PULL] Btrfs updates for 6.14 | expand

Pull-request

git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git tags/for-6.14-tag

Message

David Sterba Jan. 20, 2025, 5:41 p.m. UTC 
Hi,

please pull the following updates to btrfs. There are some new features
or feature previews, the reset the usual mix of core changes.  There's
also one minor rb-tree API update.

Please pull, thanks.

User visible changes, features:

- rebuilding of the free space tree at mount time is done in more
  transactions, fix potential hangs when the transaction thread is
  blocked due to large amount of block groups

- more read IO balancing strategies (experimental config), add two new
  ways how to select a device for read if the profiles allow that (all RAID1*),
  the current default selects the device by pid which is good on average
  but less performant for single reader workloads

  - select preferred device for all reads (namely for testing)
  - round-robin, balance reads across devices relevant for the requested IO
    range

- add encoded write ioctl support to io_uring (read was added in 6.12), basis
  for writing send stream using that instead of syscalls, non-blocking
  mode is not yet implemented

- support FS_IOC_READ_VERITY_METADATA, applications can use the metadata to do
  their own verification

- pass inode's i_write_hint to bios, for parity with other filesystems, ioctls
  F_GET_RW_HINT/F_SET_RW_HINT

Core:

- in zoned mode: allow to directly reclaim a block group by simply resetting
  it, then it can be reused and another block group does not need to be
  allocated

- super block validation now also does more comprehensive sys array validation,
  adding it to the points where superblock is validated (post-read, pre-write)

- subpage mode fixes
  - fix double accounting of blocks due to some races
  - improved or fixed error handling in a few cases (compression, delalloc)

- raid stripe tree
  - fix various cases with extent range splitting or deleting
  - implement hole punching to extent range
  - reduce number of stripe tree lookups during bio submission
  - more self-tests

- updated self-tests (delayed refs)

- error handling improvements

- cleanups, refactoring
  - remove rest of backref caching infrastructure from relocation, not needed
    anymore
  - error message updates
  - remove unnecessary calls when extent buffer was marked dirty
  - unused parameter removal
  - code moved to new files

Other code changes: add rb_find_add_cached() to the rb-tree API

----------------------------------------------------------------
The following changes since commit 5bc55a333a2f7316b58edc7573e8e893f7acb532:

  Linux 6.13-rc7 (2025-01-12 14:37:56 -0800)

are available in the Git repository at:

  git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux.git tags/for-6.14-tag

for you to fetch changes up to 9d0c23db26cb58c9fc6ee8817e8f9ebeb25776e5:

  btrfs: selftests: add a selftest for deleting two out of three extents (2025-01-14 15:57:55 +0100)

----------------------------------------------------------------
Allison Karlitskaya (1):
      btrfs: handle FS_IOC_READ_VERITY_METADATA ioctl

Anand Jain (10):
      btrfs: initialize fs_devices->fs_info earlier in btrfs_init_devices_late()
      btrfs: sysfs: refactor output formatting in btrfs_read_policy_show()
      btrfs: sysfs: add btrfs_read_policy_to_enum() helper and refactor read policy store
      btrfs: sysfs: handle value associated with read balancing policy
      btrfs: add tracking of read blocks for read policy
      btrfs: introduce RAID1 round-robin read balancing
      btrfs: add read policy to set a preferred device
      btrfs: print status of experimental mode when loading module
      btrfs: configure read policy via module parameter
      btrfs: print read policy on module load

Colin Ian King (1):
      btrfs: send: remove redundant assignments to variable ret

David Sterba (18):
      btrfs: drop unused parameter fs_info to btrfs_delete_delayed_insertion_item()
      btrfs: remove stray comment about SRCU
      btrfs: use SECTOR_SIZE defines in btrfs_issue_discard()
      btrfs: rename __unlock_for_delalloc() and drop underscores
      btrfs: open code set_page_extent_mapped()
      btrfs: rename __get_extent_map() and pass btrfs_inode
      btrfs: use btrfs_inode in extent_writepage()
      btrfs: make wait_on_extent_buffer_writeback() static inline
      btrfs: drop one time used local variable in end_bbio_meta_write()
      btrfs: open code __free_extent_buffer()
      btrfs: rename btrfs_release_extent_buffer_pages() to mention folios
      btrfs: switch grab_extent_buffer() to folios
      btrfs: change return type to bool type of check_eb_alignment()
      btrfs: unwrap folio locking helpers
      btrfs: remove unused define WAIT_PAGE_LOCK for extent io
      btrfs: split waiting from read_extent_buffer_pages(), drop parameter wait
      btrfs: remove redundant variables from __process_folios_contig() and lock_delalloc_folios()
      btrfs: async-thread: rename DFT_THRESHOLD to DEFAULT_THRESHOLD

Filipe Manana (38):
      btrfs: remove no longer needed strict argument from can_nocow_extent()
      btrfs: remove the snapshot check from check_committed_ref()
      btrfs: avoid redundant call to get inline ref type at check_committed_ref()
      btrfs: simplify return logic at check_committed_ref()
      btrfs: simplify arguments for btrfs_cross_ref_exist()
      btrfs: add function comment for check_committed_ref()
      btrfs: add assertions and comment about path expectations to btrfs_cross_ref_exist()
      btrfs: move abort_should_print_stack() to transaction.h
      btrfs: move csum related functions from ctree.c into fs.c
      btrfs: move the exclusive operation functions into fs.c
      btrfs: move btrfs_is_empty_uuid() from ioctl.c into fs.c
      btrfs: move the folio ordered helpers from ctree.h into fs.h
      btrfs: move BTRFS_BYTES_TO_BLKS() into fs.h
      btrfs: move btrfs_alloc_write_mask() into fs.h
      btrfs: move extent-tree function declarations out of ctree.h
      btrfs: remove pointless comment from ctree.h
      btrfs: use uuid_is_null() to verify if an uuid is empty
      btrfs: uncollapse transaction aborts during renames
      btrfs: tree-log: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: free-space-tree: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: extent-tree: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: block-group: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: delayed-inode: remove unnecessary call to btrfs_mark_buffer_dirty()
      btrfs: dev-replace: remove unnecessary call to btrfs_mark_buffer_dirty()
      btrfs: dir-item: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: file: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: file-item: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: free-space-cache: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: inode: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: inode-item: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: ioctl: remove unnecessary call to btrfs_mark_buffer_dirty()
      btrfs: qgroup: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: raid-stripe-tree: remove unnecessary call to btrfs_mark_buffer_dirty()
      btrfs: relocation: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: root-tree: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: uuid-tree: remove unnecessary call to btrfs_mark_buffer_dirty()
      btrfs: volumes: remove unnecessary calls to btrfs_mark_buffer_dirty()
      btrfs: xattr: remove unnecessary call to btrfs_mark_buffer_dirty()

Hao-ran Zheng (1):
      btrfs: fix data race when accessing the inode's disk_i_size at btrfs_drop_extents()

Jing Xia (1):
      btrfs: pass write-hint for buffered IO

Johannes Thumshirn (19):
      btrfs: don't BUG_ON() in btrfs_drop_extents()
      btrfs: remove unused variable length in btrfs_insert_one_raid_extent()
      btrfs: cache stripe tree usage in struct btrfs_io_geometry
      btrfs: cache RAID stripe tree decision in btrfs_io_context
      btrfs: pass btrfs_io_geometry to is_single_device_io
      btrfs: selftests: correct RAID stripe-tree feature flag setting
      btrfs: don't try to delete RAID stripe-extents if we don't need to
      btrfs: assert RAID stripe-extent length is always greater than 0
      btrfs: fix front delete range calculation for RAID stripe extents
      btrfs: fix tail delete of RAID stripe-extents
      btrfs: fix deletion of a range spanning parts two RAID stripe extents
      btrfs: implement hole punching for RAID stripe extents
      btrfs: don't use btrfs_set_item_key_safe on RAID stripe-extents
      btrfs: selftests: check for correct return value of failed lookup
      btrfs: selftests: don't split RAID extents in half
      btrfs: selftests: test RAID stripe-tree deletion spanning two items
      btrfs: selftests: add selftest for punching holes into the RAID stripe extents
      btrfs: selftests: add test for punching a hole into 3 RAID stripe-extents
      btrfs: selftests: add a selftest for deleting two out of three extents

Josef Bacik (12):
      btrfs: move select_delayed_ref() and export it
      btrfs: selftests: add delayed ref self test cases
      btrfs: convert BUG_ON in btrfs_reloc_cow_block() to proper error handling
      btrfs: remove the changed list for backref cache
      btrfs: add a comment for new_bytenr in backref_cache_node
      btrfs: simplify loop in select_reloc_root()
      btrfs: remove clone_backref_node() from relocation
      btrfs: don't build backref tree for COW-only blocks
      btrfs: do not handle non-shareable roots in backref cache
      btrfs: simplify btrfs_backref_release_cache()
      btrfs: remove the ->lowest and ->leaves members from struct btrfs_backref_node
      btrfs: remove detached list from struct btrfs_backref_cache

Mark Harmstone (1):
      btrfs: add io_uring interface for encoded writes

Naohiro Aota (3):
      btrfs: factor out btrfs_return_free_space()
      btrfs: drop fs_info argument from btrfs_update_space_info_*()
      btrfs: zoned: reclaim unused zone by zone resetting

Qu Wenruo (15):
      btrfs: use PTR_ERR() instead of PTR_ERR_OR_ZERO() for btrfs_get_extent()
      btrfs: improve the warning and error message for btrfs_remove_qgroup()
      btrfs: open-code btrfs_copy_from_user()
      btrfs: output the reason for open_ctree() failure
      btrfs: handle free space tree rebuild in multiple transactions
      btrfs: validate system chunk array at btrfs_validate_super()
      btrfs: fix double accounting race when btrfs_run_delalloc_range() failed
      btrfs: fix double accounting race when extent_writepage_io() failed
      btrfs: fix error handling of submit_uncompressed_range()
      btrfs: do proper folio cleanup when cow_file_range() failed
      btrfs: do proper folio cleanup when run_delalloc_nocow() failed
      btrfs: subpage: fix the bitmap dump of the locked flags
      btrfs: subpage: dump the involved bitmap when ASSERT() failed
      btrfs: add extra error messages for delalloc range related errors
      btrfs: remove the unused locked_folio parameter from btrfs_cleanup_ordered_extents()

Roger L. Beckermeyer III (6):
      rbtree: add rb_find_add_cached() to rbtree.h
      btrfs: update btrfs_add_block_group_cache() to use rb helper
      btrfs: update prelim_ref_insert() to use rb helpers
      btrfs: update __btrfs_add_delayed_item() to use rb helper
      btrfs: update btrfs_add_chunk_map() to use rb helpers
      btrfs: update tree_insert() to use rb helpers

Wolfram Sang (1):
      btrfs: don't include linux/rwlock_types.h directly

 fs/btrfs/Makefile                       |    2 +-
 fs/btrfs/async-thread.c                 |    6 +-
 fs/btrfs/backref.c                      |  172 ++----
 fs/btrfs/backref.h                      |   16 +-
 fs/btrfs/bio.c                          |   11 +-
 fs/btrfs/block-group.c                  |   64 +-
 fs/btrfs/block-rsv.c                    |   10 +-
 fs/btrfs/btrfs_inode.h                  |    2 +-
 fs/btrfs/ctree.c                        |   68 +--
 fs/btrfs/ctree.h                        |   29 -
 fs/btrfs/delalloc-space.c               |    2 +-
 fs/btrfs/delayed-inode.c                |   49 +-
 fs/btrfs/delayed-ref.c                  |   89 ++-
 fs/btrfs/delayed-ref.h                  |    1 +
 fs/btrfs/dev-replace.c                  |    3 -
 fs/btrfs/dir-item.c                     |    2 -
 fs/btrfs/direct-io.c                    |    3 +-
 fs/btrfs/disk-io.c                      |   75 ++-
 fs/btrfs/disk-io.h                      |    3 -
 fs/btrfs/extent-tree.c                  |  202 +++---
 fs/btrfs/extent-tree.h                  |    7 +-
 fs/btrfs/extent_io.c                    |  250 +++++---
 fs/btrfs/extent_io.h                    |   16 +-
 fs/btrfs/file-item.c                    |    3 -
 fs/btrfs/file.c                         |  106 ++--
 fs/btrfs/free-space-cache.c             |    7 +-
 fs/btrfs/free-space-tree.c              |   11 +-
 fs/btrfs/fs.c                           |  130 ++++
 fs/btrfs/fs.h                           |   31 +-
 fs/btrfs/inode-item.c                   |    5 -
 fs/btrfs/inode.c                        |  325 ++++++----
 fs/btrfs/ioctl.c                        |  222 ++++---
 fs/btrfs/ioctl.h                        |    1 -
 fs/btrfs/locking.h                      |    5 +
 fs/btrfs/qgroup.c                       |   39 +-
 fs/btrfs/raid-stripe-tree.c             |  146 ++++-
 fs/btrfs/relocation.c                   |  369 +++++------
 fs/btrfs/root-tree.c                    |    2 -
 fs/btrfs/send.c                         |    3 +-
 fs/btrfs/space-info.c                   |   69 ++-
 fs/btrfs/space-info.h                   |   15 +-
 fs/btrfs/subpage.c                      |   47 +-
 fs/btrfs/subpage.h                      |   13 +
 fs/btrfs/super.c                        |   20 +-
 fs/btrfs/sysfs.c                        |  174 +++++-
 fs/btrfs/sysfs.h                        |    6 +
 fs/btrfs/tests/btrfs-tests.c            |   18 +
 fs/btrfs/tests/btrfs-tests.h            |    6 +
 fs/btrfs/tests/delayed-refs-tests.c     | 1015 +++++++++++++++++++++++++++++++
 fs/btrfs/tests/raid-stripe-tree-tests.c |  661 +++++++++++++++++++-
 fs/btrfs/transaction.c                  |    3 +-
 fs/btrfs/transaction.h                  |   18 +-
 fs/btrfs/tree-checker.c                 |   96 +--
 fs/btrfs/tree-checker.h                 |    7 +-
 fs/btrfs/tree-log.c                     |    4 -
 fs/btrfs/uuid-tree.c                    |    2 -
 fs/btrfs/volumes.c                      |  240 +++++---
 fs/btrfs/volumes.h                      |   21 +
 fs/btrfs/xattr.c                        |    1 -
 fs/btrfs/zoned.c                        |  124 ++++
 fs/btrfs/zoned.h                        |    7 +
 include/linux/rbtree.h                  |   37 ++
 include/trace/events/btrfs.h            |    3 +-
 63 files changed, 3751 insertions(+), 1343 deletions(-)
 create mode 100644 fs/btrfs/tests/delayed-refs-tests.c