pull-request: bpf-next 2024-06-06

Pull-request

https://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next.git tags/for-netdev

Message

Daniel Borkmann June 6, 2024, 10:31 p.m. UTC

Hi David, hi Jakub, hi Paolo, hi Eric,

The following pull-request contains BPF updates for your *net-next* tree.

We've added 54 non-merge commits during the last 10 day(s) which contain
a total of 50 files changed, 1887 insertions(+), 527 deletions(-).

The main changes are:

1) Add a user space notification mechanism via epoll when a struct_ops object
   is getting detached/unregistered, from Kui-Feng Lee.

2) Big batch of BPF selftest refactoring for sockmap and BPF congctl tests,
   from Geliang Tang.

3) Add BTF field (type and string fields, right now) iterator support to libbpf
   instead of using existing callback-based approaches, from Andrii Nakryiko.

4) Extend BPF selftests for the latter with a new btf_field_iter selftest,
   from Alan Maguire.

5) Add new kfuncs for a generic, open-coded bits iterator, from Yafang Shao.

6) Fix BPF selftests' kallsyms_find() helper under kernels configured with
   CONFIG_LTO_CLANG_THIN, from Yonghong Song.

7) Remove a bunch of unused structs in BPF selftests, from David Alan Gilbert.

8) Convert test_sockmap section names into names understood by libbpf so it
   can deduce program type and attach type, from Jakub Sitnicki.

9) Extend libbpf with the ability to configure log verbosity via LIBBPF_LOG_LEVEL
   environment variable, from Mykyta Yatsenko.

10) Fix BPF selftests with regards to bpf_cookie and find_vma flakiness
    in nested VMs, from Song Liu.

11) Extend riscv32/64 JITs to introduce shift/add helpers to generate Zba
    optimization, from Xiao Wang.

12) Enable BPF programs to declare arrays and struct fields with kptr,
    bpf_rb_root, and bpf_list_head, from Kui-Feng Lee.

Please consider pulling these changes from:

  git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next.git tags/for-netdev

Thanks a lot!

Also thanks to reporters, reviewers and testers of commits in this pull-request:

Alan Maguire, Alexei Starovoitov, Björn Töpel, Eduard Zingerman, Jakub 
Sitnicki, Jiri Olsa, John Fastabend, Lennart Poettering, Quentin Monnet

----------------------------------------------------------------

The following changes since commit 4b3529edbb8ff069d762c6947e055e10c1748170:

  Merge tag 'for-netdev' of https://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next (2024-05-28 07:27:29 -0700)

are available in the Git repository at:

  https://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next.git tags/for-netdev

for you to fetch changes up to f85af9d955ac9601174e1c64f4b3308c1cae4a7e:

  selftests/bpf: Drop useless arguments of do_test in bpf_tcp_ca (2024-06-06 23:04:06 +0200)

----------------------------------------------------------------
bpf-next-for-netdev

----------------------------------------------------------------
Alan Maguire (1):
      selftests/bpf: Add btf_field_iter selftests

Alexei Starovoitov (1):
      Merge branch 'enable-bpf-programs-to-declare-arrays-of-kptr-bpf_rb_root-and-bpf_list_head'

Andrii Nakryiko (7):
      Merge branch 'bpf-add-a-generic-bits-iterator'
      libbpf: keep FD_CLOEXEC flag when dup()'ing FD
      libbpf: Add BTF field iterator
      libbpf: Make use of BTF field iterator in BPF linker code
      libbpf: Make use of BTF field iterator in BTF handling code
      bpftool: Use BTF field iterator in btfgen
      libbpf: Remove callback-based type/string BTF field visitor helpers

Dr. David Alan Gilbert (3):
      selftests/bpf: Remove unused struct 'scale_test_def'
      selftests/bpf: Remove unused 'key_t' structs
      selftests/bpf: Remove unused struct 'libcap'

Geliang Tang (18):
      selftests/bpf: Drop struct post_socket_opts
      selftests/bpf: Add start_server_str helper
      selftests/bpf: Use post_socket_cb in connect_to_fd_opts
      selftests/bpf: Use post_socket_cb in start_server_str
      selftests/bpf: Use start_server_str in do_test in bpf_tcp_ca
      selftests/bpf: Fix tx_prog_fd values in test_sockmap
      selftests/bpf: Drop duplicate definition of i in test_sockmap
      selftests/bpf: Use bpf_link attachments in test_sockmap
      selftests/bpf: Replace tx_prog_fd with tx_prog in test_sockmap
      selftests/bpf: Drop prog_fd array in test_sockmap
      selftests/bpf: Fix size of map_fd in test_sockmap
      selftests/bpf: Check length of recv in test_sockmap
      selftests/bpf: Drop duplicate bpf_map_lookup_elem in test_sockmap
      selftests/bpf: Use connect_to_fd_opts in do_test in bpf_tcp_ca
      selftests/bpf: Add start_test helper in bpf_tcp_ca
      selftests/bpf: Use start_test in test_dctcp_fallback in bpf_tcp_ca
      selftests/bpf: Use start_test in test_dctcp in bpf_tcp_ca
      selftests/bpf: Drop useless arguments of do_test in bpf_tcp_ca

Jakub Sitnicki (1):
      selftests/bpf: use section names understood by libbpf in test_sockmap

Jeff Johnson (1):
      test_bpf: Add missing MODULE_DESCRIPTION()

Kui-Feng Lee (15):
      bpf: pass bpf_struct_ops_link to callbacks in bpf_struct_ops.
      bpf: enable detaching links of struct_ops objects.
      bpf: support epoll from bpf struct_ops links.
      bpf: export bpf_link_inc_not_zero.
      selftests/bpf: test struct_ops with epoll
      bpftool: Change pid_iter.bpf.c to comply with the change of bpf_link_fops.
      bpf: Remove unnecessary checks on the offset of btf_field.
      bpf: Remove unnecessary call to btf_field_type_size().
      bpf: refactor btf_find_struct_field() and btf_find_datasec_var().
      bpf: create repeated fields for arrays.
      bpf: look into the types of the fields of a struct type recursively.
      bpf: limit the number of levels of a nested struct type.
      selftests/bpf: Test kptr arrays and kptrs in nested struct fields.
      selftests/bpf: Test global bpf_rb_root arrays and fields in nested struct types.
      selftests/bpf: Test global bpf_list_head arrays.

Martin KaFai Lau (2):
      Merge branch 'use network helpers, part 5'
      Merge branch 'Notify user space when a struct_ops object is detached/unregistered'

Mykyta Yatsenko (2):
      libbpf: Configure log verbosity with env variable
      libbpf: Auto-attach struct_ops BPF maps in BPF skeleton

Song Liu (1):
      selftests/bpf: Fix bpf_cookie and find_vma in nested VM

Swan Beaujard (1):
      bpftool: Fix typo in MAX_NUM_METRICS macro name

Xiao Wang (1):
      riscv, bpf: Introduce shift add helper with Zba optimization

Yafang Shao (2):
      bpf: Add bits iterator
      selftests/bpf: Add selftest for bits iter

Yonghong Song (2):
      selftests/bpf: Ignore .llvm.<hash> suffix in kallsyms_find()
      selftests/bpf: Fix send_signal test with nested CONFIG_PARAVIRT

 Documentation/bpf/libbpf/libbpf_overview.rst       |   8 +
 arch/riscv/net/bpf_jit.h                           |  33 +++
 arch/riscv/net/bpf_jit_comp32.c                    |   3 +-
 arch/riscv/net/bpf_jit_comp64.c                    |   9 +-
 include/linux/bpf.h                                |  13 +-
 kernel/bpf/bpf_struct_ops.c                        |  75 ++++-
 kernel/bpf/btf.c                                   | 310 ++++++++++++-------
 kernel/bpf/helpers.c                               | 119 ++++++++
 kernel/bpf/syscall.c                               |  34 ++-
 kernel/bpf/verifier.c                              |   4 +-
 lib/test_bpf.c                                     |   1 +
 net/bpf/bpf_dummy_struct_ops.c                     |   4 +-
 net/ipv4/bpf_tcp_ca.c                              |   6 +-
 tools/bpf/bpftool/gen.c                            |  52 +++-
 tools/bpf/bpftool/skeleton/pid_iter.bpf.c          |   7 +-
 tools/bpf/bpftool/skeleton/profiler.bpf.c          |  14 +-
 tools/lib/bpf/btf.c                                | 328 ++++++++++++---------
 tools/lib/bpf/libbpf.c                             |  89 +++++-
 tools/lib/bpf/libbpf.h                             |  23 +-
 tools/lib/bpf/libbpf.map                           |   2 +
 tools/lib/bpf/libbpf_internal.h                    |  36 ++-
 tools/lib/bpf/linker.c                             |  58 ++--
 .../bpf/bpf_test_no_cfi/bpf_test_no_cfi.c          |   4 +-
 .../selftests/bpf/bpf_testmod/bpf_testmod.c        |   6 +-
 tools/testing/selftests/bpf/network_helpers.c      |  32 +-
 tools/testing/selftests/bpf/network_helpers.h      |   8 +-
 .../testing/selftests/bpf/prog_tests/bpf_cookie.c  |   2 +-
 .../testing/selftests/bpf/prog_tests/bpf_tcp_ca.c  | 196 ++++++++----
 .../selftests/bpf/prog_tests/bpf_verif_scale.c     |   6 -
 .../selftests/bpf/prog_tests/btf_field_iter.c      | 161 ++++++++++
 tools/testing/selftests/bpf/prog_tests/cpumask.c   |   5 +
 tools/testing/selftests/bpf/prog_tests/find_vma.c  |   4 +-
 .../testing/selftests/bpf/prog_tests/linked_list.c |  12 +
 tools/testing/selftests/bpf/prog_tests/rbtree.c    |  47 +++
 .../testing/selftests/bpf/prog_tests/send_signal.c |   3 +-
 .../selftests/bpf/prog_tests/sockopt_inherit.c     |   2 +-
 .../bpf/prog_tests/test_struct_ops_module.c        |  57 ++++
 tools/testing/selftests/bpf/prog_tests/verifier.c  |   2 +
 .../selftests/bpf/progs/bpf_iter_bpf_array_map.c   |   6 -
 .../bpf/progs/bpf_iter_bpf_percpu_array_map.c      |   6 -
 .../testing/selftests/bpf/progs/cpumask_success.c  | 171 +++++++++++
 tools/testing/selftests/bpf/progs/linked_list.c    |  42 +++
 tools/testing/selftests/bpf/progs/rbtree.c         |  77 +++++
 .../selftests/bpf/progs/struct_ops_detach.c        |  10 +
 .../selftests/bpf/progs/test_sockmap_kern.h        |  20 +-
 .../selftests/bpf/progs/verifier_bits_iter.c       | 153 ++++++++++
 tools/testing/selftests/bpf/test_sockmap.c         | 132 ++++-----
 .../selftests/bpf/test_tcp_check_syncookie_user.c  |   4 +-
 tools/testing/selftests/bpf/test_verifier.c        |   5 -
 tools/testing/selftests/bpf/trace_helpers.c        |  13 +-
 50 files changed, 1887 insertions(+), 527 deletions(-)
 create mode 100644 tools/testing/selftests/bpf/prog_tests/btf_field_iter.c
 create mode 100644 tools/testing/selftests/bpf/progs/struct_ops_detach.c
 create mode 100644 tools/testing/selftests/bpf/progs/verifier_bits_iter.c

Comments

[e-mail] June 11, 2024, 1:40 a.m. UTC | #1

Hello:

This pull request was applied to netdev/net-next.git (main)
by Jakub Kicinski <[e-mail]>:

On Fri,  7 Jun 2024 00:31:46 +0200 you wrote:
> Hi David, hi Jakub, hi Paolo, hi Eric,
> 
> The following pull-request contains BPF updates for your *net-next* tree.
> 
> We've added 54 non-merge commits during the last 10 day(s) which contain
> a total of 50 files changed, 1887 insertions(+), 527 deletions(-).
> 
> [...]

Here is the summary with links:
  - pull-request: bpf-next 2024-06-06
    https://git.kernel.org/netdev/net-next/c/b1156532bc29

You are awesome, thank you!