pull-request: bpf-next 2024-03-11

Pull-request

https://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next.git tags/for-netdev

Message

Alexei Starovoitov March 12, 2024, 12:36 a.m. UTC

Hi David, hi Jakub, hi Paolo, hi Eric,

The following pull-request contains BPF updates for your *net-next* tree.

We've added 59 non-merge commits during the last 9 day(s) which contain
a total of 88 files changed, 4181 insertions(+), 590 deletions(-).

The main changes are:

1) Enforce VM_IOREMAP flag and range in ioremap_page_range and introduce
   VM_SPARSE kind and vm_area_[un]map_pages to be used in bpf_arena,
   from Alexei.

2) Introduce bpf_arena which is sparse shared memory region between bpf
   program and user space where structures inside the arena can have
   pointers to other areas of the arena, and pointers work seamlessly for
   both user-space programs and bpf programs, from Alexei and Andrii.

3) Introduce may_goto instruction that is a contract between the verifier
   and the program. The verifier allows the program to loop assuming it's
   behaving well, but reserves the right to terminate it, from Alexei.

4) Use IETF format for field definitions in the BPF standard
   document, from Dave.

5) Extend struct_ops libbpf APIs to allow specify version suffixes for
   stuct_ops map types, share the same BPF program between several map
   definitions, and other improvements, from Eduard.

6) Enable struct_ops support for more than one page in trampolines,
   from Kui-Feng.

7) Support kCFI + BPF on riscv64, from Puranjay.

8) Use bpf_prog_pack for arm64 bpf trampoline, from Puranjay.

9) Fix roundup_pow_of_two undefined behavior on 32-bit archs, from Toke.

Please consider pulling these changes from:

  git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next.git tags/for-netdev

Note, there will be a trivial conflict in verifier_iterating_callbacks.c
take both hunks.

Thanks a lot!

Also thanks to reporters, reviewers and testers of commits in this pull-request:

Andrii Nakryiko, Barret Rhoden, Björn Töpel, Bui Quang Minh, Christoph 
Hellwig, David Vernet, Eduard Zingerman, Jiri Olsa, John Fastabend, 
"kernelci.org bot", kernel test robot, Kumar Kartikeya Dwivedi, Miguel 
Ojeda, Pasha Tatashin, Pu Lehui, Quentin Monnet, Stanislav Fomichev, 
Yonghong Song

----------------------------------------------------------------

The following changes since commit 4b2765ae410abf01154cf97876384d8a58c43953:

  Merge tag 'for-netdev' of https://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next (2024-03-02 20:50:59 -0800)

are available in the Git repository at:

  https://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next.git tags/for-netdev

for you to fetch changes up to 66c8473135c62f478301a0e5b3012f203562dfa6:

  bpf: move sleepable flag from bpf_prog_aux to bpf_prog (2024-03-11 16:41:25 -0700)

----------------------------------------------------------------
for-netdev

----------------------------------------------------------------
Alexei Starovoitov (26):
      mm: Enforce VM_IOREMAP flag and range in ioremap_page_range.
      mm: Introduce VM_SPARSE kind and vm_area_[un]map_pages().
      bpf: Introduce may_goto instruction
      bpf: Recognize that two registers are safe when their ranges match
      bpf: Add cond_break macro
      selftests/bpf: Test may_goto
      bpf: Allow kfuncs return 'void *'
      bpf: Recognize '__map' suffix in kfunc arguments
      bpf: Plumb get_unmapped_area() callback into bpf_map_ops
      libbpf: Allow specifying 64-bit integers in map BTF.
      bpf: Tell bpf programs kernel's PAGE_SIZE
      Merge branch 'fix-hash-bucket-overflow-checks-for-32-bit-arches'
      mm: Introduce vmap_page_range() to map pages in PCI address space
      bpf: Introduce bpf_arena.
      bpf: Disasm support for addr_space_cast instruction.
      bpf: Add x86-64 JIT support for PROBE_MEM32 pseudo instructions.
      bpf: Add x86-64 JIT support for bpf_addr_space_cast instruction.
      bpf: Recognize addr_space_cast instruction in the verifier.
      bpf: Recognize btf_decl_tag("arg: Arena") as PTR_TO_ARENA.
      libbpf: Add __arg_arena to bpf_helpers.h
      libbpf: Add support for bpf_arena.
      bpftool: Recognize arena map type
      bpf: Add helper macro bpf_addr_space_cast()
      selftests/bpf: Add unit tests for bpf_arena_alloc/free_pages
      selftests/bpf: Add bpf_arena_list test.
      selftests/bpf: Add bpf_arena_htab test.

Andrii Nakryiko (9):
      selftests/bpf: Extend uprobe/uretprobe triggering benchmarks
      Merge branch 'mm-enforce-ioremap-address-space-and-introduce-sparse-vm_area'
      Merge branch 'bpf-introduce-may_goto-and-cond_break'
      Merge branch 'libbpf-type-suffixes-and-autocreate-flag-for-struct_ops-maps'
      bpftool: rename is_internal_mmapable_map into is_mmapable_map
      selftests/bpf: Add fexit and kretprobe triggering benchmarks
      libbpf: Recognize __arena global variables.
      Merge branch 'bpf-introduce-bpf-arena'
      bpf: move sleepable flag from bpf_prog_aux to bpf_prog

Chen Shen (1):
      libbpf: Correct debug message in btf__load_vmlinux_btf

Dave Thaler (2):
      bpf, docs: Use IETF format for field definitions in instruction-set.rst
      bpf, docs: Rename legacy conformance group to packet

Eduard Zingerman (15):
      libbpf: Allow version suffixes (___smth) for struct_ops types
      libbpf: Tie struct_ops programs to kernel BTF ids, not to local ids
      libbpf: Honor autocreate flag for struct_ops maps
      selftests/bpf: Test struct_ops map definition with type suffix
      selftests/bpf: Utility functions to capture libbpf log in test_progs
      selftests/bpf: Bad_struct_ops test
      selftests/bpf: Test autocreate behavior for struct_ops maps
      libbpf: Sync progs autoload with maps autocreate for struct_ops maps
      selftests/bpf: Verify struct_ops autoload/autocreate sync
      libbpf: Replace elf_state->st_ops_* fields with SEC_ST_OPS sec_type
      libbpf: Struct_ops in SEC("?.struct_ops") / SEC("?.struct_ops.link")
      libbpf: Rewrite btf datasec names starting from '?'
      selftests/bpf: Test case for SEC("?.struct_ops")
      bpf: Allow all printable characters in BTF DATASEC names
      selftests/bpf: Test cases for '?' in BTF names

Jiri Olsa (1):
      selftests/bpf: Add kprobe multi triggering benchmarks

Kui-Feng Lee (3):
      bpf, net: validate struct_ops when updating value.
      bpf: struct_ops supports more than one page for trampolines.
      selftests/bpf: Test struct_ops maps with a large number of struct_ops program.

Martin KaFai Lau (2):
      Merge branch 'Allow struct_ops maps with a large number of programs'
      Merge branch 'bpf: arena prerequisites'

Puranjay Mohan (3):
      bpf, riscv64/cfi: Support kCFI + BPF on riscv64
      arm64, bpf: Use bpf_prog_pack for arm64 bpf trampoline
      bpf: hardcode BPF_PROG_PACK_SIZE to 2MB * num_possible_nodes()

Song Yoong Siang (1):
      selftests/bpf: xdp_hw_metadata reduce sleep interval

Toke Høiland-Jørgensen (3):
      bpf: Fix DEVMAP_HASH overflow check on 32-bit arches
      bpf: Fix hashtab overflow check on 32-bit arches
      bpf: Fix stackmap overflow check on 32-bit arches

 .../bpf/standardization/instruction-set.rst        | 535 +++++++++++---------
 arch/arm/mm/ioremap.c                              |   8 +-
 arch/arm64/net/bpf_jit_comp.c                      |  55 +-
 arch/loongarch/kernel/setup.c                      |   2 +-
 arch/mips/loongson64/init.c                        |   2 +-
 arch/powerpc/kernel/isa-bridge.c                   |   4 +-
 arch/riscv/include/asm/cfi.h                       |  17 +
 arch/riscv/kernel/cfi.c                            |  53 ++
 arch/riscv/net/bpf_jit.h                           |   2 +-
 arch/riscv/net/bpf_jit_comp32.c                    |   2 +-
 arch/riscv/net/bpf_jit_comp64.c                    |  14 +-
 arch/riscv/net/bpf_jit_core.c                      |   9 +-
 arch/x86/net/bpf_jit_comp.c                        | 231 ++++++++-
 drivers/pci/pci.c                                  |   4 +-
 include/linux/bpf.h                                |  25 +-
 include/linux/bpf_types.h                          |   1 +
 include/linux/bpf_verifier.h                       |   3 +
 include/linux/filter.h                             |   4 +
 include/linux/io.h                                 |   7 +
 include/linux/vmalloc.h                            |   5 +
 include/uapi/linux/bpf.h                           |  19 +
 kernel/bpf/Makefile                                |   3 +
 kernel/bpf/arena.c                                 | 558 +++++++++++++++++++++
 kernel/bpf/bpf_iter.c                              |   4 +-
 kernel/bpf/bpf_struct_ops.c                        | 141 ++++--
 kernel/bpf/btf.c                                   |  35 +-
 kernel/bpf/core.c                                  |  33 +-
 kernel/bpf/devmap.c                                |  11 +-
 kernel/bpf/disasm.c                                |  14 +
 kernel/bpf/hashtab.c                               |  14 +-
 kernel/bpf/log.c                                   |   3 +
 kernel/bpf/stackmap.c                              |   9 +-
 kernel/bpf/syscall.c                               |  64 ++-
 kernel/bpf/trampoline.c                            |   4 +-
 kernel/bpf/verifier.c                              | 366 +++++++++++---
 kernel/events/core.c                               |   2 +-
 kernel/trace/bpf_trace.c                           |   2 +-
 mm/vmalloc.c                                       |  83 ++-
 net/bpf/bpf_dummy_struct_ops.c                     |  14 +-
 net/ipv4/tcp_cong.c                                |   6 +-
 tools/bpf/bpftool/Documentation/bpftool-map.rst    |   2 +-
 tools/bpf/bpftool/gen.c                            |  31 +-
 tools/bpf/bpftool/map.c                            |   2 +-
 tools/include/uapi/linux/bpf.h                     |  19 +
 tools/lib/bpf/bpf_helpers.h                        |   2 +
 tools/lib/bpf/btf.c                                |   2 +-
 tools/lib/bpf/features.c                           |  22 +
 tools/lib/bpf/libbpf.c                             | 416 ++++++++++++---
 tools/lib/bpf/libbpf.h                             |   2 +-
 tools/lib/bpf/libbpf_internal.h                    |   2 +
 tools/lib/bpf/libbpf_probes.c                      |   7 +
 tools/testing/selftests/bpf/DENYLIST.aarch64       |   2 +
 tools/testing/selftests/bpf/DENYLIST.s390x         |   3 +
 tools/testing/selftests/bpf/Makefile               |   2 +-
 tools/testing/selftests/bpf/bench.c                |  28 +-
 tools/testing/selftests/bpf/benchs/bench_trigger.c | 182 +++++--
 .../selftests/bpf/benchs/run_bench_uprobes.sh      |   9 +
 tools/testing/selftests/bpf/bpf_arena_alloc.h      |  67 +++
 tools/testing/selftests/bpf/bpf_arena_common.h     |  70 +++
 tools/testing/selftests/bpf/bpf_arena_htab.h       | 100 ++++
 tools/testing/selftests/bpf/bpf_arena_list.h       |  92 ++++
 tools/testing/selftests/bpf/bpf_experimental.h     |  55 ++
 .../selftests/bpf/bpf_testmod/bpf_testmod.c        |  26 +
 .../selftests/bpf/bpf_testmod/bpf_testmod.h        |  48 ++
 .../testing/selftests/bpf/prog_tests/arena_htab.c  |  88 ++++
 .../testing/selftests/bpf/prog_tests/arena_list.c  |  68 +++
 .../selftests/bpf/prog_tests/bad_struct_ops.c      |  67 +++
 tools/testing/selftests/bpf/prog_tests/btf.c       |  29 ++
 .../bpf/prog_tests/struct_ops_autocreate.c         | 159 ++++++
 .../bpf/prog_tests/test_struct_ops_module.c        |  33 +-
 .../bpf/prog_tests/test_struct_ops_multi_pages.c   |  30 ++
 tools/testing/selftests/bpf/prog_tests/verifier.c  |   2 +
 tools/testing/selftests/bpf/progs/arena_htab.c     |  48 ++
 tools/testing/selftests/bpf/progs/arena_htab_asm.c |   5 +
 tools/testing/selftests/bpf/progs/arena_list.c     |  87 ++++
 tools/testing/selftests/bpf/progs/bad_struct_ops.c |  25 +
 .../testing/selftests/bpf/progs/bad_struct_ops2.c  |  14 +
 .../selftests/bpf/progs/struct_ops_autocreate.c    |  52 ++
 .../selftests/bpf/progs/struct_ops_autocreate2.c   |  32 ++
 .../selftests/bpf/progs/struct_ops_module.c        |  21 +-
 .../selftests/bpf/progs/struct_ops_multi_pages.c   | 102 ++++
 tools/testing/selftests/bpf/progs/trigger_bench.c  |  28 ++
 tools/testing/selftests/bpf/progs/verifier_arena.c | 146 ++++++
 .../bpf/progs/verifier_iterating_callbacks.c       | 103 +++-
 tools/testing/selftests/bpf/test_loader.c          |   9 +-
 tools/testing/selftests/bpf/test_progs.c           |  59 +++
 tools/testing/selftests/bpf/test_progs.h           |   3 +
 tools/testing/selftests/bpf/xdp_hw_metadata.c      |   2 +-
 88 files changed, 4181 insertions(+), 590 deletions(-)
 create mode 100644 kernel/bpf/arena.c
 create mode 100755 tools/testing/selftests/bpf/benchs/run_bench_uprobes.sh
 create mode 100644 tools/testing/selftests/bpf/bpf_arena_alloc.h
 create mode 100644 tools/testing/selftests/bpf/bpf_arena_common.h
 create mode 100644 tools/testing/selftests/bpf/bpf_arena_htab.h
 create mode 100644 tools/testing/selftests/bpf/bpf_arena_list.h
 create mode 100644 tools/testing/selftests/bpf/prog_tests/arena_htab.c
 create mode 100644 tools/testing/selftests/bpf/prog_tests/arena_list.c
 create mode 100644 tools/testing/selftests/bpf/prog_tests/bad_struct_ops.c
 create mode 100644 tools/testing/selftests/bpf/prog_tests/struct_ops_autocreate.c
 create mode 100644 tools/testing/selftests/bpf/prog_tests/test_struct_ops_multi_pages.c
 create mode 100644 tools/testing/selftests/bpf/progs/arena_htab.c
 create mode 100644 tools/testing/selftests/bpf/progs/arena_htab_asm.c
 create mode 100644 tools/testing/selftests/bpf/progs/arena_list.c
 create mode 100644 tools/testing/selftests/bpf/progs/bad_struct_ops.c
 create mode 100644 tools/testing/selftests/bpf/progs/bad_struct_ops2.c
 create mode 100644 tools/testing/selftests/bpf/progs/struct_ops_autocreate.c
 create mode 100644 tools/testing/selftests/bpf/progs/struct_ops_autocreate2.c
 create mode 100644 tools/testing/selftests/bpf/progs/struct_ops_multi_pages.c
 create mode 100644 tools/testing/selftests/bpf/progs/verifier_arena.c

Comments

[e-mail] March 12, 2024, 1:50 a.m. UTC | #1

Hello:

This pull request was applied to netdev/net-next.git (main)
by Jakub Kicinski <[e-mail]>:

On Mon, 11 Mar 2024 17:36:46 -0700 you wrote:
> Hi David, hi Jakub, hi Paolo, hi Eric,
> 
> The following pull-request contains BPF updates for your *net-next* tree.
> 
> We've added 59 non-merge commits during the last 9 day(s) which contain
> a total of 88 files changed, 4181 insertions(+), 590 deletions(-).
> 
> [...]

Here is the summary with links:
  - pull-request: bpf-next 2024-03-11
    https://git.kernel.org/netdev/net-next/c/5f20e6ab1f65

You are awesome, thank you!