[v2,rdma-core,00/10] libhns: Add support for Dynamic Context Attachment

Message

Wenpeng Liang July 27, 2021, 3:27 a.m. UTC

The HIP09 introduces the DCA(Dynamic Context Attachment) feature which
supports many RC QPs to share the WQE buffer in a memory pool. If a QP
enables DCA feature, the WQE's buffer will not be allocated when creating
but when the users start to post WRs. This will reduce the memory
consumption when there are too many QPs are inactive.

For more detailed information, please refer to the man pages provided by
the last patch of this series.

This series is associated with the kernel one "RDMA/hns: Add support for
Dynamic Context Attachment", and two RFC versions of this series has been
sent before.

Changes since v1:
* Add DCA pyverbs test cases.
* Add a shared memory mechanism to synchronize status of DCA.
* Link: https://patchwork.kernel.org/project/linux-rdma/cover/[e-mail]/

No changes since RFC v2.
* Link: https://patchwork.kernel.org/project/linux-rdma/cover/[e-mail]/

Changes since RFC v1:
* Add direct verbs to set the parameters about size that used to
  configuring DCA.
* Add man pages to explain what is DCA, how does it works and how to use
  it.
* Link: https://patchwork.kernel.org/project/linux-rdma/cover/[e-mail]/

Wenpeng Liang (1):
  Update kernel headers

Xi Wang (9):
  libhns: Introduce DCA for RC QP
  libhns: Add support for shrinking DCA memory pool
  libhns: Add support for attaching QP's WQE buffer
  libhns: Use shared memory to sync DCA status
  libhns: Sync DCA status by shared memory
  libhns: Add direct verbs support to config DCA
  libhns: Add man pages to introduce DCA feature
  pyverbs/hns: Initial support for HNS direct verbs
  tests: Add traffic test of send on HNS DCA QPEx

 CMakeLists.txt                             |   1 +
 debian/control                             |   2 +-
 debian/ibverbs-providers.install           |   1 +
 debian/ibverbs-providers.lintian-overrides |   4 +-
 debian/ibverbs-providers.symbols           |   6 +
 debian/libibverbs-dev.install              |   6 +
 kernel-headers/rdma/hns-abi.h              |  86 ++++++
 kernel-headers/rdma/mlx5-abi.h             |  17 +-
 providers/hns/CMakeLists.txt               |   9 +-
 providers/hns/hns_roce_u.c                 | 229 ++++++++++++++--
 providers/hns/hns_roce_u.h                 |  88 +++++-
 providers/hns/hns_roce_u_abi.h             |   7 +-
 providers/hns/hns_roce_u_buf.c             | 422 +++++++++++++++++++++++++++++
 providers/hns/hns_roce_u_hw_v2.c           | 178 ++++++++++--
 providers/hns/hns_roce_u_hw_v2.h           |   7 +
 providers/hns/hns_roce_u_verbs.c           |  67 ++++-
 pyverbs/CMakeLists.txt                     |   1 +
 pyverbs/providers/hns/CMakeLists.txt       |   7 +
 pyverbs/providers/hns/__init__.pxd         |   0
 pyverbs/providers/hns/__init__.py          |   0
 pyverbs/providers/hns/hns_enums.pyx        |   1 +
 pyverbs/providers/hns/hnsdv.pxd            |  25 ++
 pyverbs/providers/hns/hnsdv.pyx            | 158 +++++++++++
 pyverbs/providers/hns/hnsdv_enums.pxd      |  21 ++
 pyverbs/providers/hns/libhns.pxd           |  28 ++
 redhat/rdma-core.spec                      |   7 +-
 suse/rdma-core.spec                        |  21 +-
 tests/hns_base.py                          |  80 ++++++
 tests/test_hns_dca.py                      |  37 +++
 29 files changed, 1449 insertions(+), 67 deletions(-)
 create mode 100644 pyverbs/providers/hns/CMakeLists.txt
 create mode 100644 pyverbs/providers/hns/__init__.pxd
 create mode 100644 pyverbs/providers/hns/__init__.py
 create mode 120000 pyverbs/providers/hns/hns_enums.pyx
 create mode 100644 pyverbs/providers/hns/hnsdv.pxd
 create mode 100644 pyverbs/providers/hns/hnsdv.pyx
 create mode 100644 pyverbs/providers/hns/hnsdv_enums.pxd
 create mode 100644 pyverbs/providers/hns/libhns.pxd
 create mode 100644 tests/hns_base.py
 create mode 100644 tests/test_hns_dca.py

--
2.8.1

Comments

Wenpeng Liang July 27, 2021, 6:48 a.m. UTC | #1

On 2021/7/27 11:27, Wenpeng Liang wrote:
> The HIP09 introduces the DCA(Dynamic Context Attachment) feature which
> supports many RC QPs to share the WQE buffer in a memory pool. If a QP
> enables DCA feature, the WQE's buffer will not be allocated when creating
> but when the users start to post WRs. This will reduce the memory
> consumption when there are too many QPs are inactive.
> 
> For more detailed information, please refer to the man pages provided by
> the last patch of this series.
> 
> This series is associated with the kernel one "RDMA/hns: Add support for
> Dynamic Context Attachment", and two RFC versions of this series has been
> sent before.

Sorry, some patches are missing from this patchset. Please ignore this patchset.