From patchwork Sun Oct 14 18:55:22 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: James Simmons X-Patchwork-Id: 10640777 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 5A50E1508 for ; Sun, 14 Oct 2018 18:55:38 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 09BE128B9F for ; Sun, 14 Oct 2018 18:55:38 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id ECACB291F2; Sun, 14 Oct 2018 18:55:37 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from pdx1-mailman02.dreamhost.com (pdx1-mailman02.dreamhost.com [64.90.62.194]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 9D73028B9F for ; Sun, 14 Oct 2018 18:55:37 +0000 (UTC) Received: from pdx1-mailman02.dreamhost.com (localhost [IPv6:::1]) by pdx1-mailman02.dreamhost.com (Postfix) with ESMTP id 1E51E21F24F; Sun, 14 Oct 2018 11:55:37 -0700 (PDT) X-Original-To: lustre-devel@lists.lustre.org Delivered-To: lustre-devel-lustre.org@pdx1-mailman02.dreamhost.com Received: from smtp3.ccs.ornl.gov (smtp3.ccs.ornl.gov [160.91.203.39]) by pdx1-mailman02.dreamhost.com (Postfix) with ESMTP id DD7ED21F1B2 for ; Sun, 14 Oct 2018 11:55:35 -0700 (PDT) Received: from star.ccs.ornl.gov (star.ccs.ornl.gov [160.91.202.134]) by smtp3.ccs.ornl.gov (Postfix) with ESMTP id BA1292220; Sun, 14 Oct 2018 14:55:34 -0400 (EDT) Received: by star.ccs.ornl.gov (Postfix, from userid 2004) id B1E772A5; Sun, 14 Oct 2018 14:55:34 -0400 (EDT) From: James Simmons To: Andreas Dilger , Oleg Drokin , NeilBrown Date: Sun, 14 Oct 2018 14:55:22 -0400 Message-Id: <1539543332-28679-1-git-send-email-jsimmons@infradead.org> X-Mailer: git-send-email 1.8.3.1 Subject: [lustre-devel] [PATCH 00/10] lustre: lnet: fixes for non-x86 systems X-BeenThere: lustre-devel@lists.lustre.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "For discussing Lustre software development." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Lustre Development List MIME-Version: 1.0 Errors-To: lustre-devel-bounces@lists.lustre.org Sender: "lustre-devel" X-Virus-Scanned: ClamAV using ClamSMTP These are the required patches to make LNet work with non-x86 platforms like ARM or Power8. The tunables map_on_demand and concurrent_sends assumed pages were 4K in size which is not correct. Massively reworked to basically defunct those tunables. Also the size of the LNet packet was always 256 pages but when the page size is 64K like some ARM or Power8 systems the maximum LNet message sent was 16MB not 1MB which is what is expected. Fixing up the RDMA handling in the ko2iblnd driver also resolved some performance issues. Alexey Lyashkov (1): lustre: lnd: use less CQ entries for each connection Amir Shehata (6): lustre: lnd: set device capabilities lustre: o2iblnd: use IB_MR_TYPE_SG_GAPS lustre: lnd: rework map_on_demand behavior lustre: lnd: calculate qp max_send_wrs properly lustre: lnd: remove concurrent_sends tunable lustre: lnd: correct WR fast reg accounting Dmitry Eremin (1): lustre: o2iblnd: limit cap.max_send_wr for MLX5 James Simmons (1): lustre: lnet: make LNET_MAX_IOV dependent on page size John L. Hammond (1): lustre: o2ib: use splice in kiblnd_peer_connect_failed() .../staging/lustre/include/linux/lnet/lib-types.h | 10 +- .../lustre/include/uapi/linux/lnet/lnet-types.h | 3 - drivers/staging/lustre/lnet/Kconfig | 10 -- .../staging/lustre/lnet/klnds/o2iblnd/o2iblnd.c | 138 +++++++++++++++------ .../staging/lustre/lnet/klnds/o2iblnd/o2iblnd.h | 68 +++------- .../staging/lustre/lnet/klnds/o2iblnd/o2iblnd_cb.c | 133 ++++++++++++++------ .../lustre/lnet/klnds/o2iblnd/o2iblnd_modparams.c | 85 ++++++------- drivers/staging/lustre/lustre/include/lustre_net.h | 1 + 8 files changed, 256 insertions(+), 192 deletions(-)