Message ID | 20230126215125.4069751-1-kbusch@meta.com (mailing list archive) |
---|---|
Headers | show
Return-Path: <owner-linux-mm@kvack.org> X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C1A0BC61D97 for <linux-mm@archiver.kernel.org>; Thu, 26 Jan 2023 21:51:40 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3C9CF6B0072; Thu, 26 Jan 2023 16:51:40 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 378996B007B; Thu, 26 Jan 2023 16:51:40 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 17DE56B0075; Thu, 26 Jan 2023 16:51:40 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 0A83E6B0072 for <linux-mm@kvack.org>; Thu, 26 Jan 2023 16:51:40 -0500 (EST) Received: from smtpin01.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id D26F21C5D61 for <linux-mm@kvack.org>; Thu, 26 Jan 2023 21:51:39 +0000 (UTC) X-FDA: 80398297518.01.3B32242 Received: from mx0a-00082601.pphosted.com (mx0a-00082601.pphosted.com [67.231.145.42]) by imf21.hostedemail.com (Postfix) with ESMTP id C1B551C0002 for <linux-mm@kvack.org>; Thu, 26 Jan 2023 21:51:37 +0000 (UTC) Authentication-Results: imf21.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=RK0eODc0; spf=pass (imf21.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.145.42 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674769898; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=YSju8h3IcFoXJFagXVV/kEgcC/pDir68RdkcrZYyLwI=; b=VBaZEDkYzEhCHFLSIVDyk3ses5MkUwbVZcafBSbctrq+e/ou/J+A4kG9qoXNNA+9/GP9/8 zuwVeKVbwUdYB/TJsN6URddLArP5KDAXAlBsIbtwuJeeHNqxfKJFz0X7sHeUbQuOwkpFc3 6YGYYfqjleyFXHKETx6HlGOJX4eaJzk= ARC-Authentication-Results: i=1; imf21.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=RK0eODc0; spf=pass (imf21.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.145.42 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674769898; a=rsa-sha256; cv=none; b=OuINCHus43ZHaghxMua9YoBPhZnaDZdiYEuD9btxnLxeGFNA3dXun2tUERErpds1kyYPco giyLY5HfCJgnSTnxQqEVV9+1eShLx3UxrTm5PZr17W8hxM9lsFtsiZm9pIXJLXN9eKapVt 1cRo1Msxj0B2XZHtg5Q+6sDclo3Ts88= Received: from pps.filterd (m0109333.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QKqvb8000849 for <linux-mm@kvack.org>; Thu, 26 Jan 2023 13:51:36 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=YSju8h3IcFoXJFagXVV/kEgcC/pDir68RdkcrZYyLwI=; b=RK0eODc0AYW8MNOFDP/1dkUB/QQe5YtJVLFOk/cTZAPUxYdkCpZ1BVnCIbdPDHoAHKI/ /C4426KZe/tMOI+1oaXVo+ggjof+LkZopPTc7bJ5AOs1zllEgCxljCOm/YNOoMVqEIS6 GvWzQiV47VFQHkUQJgRqL7MN78bFLgAf/dfAWs/SflUF9yt1rQdwojOy6s3e27map76/ rLBLhV9BtGFR7BaW6GgtdlD3Ix1zccpf6OAqzFZkR7qpJegbXszkvssICmTGVKZuapX2 XYG9B4fFAH144s94n15CG+uNBRkUA9Av97PiCi4e+ovfyTx6R9kJzcPOxXzFNRHdQ2TS Yw== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nb7mbshbn-2 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for <linux-mm@kvack.org>; Thu, 26 Jan 2023 13:51:36 -0800 Received: from twshared24547.08.ash9.facebook.com (2620:10d:c085:208::11) by mail.thefacebook.com (2620:10d:c085:21d::4) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:51:35 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id D3B55FE80A8B; Thu, 26 Jan 2023 13:51:25 -0800 (PST) From: Keith Busch <kbusch@meta.com> To: <linux-mm@kvack.org>, <linux-kernel@vger.kernel.org>, <willy@infradead.org>, <hch@lst.de>, <tonyb@cybernetics.com>, <akpm@linux-foundation.org> CC: <kernel-team@meta.com>, Keith Busch <kbusch@kernel.org> Subject: [PATCHv4 00/12] dmapool enhancements Date: Thu, 26 Jan 2023 13:51:13 -0800 Message-ID: <20230126215125.4069751-1-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-FB-Internal: Safe Content-Type: text/plain X-Proofpoint-GUID: MLahRtOxRsS-a6HsHjcljkk2_saCqRxv X-Proofpoint-ORIG-GUID: MLahRtOxRsS-a6HsHjcljkk2_saCqRxv X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspamd-Queue-Id: C1B551C0002 X-Stat-Signature: 4kzjfaf9mfw6x7kb65mep4a1co7ykpsk X-Rspam-User: X-Rspamd-Server: rspam08 X-HE-Tag: 1674769897-676608 X-HE-Meta: U2FsdGVkX19rxhTDigFqK2kkFzyHwwNeUq+lQ26Y3UhjO0vHB1tdvpO+HYLYxi/C4e7F/lWnkfdrP/t0QKJjc1n3zKW4yZx75shjsfMv7uryqaaKBLfooR7EEJM+D3ghLk6yU07IUSiYaa55VtEZldmTEiJeLve+SG051afHJCZZlTbfkpBbyIPW+vqij09NmsXVOO+xa4spA4larDYzJaduw82+lxq4TJ/41bCgkWEqUlvzSqaIEgGTV9lQOgRcI+VsBuKgXcj6vi2SyI5L44Ejl/cshrKj3/+Ge5hm9YFE39bV/vt5ZdeuVVky9bbIdbDlHh/xlBjRyAj6bkO5dLWYOAlB0c2dyRctVz+fmyv4i35sKvzrcGiCjJIE/hhTxOV4iD1YM6S1wIwe9HdfMI2011mZT7zS4oripzDxGNHn1GX+EOeQLJ7eIOb+0eislkk1HrrQH6fjnowqKe2NE6FaNFXBBvonmfI+gmIYqgGxaitjf7cySdcHKoCzpGrNsE5N+mIUzzVE3NDP9vEFyVIhtZk/rUr5CtE0a9ja+CsLZ7cQXqCqtluYkN6mWxPiH4SJ3Wn/YeqE4EXSua0yMez/V8IAcpRgTOZCaEYloNhN1tduDAnv+5FBew27oRIo0aTgH018yeruIXYS1OEBdghyfc/gXzZWN3U9++Q1XCw/TBFqV8AxIpzRauh1UfL13JZfG3Bjjb0hFebd0aesU1dazAunHrUS3mv0I8QVqmfbq1auz/TeQ3H6Yx5jx+MgCusnStnIY//oboW6+umqfWqR5H/x9+KecY/IakcQE36urt9uay+QUQERabuBxj7djw/BIT6HQ2XoxBE6usysfrY4cKM4c52pzJFCLbQ4vePBr9FJPO96eTRxm181sStGNd8FfgKBzJP2LF4a1xk6FoUWsCTF4rNLvZkTKndUfqmBRsp335l2bAK4AYVVbat5dEBOG36jqwG6addL7lG glx1/lZL 4i40DS5rhPs3EnmCSF0oblFxf2v2mWITf8Z3RHFTpdA+Xo2ZKKZRDfvEcgs9m6Rt0cY86OJZGpvR7wm4KXpdhgDXRdJ/PM9EAVwjgfHmW7R/vWyifx5n7VJN1GjB3aY3vTTTPy5qa62vP6LgdH+mCFcwF5b28VjolE9J6s0xIRFKupmHtIl7qkghowohRuqw0OOTFk8sMkc/eDYTzi5adA+30paPDzOQzdGw5C2Lhp/5gtrfIoZq4TEPvJNxOumh5xhoZ0I19dWULkR0TrsDtw9ePVMLeDFlOOac8QIA8Gmx6c1TjV9PZkLcCjCEp9mvKZ/GmIj8TiQBRSzraz7IAfS31WAYaZ+DYHPhS8HUjobqaQ7OQa2d62UOFaFKcGclVXR1CxvdMeputq2A= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: <linux-mm.kvack.org> |
Series |
dmapool enhancements
|
expand
|
On Thu, 26 Jan 2023 13:51:13 -0800 Keith Busch <kbusch@meta.com> wrote: > Time spent in dma_pool alloc/free increases linearly with the number of > pages backing the pool. We can reduce this to constant time with minor > changes to how free pages are tracked. Do we have any performance testing results for realistic workloads?
On Thu, Jan 26, 2023 at 02:22:09PM -0800, Andrew Morton wrote: > On Thu, 26 Jan 2023 13:51:13 -0800 Keith Busch <kbusch@meta.com> wrote: > > > Time spent in dma_pool alloc/free increases linearly with the number of > > pages backing the pool. We can reduce this to constant time with minor > > changes to how free pages are tracked. > > Do we have any performance testing results for realistic workloads? Yes, I mentioned this a little in patch 11, profiling with nvme with high-depth dmapool allocating workloads. Results really depend on your environment, so YMMV, but I was able to observe time spent in dma_pool_{alloc,free}() reduced by half.
From: Keith Busch <kbusch@kernel.org> Time spent in dma_pool alloc/free increases linearly with the number of pages backing the pool. We can reduce this to constant time with minor changes to how free pages are tracked. Changes since v4: Added received reviews Applied comments from Christoph: Combined all debug code in one #ifdef block Fixed some whitespace Keith Busch (8): dmapool: add alloc/free performance test dmapool: move debug code to own functions dmapool: rearrange page alloc failure handling dmapool: consolidate page initialization dmapool: simplify freeing dmapool: don't memset on free twice dmapool: link blocks across pages dmapool: create/destroy cleanup Tony Battersby (4): dmapool: remove checks for dev == NULL dmapool: use sysfs_emit() instead of scnprintf() dmapool: cleanup integer types dmapool: speedup DMAPOOL_DEBUG with init_on_alloc mm/Kconfig | 9 ++ mm/Makefile | 1 + mm/dmapool.c | 402 ++++++++++++++++++++++------------------------ mm/dmapool_test.c | 147 +++++++++++++++++ 4 files changed, 350 insertions(+), 209 deletions(-) create mode 100644 mm/dmapool_test.c