From patchwork Thu Jan 26 21:51:14 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117832 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 94541C61DB3 for ; Thu, 26 Jan 2023 21:51:42 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 836196B0074; Thu, 26 Jan 2023 16:51:40 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 7715B8E0001; Thu, 26 Jan 2023 16:51:40 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3ECA56B0075; Thu, 26 Jan 2023 16:51:40 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 1C2656B0072 for ; Thu, 26 Jan 2023 16:51:40 -0500 (EST) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id E942C1C5E0B for ; Thu, 26 Jan 2023 21:51:39 +0000 (UTC) X-FDA: 80398297518.30.AEA59AA Received: from mx0b-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf17.hostedemail.com (Postfix) with ESMTP id F16C14000F for ; Thu, 26 Jan 2023 21:51:37 +0000 (UTC) Authentication-Results: imf17.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=ASRbVkEP; spf=pass (imf17.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674769898; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=s5rbVdHY8if3NZwBpxyqPHsyHy0AGgbbdnlk67jswfk=; b=7VwZ1oTB5T9tPLm1693Zqs7QfoK1LZePXLmBv+5+qC4HTPD49cv7Sf6Irygge8FRqw8yG5 8mR89CQoJbeBSExyj4DTLRxM8Dc7+058lhr/KYC8fU1mMNnHKM58d1XZPb7HMP2ZX91CM1 FoOtxOBIShod1LXJokT01S8xuI0jjRU= ARC-Authentication-Results: i=1; imf17.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=ASRbVkEP; spf=pass (imf17.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674769898; a=rsa-sha256; cv=none; b=coA4Pp9cwF4ALq6gTr0sN//OUH1yT8TSldhTFcicqaxWdfhh2B9Z3l53VtpmR5d4Yojr2w HkF+lz8xVDoHybei2JeHTT5hXZl+kbcKTlKrSy7W8x9+vmIo+lpINYUv2Lu7lSvkEHs0Mu f2CiEXBdhO/yeD5W1Ybofo6ARWn0cs4= Received: from pps.filterd (m0109331.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QJ4q2i024956 for ; Thu, 26 Jan 2023 13:51:37 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=s5rbVdHY8if3NZwBpxyqPHsyHy0AGgbbdnlk67jswfk=; b=ASRbVkEP1febABvLy/E0M7KjVontma+WpIWKpp2bOHChITSLbdpyiQfexfBcy6D/RptR bDSRXFGJLr4hPl6ETgdfbdd1EhaMZFsw38KGwRzHFEt+c/fOQ29gMBwyA3uuLvfY+4QX bWYQRjIMczLp7ifZe7xe4b+nWOnp/G5In2o/uYYqMwzBDXf/dRCjX2hJd94JsWXjlJBr 20kd7KkQ1Mf+Ocz8gB9pqjlaD1P2Hy0H4It4QcwGSyeHKoJy7nlMDujxK6i1XjDdzGPk 0TAfTJOE6d47lcv6WTJ64X4xWgdP+b+ZqAj6Xxbrx5b/cBu8sLHCTHF8GFsJ6LpmuGlt cw== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nbb800mma-4 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:51:37 -0800 Received: from twshared24547.08.ash9.facebook.com (2620:10d:c085:208::11) by mail.thefacebook.com (2620:10d:c085:11d::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:51:35 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id DC4FCFE80A8D; Thu, 26 Jan 2023 13:51:25 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 01/12] dmapool: add alloc/free performance test Date: Thu, 26 Jan 2023 13:51:14 -0800 Message-ID: <20230126215125.4069751-2-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: AQG0iXHdMdTUl4BOBZzykvpjqhf_V5Wg X-Proofpoint-GUID: AQG0iXHdMdTUl4BOBZzykvpjqhf_V5Wg X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Stat-Signature: xjhfnpiysofqwygk45k5doiha6crqwzt X-Rspam-User: X-Rspamd-Queue-Id: F16C14000F X-Rspamd-Server: rspam06 X-HE-Tag: 1674769897-720149 X-HE-Meta: U2FsdGVkX1/i6/ajW6OIOPt1Qb4BleoeFGzSh/JMJUUFoDrV0lQ4NqRdowjYTMdNcimxc96fDAskrjN/nwGSFl4bVF4gYt2BrbvDPGVxXXuSufaMv6pMRSP7nVATyJdqSg2cD4aG0nB2+pIdSMA23h4aDWH1yBNcKgDvESyLFZcYD6XAj4MbJsFa6TdV7iff2gLvVr+qIo3hliW5p4ovRYxZSFmkfVFwbz1gz+hY8lNgvYvHZKd6gWkJ+KTsu+iOR7BV60vWYbzvL/SvY1zjkeJtfIp2Pgp/f+sk+9xbUayHQYK5nD+HLQxgTBihspXAGKrYYX6IYa+v/eGAvHA/7ja4AmmZXnY/3Fuy3IPpPUrqK2rmAameQvAs+VaxC/CTZ9227xwE9J2MObHLM40xD77xGc0kvZ6tMYIuhgVE6uREtISaDRJmaP6TjEXzxyHLSwBi1nlRS9U0BCiyhQHHvF6oWF8ErEgY2wbnokGL/bvk1EplQ1wQcqPsQWG0hF9rd9u2SsBfYmKtUoh+xB2KSWQJ6tBi8kjJxlcNjwxAEHXPng/xzYPGkmVjt8RkaPJbQI7yPd4ntyiDGc4Y3d7Nc/aIaYc99O7jwBiBZ68eavU8TwPYrrex71q+gabNprIkFTM0WvTzo9L1QCLeNnTw9u/ArHlm1e9OJcUAo1ctsE7PQggsWa10hTDOnuSnwt+7d4kEIssaqWGTY0CDXlTgoWhxNB9qfA4lWQ1j4EaWg6PgF2HSTkYV9n7Tmcf+4SqPS1KMIbRoTMqgj41Cv3I2g4MP0fl0H+CvtlvcHZ6pOdFU2rGdVOWrKgM7dThONPk2+QWU5GMc01mL7Pwiu2ykxTjHijiPLFA5ZWIopnX2cBCkLNgjgYD5auHuoRCiW14hGrKrz6ANv/j1phYq7ySe0bwyviAi+wonhzokgG2h+K8yqEVvAuaPyRmmChxAnPzH6BBDy711BJYJw3ArW+Q MN7+GEge U4ohiyu73Go0gaYJuL9F2/2RHpuqfJlhhKWWq2HtR5ItveTY6QQUtO0SYUEgzmsisge1wJz/vT+kXVQf28pGtvoSmKlBk7M8NdJwpaHNirmK/RDC2Q2WaQj9QPUGq2kYf0SPtpCC71SaRBUbsHCWyaW5bgypZmbdKoazZm0OgJ/AqTDb8DYkBX+v8OznDmmmn7gJkN93aX0LEwFJSmXifuxJgTpMljU/gpEC5C7NSwux1fbNvURReKtIs0YkWQfWAPgCmxASsmPiJ/xP1BuDZkpnnUS6Tq0V+s1Td92EJba7wjf+W8Peq9amNEsDTKCTjXVhCTn7AYuaXBxNpCdhlSvhg9bv5ZNVXogjXfWsOZ22nR7dul1353jyaSRbTPwxCthWw+hXhI8XFEAY= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Keith Busch Provide a module that allocates and frees many blocks of various sizes and report how long it takes. This is intended to provide a consistent way to measure how changes to the dma_pool_alloc/free routines affect timing. Signed-off-by: Keith Busch --- mm/Kconfig | 9 +++ mm/Makefile | 1 + mm/dmapool_test.c | 147 ++++++++++++++++++++++++++++++++++++++++++++++ 3 files changed, 157 insertions(+) create mode 100644 mm/dmapool_test.c diff --git a/mm/Kconfig b/mm/Kconfig index ebfe5796adf83..28ee03f39e93f 100644 --- a/mm/Kconfig +++ b/mm/Kconfig @@ -1099,6 +1099,15 @@ comment "GUP_TEST needs to have DEBUG_FS enabled" config GUP_GET_PXX_LOW_HIGH bool +config DMAPOOL_TEST + tristate "Enable a module to run time tests on dma_pool" + depends on HAS_DMA + help + Provides a test module that will allocate and free many blocks of + various sizes and report how long it takes. This is intended to + provide a consistent way to measure how changes to the + dma_pool_alloc/free routines affect performance. + config ARCH_HAS_PTE_SPECIAL bool diff --git a/mm/Makefile b/mm/Makefile index 8e105e5b3e293..3a08f5d7b1782 100644 --- a/mm/Makefile +++ b/mm/Makefile @@ -103,6 +103,7 @@ obj-$(CONFIG_MEMCG) += swap_cgroup.o endif obj-$(CONFIG_CGROUP_HUGETLB) += hugetlb_cgroup.o obj-$(CONFIG_GUP_TEST) += gup_test.o +obj-$(CONFIG_DMAPOOL_TEST) += dmapool_test.o obj-$(CONFIG_MEMORY_FAILURE) += memory-failure.o obj-$(CONFIG_HWPOISON_INJECT) += hwpoison-inject.o obj-$(CONFIG_DEBUG_KMEMLEAK) += kmemleak.o diff --git a/mm/dmapool_test.c b/mm/dmapool_test.c new file mode 100644 index 0000000000000..370fb9e209eff --- /dev/null +++ b/mm/dmapool_test.c @@ -0,0 +1,147 @@ +#include +#include +#include +#include +#include +#include +#include + +#define NR_TESTS (100) + +struct dma_pool_pair { + dma_addr_t dma; + void *v; +}; + +struct dmapool_parms { + size_t size; + size_t align; + size_t boundary; +}; + +static const struct dmapool_parms pool_parms[] = { + { .size = 16, .align = 16, .boundary = 0 }, + { .size = 64, .align = 64, .boundary = 0 }, + { .size = 256, .align = 256, .boundary = 0 }, + { .size = 1024, .align = 1024, .boundary = 0 }, + { .size = 4096, .align = 4096, .boundary = 0 }, + { .size = 68, .align = 32, .boundary = 4096 }, +}; + +static struct dma_pool *pool; +static struct device test_dev; +static u64 dma_mask; + +static inline int nr_blocks(int size) +{ + return clamp_t(int, (PAGE_SIZE / size) * 512, 1024, 8192); +} + +static int dmapool_test_alloc(struct dma_pool_pair *p, int blocks) +{ + int i; + + for (i = 0; i < blocks; i++) { + p[i].v = dma_pool_alloc(pool, GFP_KERNEL, + &p[i].dma); + if (!p[i].v) + goto pool_fail; + } + + for (i = 0; i < blocks; i++) + dma_pool_free(pool, p[i].v, p[i].dma); + + return 0; + +pool_fail: + for (--i; i >= 0; i--) + dma_pool_free(pool, p[i].v, p[i].dma); + return -ENOMEM; +} + +static int dmapool_test_block(const struct dmapool_parms *parms) +{ + int blocks = nr_blocks(parms->size); + ktime_t start_time, end_time; + struct dma_pool_pair *p; + int i, ret; + + p = kcalloc(blocks, sizeof(*p), GFP_KERNEL); + if (!p) + return -ENOMEM; + + pool = dma_pool_create("test pool", &test_dev, parms->size, + parms->align, parms->boundary); + if (!pool) { + ret = -ENOMEM; + goto free_pairs; + } + + start_time = ktime_get(); + for (i = 0; i < NR_TESTS; i++) { + ret = dmapool_test_alloc(p, blocks); + if (ret) + goto free_pool; + if (need_resched()) + cond_resched(); + } + end_time = ktime_get(); + + printk("dmapool test: size:%-4zu align:%-4zu blocks:%-4d time:%llu\n", + parms->size, parms->align, blocks, + ktime_us_delta(end_time, start_time)); + +free_pool: + dma_pool_destroy(pool); +free_pairs: + kfree(p); + return ret; +} + +static void dmapool_test_release(struct device *dev) +{ +} + +static int dmapool_checks(void) +{ + int i, ret; + + ret = dev_set_name(&test_dev, "dmapool-test"); + if (ret) + return ret; + + ret = device_register(&test_dev); + if (ret) { + printk("%s: register failed:%d\n", __func__, ret); + goto put_device; + } + + test_dev.release = dmapool_test_release; + set_dma_ops(&test_dev, NULL); + test_dev.dma_mask = &dma_mask; + ret = dma_set_mask_and_coherent(&test_dev, DMA_BIT_MASK(64)); + if (ret) { + printk("%s: mask failed:%d\n", __func__, ret); + goto del_device; + } + + for (i = 0; i < ARRAY_SIZE(pool_parms); i++) { + ret = dmapool_test_block(&pool_parms[i]); + if (ret) + break; + } + +del_device: + device_del(&test_dev); +put_device: + put_device(&test_dev); + return ret; +} + +static void dmapool_exit(void) +{ +} + +module_init(dmapool_checks); +module_exit(dmapool_exit); +MODULE_LICENSE("GPL"); From patchwork Thu Jan 26 21:51:15 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117830 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C413BC05027 for ; Thu, 26 Jan 2023 21:51:39 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EC4B86B0071; Thu, 26 Jan 2023 16:51:38 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id E75326B0072; Thu, 26 Jan 2023 16:51:38 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D3D576B0074; Thu, 26 Jan 2023 16:51:38 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id C151F6B0071 for ; Thu, 26 Jan 2023 16:51:38 -0500 (EST) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id E504F4064C for ; Thu, 26 Jan 2023 21:51:37 +0000 (UTC) X-FDA: 80398297434.14.F689B7D Received: from mx0b-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf23.hostedemail.com (Postfix) with ESMTP id CDCD3140019 for ; Thu, 26 Jan 2023 21:51:35 +0000 (UTC) Authentication-Results: imf23.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=AzXdRJyS; spf=pass (imf23.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674769896; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=VSEPLCQaW+j9aw414roRW/MACaOkh6KNm+59eAETMIQ=; b=hXDeWfYpfNQCe2jknAjm3/OamgFfewW0FX47QbOPM0ADEEoytTkRkiFjyKNHF/hqZ7nE3Z 3dGDZLqU2fUPC7gUiamNQJnxUhM+TrnJUE2DrRrKaFoJXMYhyncMdtNFJlvDnAar7ofoQJ QgV6FYPP3QHYXB+uz3Oe8KVSqervrl4= ARC-Authentication-Results: i=1; imf23.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=AzXdRJyS; spf=pass (imf23.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674769896; a=rsa-sha256; cv=none; b=YA2+LZrXF9eRxYMBmzLPSP2zVkQzxUxvfSeftupJcjPOZhZbk7P58oSZ6QK1CVqISyfy5p YDzNH9XDTvyHbG9yza7vUZ5Zv4Fx1aDXEhebzrFjxfFhFVsd8kpt79jFx/tBxaChqTPmb+ 9OyFvV6AFLVLfmIkNFcpNdWh5jbSVN4= Received: from pps.filterd (m0109332.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QKB3O8003298 for ; Thu, 26 Jan 2023 13:51:35 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=VSEPLCQaW+j9aw414roRW/MACaOkh6KNm+59eAETMIQ=; b=AzXdRJySlHQeie3ztR4gmxWHNE0EVahHbMlWrOPQKxgiMtKkgZVHpj5b4Ze1Mh88o63s UmzYVIONbjmHn4kQq6mPsub7mmVcSLBmQybn4NBHcLTThm/Bg6SbQ/M9n9ATntU/EHJg lj4D6+mAYStymhIPBqak56VJiSuld5w7akXU1QzgFQpECq2FXzvt4Wp3t5TCdjUhtpcJ ynvGWox3bpv182qWkXoxmW+HwV+O4rI+5EBNx/N2dOZyyIFlBwWJPsBVCQWxqzppW7MP sJMb61hpmqpwEV3EumFp7t6tZi6qYpdZVret84w73gNMkxoU0ukCG5ntDaAYNhRQiJHy oQ== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3narn0x971-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:51:34 -0800 Received: from twshared26225.38.frc1.facebook.com (2620:10d:c085:208::f) by mail.thefacebook.com (2620:10d:c085:11d::4) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:51:33 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id EC93AFE80A91; Thu, 26 Jan 2023 13:51:25 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 02/12] dmapool: remove checks for dev == NULL Date: Thu, 26 Jan 2023 13:51:15 -0800 Message-ID: <20230126215125.4069751-3-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-GUID: o-2WXwCrHRnd6xVgW8c2hhSurz6unXQE X-Proofpoint-ORIG-GUID: o-2WXwCrHRnd6xVgW8c2hhSurz6unXQE X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Stat-Signature: epicowrnk4o3h51i5yd4ijg3csnaer3d X-Rspam-User: X-Rspamd-Queue-Id: CDCD3140019 X-Rspamd-Server: rspam06 X-HE-Tag: 1674769895-494184 X-HE-Meta: U2FsdGVkX1+J+QHL7suJ9lrhv07fzXK/RuZgdTSRO+YA3dD0SIx7TK7qWV2vXDo23LSmcJELOLZNzpiL8iQ4Ft0ShbDJa5wQUaLLd780wevbIGCmLi6vSSLim/2v2iU9RuWFdVo+V610fl8yZ1gWJ5a2y/6hI2k1AP0aoPWgOSCNmEfhcGhNkZgbS4Nw73sXElKUNNYh4H8C4kDYslQwu1YGYIqApDfnY7b4Y+WLatXyvwDPJnk71CnrKPAR4w1dUDpyfSYgDBuiFP6UijYWdh2qCW5SKLsXHuNVZLu6ATRAJqSs2TtofOLfX9ZotTPlAJWqBK1PLykgt2ExZP7P77iby0VXpfag4Sg/YNgCurx/wscqjDPdD7PZNIG8WM3YNnJiIiWJe2TfyQUSZDGgr0YGEqS0KgSBW8UE2lfJ9uHAxpXwpdutzsyRvPHl/cCgCnNt5RX5RzzMaKRzs2n93K0euav/oly7ZV9L2XOZ/UDOc7FJqvFw7NOb5AytMVY1U+kbbPpvmc3UR03er8d6ZHhmQo+ZCpEklTaD+wPvl5+Thv91cG3LoC1t3R7kGN7lcM5s8YLU63586iE3BbJilC/ZQUYZYXQHr1He5JE7yfmDd73EXn2OzdQfOdWpsUB9z51HMdN6IfVMmYl6V9Aq+UGcLSIf7nbK5tQX0/rDEOReeKahFE7RcOrSh4GxdF+eVB3PGRjWKaB8eFUssQfNLOKImtroUcKWrKveR49I2Ua4yBv4YYCzZjE07CPqeSlVl8zaO06MdzE81+xgdlP4RM7a4d2FZmUyr4+ZU3Roa23yKJqoPkjnH9uebK2kCxU+RkS4iqqzdezjLfySYX3n/UsxYZYx+R6+JlFQeSavZAfUc6wLDc43+NQXYRqciHYQAHOPUWHXSF3xd5G3EF7I3EP++KQ6PFIBEWXVA5Iq1TRmripE8C+CC+haCK6dfvZtSbs46722kesLMHfyB7j 7PB7EjEP fslN6v24Y9SB4kQEX7/cx21jFSDKor6mJM0euVKd4FmoTn5MckZRj0JyWYIR6Kw9gnobKSLAlLhK5UtF3NrxuXWeGWSZDNCV79MGNIqDBB3T2Yf1MHqH2P/B05a+H64WUIAvLbfYpM+RWN5qIe+3qaKgPGbiOQ7fDexCWK97EOeI1mr0RymroCiYBg6XUlaFpb7I8vL/ucXJW+qarC6P/1v9PGogTzQEbPbSSPD3x0aZZpfAAwYTp6Ml44BgM0V+619GbteyQ6gepPyE1M86gW2LTG8VbSuRn35c8zzsDCVfspRQW6PWbx8pF++aWID3vF5lcrciLnef/5R9Tzzp8g923csLLgNlHknNnRIYKzNE3XvKZqJDLwv8vx+zgZWm3B/2TxQ3WtiL9HuurnhaJlQixMfb7zRqm9ffa+ls1LiTR+gt19Aecv+CfFA5tDLMBwv/e X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Tony Battersby dmapool originally tried to support pools without a device because dma_alloc_coherent() supports allocations without a device. But nobody ended up using dma pools without a device, and trying to do so will result in an oops. So remove the checks for pool->dev == NULL since they are unneeded bloat. Signed-off-by: Tony Battersby [added check for null dev on create] Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 45 ++++++++++++++------------------------------- 1 file changed, 14 insertions(+), 31 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index a7eb5d0eb2da7..559207e1c3339 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -134,6 +134,9 @@ struct dma_pool *dma_pool_create(const char *name, struct device *dev, size_t allocation; bool empty = false; + if (!dev) + return NULL; + if (align == 0) align = 1; else if (align & (align - 1)) @@ -275,7 +278,7 @@ void dma_pool_destroy(struct dma_pool *pool) mutex_lock(&pools_reg_lock); mutex_lock(&pools_lock); list_del(&pool->pools); - if (pool->dev && list_empty(&pool->dev->dma_pools)) + if (list_empty(&pool->dev->dma_pools)) empty = true; mutex_unlock(&pools_lock); if (empty) @@ -284,12 +287,8 @@ void dma_pool_destroy(struct dma_pool *pool) list_for_each_entry_safe(page, tmp, &pool->page_list, page_list) { if (is_page_busy(page)) { - if (pool->dev) - dev_err(pool->dev, "%s %s, %p busy\n", __func__, - pool->name, page->vaddr); - else - pr_err("%s %s, %p busy\n", __func__, - pool->name, page->vaddr); + dev_err(pool->dev, "%s %s, %p busy\n", __func__, + pool->name, page->vaddr); /* leak the still-in-use consistent memory */ list_del(&page->page_list); kfree(page); @@ -351,12 +350,8 @@ void *dma_pool_alloc(struct dma_pool *pool, gfp_t mem_flags, for (i = sizeof(page->offset); i < pool->size; i++) { if (data[i] == POOL_POISON_FREED) continue; - if (pool->dev) - dev_err(pool->dev, "%s %s, %p (corrupted)\n", - __func__, pool->name, retval); - else - pr_err("%s %s, %p (corrupted)\n", - __func__, pool->name, retval); + dev_err(pool->dev, "%s %s, %p (corrupted)\n", + __func__, pool->name, retval); /* * Dump the first 4 bytes even if they are not @@ -411,12 +406,8 @@ void dma_pool_free(struct dma_pool *pool, void *vaddr, dma_addr_t dma) page = pool_find_page(pool, dma); if (!page) { spin_unlock_irqrestore(&pool->lock, flags); - if (pool->dev) - dev_err(pool->dev, "%s %s, %p/%pad (bad dma)\n", - __func__, pool->name, vaddr, &dma); - else - pr_err("%s %s, %p/%pad (bad dma)\n", - __func__, pool->name, vaddr, &dma); + dev_err(pool->dev, "%s %s, %p/%pad (bad dma)\n", + __func__, pool->name, vaddr, &dma); return; } @@ -426,12 +417,8 @@ void dma_pool_free(struct dma_pool *pool, void *vaddr, dma_addr_t dma) #ifdef DMAPOOL_DEBUG if ((dma - page->dma) != offset) { spin_unlock_irqrestore(&pool->lock, flags); - if (pool->dev) - dev_err(pool->dev, "%s %s, %p (bad vaddr)/%pad\n", - __func__, pool->name, vaddr, &dma); - else - pr_err("%s %s, %p (bad vaddr)/%pad\n", - __func__, pool->name, vaddr, &dma); + dev_err(pool->dev, "%s %s, %p (bad vaddr)/%pad\n", + __func__, pool->name, vaddr, &dma); return; } { @@ -442,12 +429,8 @@ void dma_pool_free(struct dma_pool *pool, void *vaddr, dma_addr_t dma) continue; } spin_unlock_irqrestore(&pool->lock, flags); - if (pool->dev) - dev_err(pool->dev, "%s %s, dma %pad already free\n", - __func__, pool->name, &dma); - else - pr_err("%s %s, dma %pad already free\n", - __func__, pool->name, &dma); + dev_err(pool->dev, "%s %s, dma %pad already free\n", + __func__, pool->name, &dma); return; } } From patchwork Thu Jan 26 21:51:16 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117833 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C1C7BC61DA7 for ; Thu, 26 Jan 2023 21:51:43 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id A32176B0075; Thu, 26 Jan 2023 16:51:41 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 9BC166B0078; Thu, 26 Jan 2023 16:51:41 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 835BC6B007B; Thu, 26 Jan 2023 16:51:41 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 6E1006B0075 for ; Thu, 26 Jan 2023 16:51:41 -0500 (EST) Received: from smtpin18.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 4539980E8B for ; Thu, 26 Jan 2023 21:51:41 +0000 (UTC) X-FDA: 80398297602.18.A8C085D Received: from mx0a-00082601.pphosted.com (mx0a-00082601.pphosted.com [67.231.145.42]) by imf15.hostedemail.com (Postfix) with ESMTP id 04C1DA0006 for ; Thu, 26 Jan 2023 21:51:38 +0000 (UTC) Authentication-Results: imf15.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=fMCMSJns; spf=pass (imf15.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.145.42 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674769899; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=bKgaIgCzl+sBGwA7v3YqE5kXwxl/qwPaI+k5PR78ySk=; b=oD6g6ItYGOKfR2ACpEbr0gu1WMSwGmw/SFSFPoyhEFvWfskv50hyedIhujP8Cfd4OqWp+S Osim4+iWtPitwtVxaKmwFAzbjUGzMD68vWnuAsUjxWj/5ZOOQw30lnHf1VJ2aEtc5f5UxQ 2YEi5VwaEMChWX1MxwfcGjCNRYGn6z4= ARC-Authentication-Results: i=1; imf15.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=fMCMSJns; spf=pass (imf15.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.145.42 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674769899; a=rsa-sha256; cv=none; b=cEBxIUwkfRr+Hvhw8PiY+9y7ot36eZXQ8nkrNwO8dY/KxsxFDKaKFBIHJCunUg7VSEMA6l sHp2TKNzRVoKnyGKfYcg8LWATGBkp0jy6qNinkXXSPi3byh4/uXfKwAjzkBOidV31zS1H6 IbKlW48iwcLTQpbhwtjWeGZHYXsQOgg= Received: from pps.filterd (m0109333.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QKqvbC000849 for ; Thu, 26 Jan 2023 13:51:37 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=bKgaIgCzl+sBGwA7v3YqE5kXwxl/qwPaI+k5PR78ySk=; b=fMCMSJnsInPjYMhsW+pbka/x8V+e6/LX+0UItt0S9df8MkqWdeQREl3xVMtuF1WAePTK UME9C3Uexi1D7J1HOb6QyNqWYacL3gF7/nyG/smx08AUUmIU/aYXwd/rE7haPzKYOgpn IFkrJNUMDxfPwc0w5nPYQmixyfP8ICmosVwtODZgpkn1YN4g7itlMpAy2lfAGC61G3eu 3ycTb3N8f5wDGZBMxsogKKMojt6srWVK5nMN2i6ZTUUomsO97u3ZtPvNuwcI8QJxfvi1 eWe1Uww60gIuB+k3LIBBTzRmKH293wn5EwiRh6hmVOxmD+uPKCxk0u0JmTtZpRUdPdbz Xw== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nb7mbshbn-6 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:51:37 -0800 Received: from twshared24547.08.ash9.facebook.com (2620:10d:c085:208::11) by mail.thefacebook.com (2620:10d:c085:21d::4) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:51:35 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 0ABA5FE80A93; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 03/12] dmapool: use sysfs_emit() instead of scnprintf() Date: Thu, 26 Jan 2023 13:51:16 -0800 Message-ID: <20230126215125.4069751-4-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-GUID: _1GZjSQC4WEYp4yc-P7r7bLVWHvhT0T- X-Proofpoint-ORIG-GUID: _1GZjSQC4WEYp4yc-P7r7bLVWHvhT0T- X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 04C1DA0006 X-Stat-Signature: k9x75sf5zp9qe4cwp384xpjpu9czo8tx X-Rspam-User: X-HE-Tag: 1674769898-897657 X-HE-Meta: U2FsdGVkX1+wBjK8lHPQsYKQWERhQOOjzA/jvVxR6jI+lMuKl5k34AOghSQndJ8NajCqHoah+VueUnaE/+yTHqxs3YGbSRDA6AX1u3mqaMZ+DrE3of4U9MAQxUAwOZY0/KnyeEhJs5+jbgaetSHI9LLqg2wgZBjEGK5NoBHbtWYMdrPIL/xzS6PUBhbRO94xMkkzcYvQdC91TCfFMgp9lpZWYsqGt08lUddU5a0lzYyMN105OOawEIAZaU6QRepCYXgMCJwuwY14j9Qr7MpYAli3cs9s5E6qgci6oOp82kfnWXqeCRHkAHsGO+J93NcgwILp3X+Teo4paVVU+aQIb5c4UvQy5o5awUc6hoz+66uTmbFh0/MY7FJzG+zWLF/tPVoyZlXC2zi9oas6AHt754dCAxeIMbpEvSY92dudz7U1HP0nP7/fD7g8EMfjFctJmCYZDdBhONJikCV3qJJtsRMBuhtiy8ST9HOX9qvfAPLa3m3sv86ElnH/l5hn726JrwUcc2102YeFUMq+nt8lu3kTA2EXCVIAVW/QBxfzv7CsQYBqK6SP0ca5NibO8ozNkFeNSEyXy7jooHB3iu4RIIM41SN5951+LT5Kess9djPDAvD/CqdbH18AZG6Jt2YSO9CYLUZV0F6qfHnND1m+ctoamyH0AvrhgGlbAMH9ZR7w4oOF3K75d9CEeekjVoK6DQPwVYGQdznKZf0kOm+Mh2kb/SBv+jn3ITykonYVb78lLScZ6ELB5VU2SOIMagnTM1w9UHvciOoS3J/FLDCiGiJCEZmlQAReOuIN/TFirRp3Kl/3JrS9XvAN0GvOo9ho15lK8E9RBIGUdbeGs0H3VYSSpjT/ygweGhSC/9KKw8gt6rXxGzeClk+mY7maaqOwKFYKqLDnNS51ao3uuKZKLisFxIoUwcYTCwM2RHrHzJLqhfobKxlLXoayngI5TnqeKHOFNx3MsDVFyVD838i 0KBif34U nyK0ml6rH2JdAMynU5mhwtETE+akfnRRs/qnvEGO3OsimaoW6pjjSeEEzouoAw/N/XfLY4fxRbFJyyOJ43nbPMWoeQUjpB45Pl700oVkfUkCP/BPLcC/oaXchTp1glKtfNMKVqv4Ssms6EkMULmN28zE9VfWhkOgfpR3VOO9A/6hr6Fuki0XxhG2ShOhxA/8ImV1eyaPu3OSuwOeUPVwyQMy7wBm2mpgdSeOnr7YZsG3kaIkb30wlrnTDuZF1NOvqX5ARRmNTH7pINdEkaPQGudOHSdLxUMK32eqIUcyoRf+lbfugk8iJkV3uEXL1OWsTaTV5Ps5k902iHG/GDRlwfsGcgo0DbVSw9C+OOUpGroz7/NfJVoK/zetegJFPQybozRpVwTnGM/gNDUP9v8PJpaX+vVAbBm81u1pGn8hSlEKBwlGo0Fy1sslXp/k8ArgOqpbHJbIPe4GdZGAjLYA+l8bSyX6oefhARMhJ/KTMveJ6cgJFCK/fxEs8eg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Tony Battersby Use sysfs_emit instead of scnprintf, snprintf or sprintf. Signed-off-by: Tony Battersby Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 23 +++++++---------------- 1 file changed, 7 insertions(+), 16 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index 559207e1c3339..20616b760bb9c 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -64,18 +64,11 @@ static DEFINE_MUTEX(pools_reg_lock); static ssize_t pools_show(struct device *dev, struct device_attribute *attr, char *buf) { - unsigned temp; - unsigned size; - char *next; + int size; struct dma_page *page; struct dma_pool *pool; - next = buf; - size = PAGE_SIZE; - - temp = scnprintf(next, size, "poolinfo - 0.1\n"); - size -= temp; - next += temp; + size = sysfs_emit(buf, "poolinfo - 0.1\n"); mutex_lock(&pools_lock); list_for_each_entry(pool, &dev->dma_pools, pools) { @@ -90,16 +83,14 @@ static ssize_t pools_show(struct device *dev, struct device_attribute *attr, cha spin_unlock_irq(&pool->lock); /* per-pool info, no real statistics yet */ - temp = scnprintf(next, size, "%-16s %4u %4zu %4zu %2u\n", - pool->name, blocks, - pages * (pool->allocation / pool->size), - pool->size, pages); - size -= temp; - next += temp; + size += sysfs_emit_at(buf, size, "%-16s %4u %4zu %4zu %2u\n", + pool->name, blocks, + pages * (pool->allocation / pool->size), + pool->size, pages); } mutex_unlock(&pools_lock); - return PAGE_SIZE - size; + return size; } static DEVICE_ATTR_RO(pools); From patchwork Thu Jan 26 21:51:17 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117838 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B3B26C05027 for ; Thu, 26 Jan 2023 21:54:39 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 749B2900006; Thu, 26 Jan 2023 16:54:37 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 6F9FC900002; Thu, 26 Jan 2023 16:54:37 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5269A900006; Thu, 26 Jan 2023 16:54:37 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 3A380900002 for ; Thu, 26 Jan 2023 16:54:37 -0500 (EST) Received: from smtpin05.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 11E7BC0ED9 for ; Thu, 26 Jan 2023 21:54:37 +0000 (UTC) X-FDA: 80398304994.05.C54F3F3 Received: from mx0b-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf16.hostedemail.com (Postfix) with ESMTP id 03DF418001C for ; Thu, 26 Jan 2023 21:54:34 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=f6Yo6rnv; spf=pass (imf16.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770075; a=rsa-sha256; cv=none; b=gX0nD++PLnu1TxgQ52uEsy+eYpD2e68wndWUzNM7SuxktJ2957xaMWOsVsL5uy8L3L7FRA lnTTzvl7+LHmQ8smD3S4EbkjiMzKnhV7yxo7nL1calJ7HClct5hEwVlt3G2BN8O6kmFQfD J73nbntIC7u+DaXlDx8VX5eplaRoE5I= ARC-Authentication-Results: i=1; imf16.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=f6Yo6rnv; spf=pass (imf16.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770075; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=Dd8QlDeIX9+IRxSeA5RcOHNXrB5QMHTJYiPzhiQ/gts=; b=apGDmMA7YOg+G6NzAcam8IbFOgZvSMeU0fv32hiNC3bEvMDtDJJ5tsO1V5zx+mZSzNXu/l Pv9MCe5MUGdx6ma8YjAXDS7PWqTkpQB0giBsqExMyaHkuULa7bmU0H7uLYSBshP4BjtOyX +o9jMX5LjDkqJIEx70KzYfLQF9kCIRk= Received: from pps.filterd (m0148460.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QKwn4f000398 for ; Thu, 26 Jan 2023 13:54:34 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=Dd8QlDeIX9+IRxSeA5RcOHNXrB5QMHTJYiPzhiQ/gts=; b=f6Yo6rnvPuGQSjOivMjFMiVoexX2wF9EGMLL44szI0ICCjq6HzrZKA8OUZRmZyffbSdA RQBNK8igSKHCfl/W9ss3bKerG/fHxXmeQ065OFHFPE5jEEU0mt7AhO5NX/SYdJwT993g 8nwd1dW16YdRfWTqv7QijChPOzi8/IGFFgtNuoyuBJxs/4IKZyF+JMbM69ToNYyiZqiy M/H+kW9DwaNJyEyfox6RVoECGTLntSDbmWq6raIlbu/kuXLqSKfdPxaJwY+PKur3IKqL 7gUyj+tQAbjJkehrQQg9ycN0p6HzafwJ70bccLVBnhkDYMtiKHQD5BKKqcC3Oh+m3UMt 7A== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nbvft36uk-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:54:33 -0800 Received: from twshared9608.03.ash7.facebook.com (2620:10d:c085:208::11) by mail.thefacebook.com (2620:10d:c085:21d::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:54:31 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 10E17FE80A95; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 04/12] dmapool: cleanup integer types Date: Thu, 26 Jan 2023 13:51:17 -0800 Message-ID: <20230126215125.4069751-5-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: OFXNYg2m1uS4GbeE4iRa232RGHuYhT5o X-Proofpoint-GUID: OFXNYg2m1uS4GbeE4iRa232RGHuYhT5o X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspam-User: X-Rspamd-Queue-Id: 03DF418001C X-Rspamd-Server: rspam01 X-Stat-Signature: u14raz4siwrg5458pr8g16jniebt9m7i X-HE-Tag: 1674770074-539932 X-HE-Meta: U2FsdGVkX1/Uq6y98XnlLzlJLZ1S2JxjvOwziduyRK4pMSQonScQBsa89yg3BnAFMMVhLM+G+meMp4xXs3osYBXZXTwsvamIUGqiK9ABIo7mfqSET96QAfdEEirBbDPPo1T/t8lpXcujTOKk9h9fhQkszTUU05YqeN+zzkdmZzYLF4oL5WkbBJg9sPFF2zgfNuaXhx0q/KyY+3x/HgbncB7OmpZgc1muK+CLhh8lHzYrpgL46A93EkQUsItdwno7fP+5I0UHR4owIBafFrQF4oX6uwj6wYCTbWwPOSQ7l+gyOV6wDomUfaEM5Nj5NS7f8qitT1+u0trgSfv0AsU/Yo39whSgAY6VXOfa+VE6bvFZ1rVRlHSVwoodPpg+X01zqg9XLRLcgWSMqFDuMOEdauRUVpnEB9zl8prbZMat9O3Txt5s07iP5Ne2CvC+0XpNLJKuV8qfRgKxf2GkN8vvIsyZCRp+lqYOa8RCHLEcrPtuXvU9L92ZuBVfaXvFdK2wRPMSsqm0RZD4rSq2XryAc6KinXaa8XLX/0TRc+NXn3F9tSaO8VkjRfR3VWQvGJ130PM4B7St9Mss/sJcPqNPQepHrDlTJvOiDsAi7/bBa8bMdEoxyj5h3tf8W77oaudSIaUSYjhrxHWVuOFSUeCqgKEuTZ3E/7yHYNl9Dug6R4e3kNUMYgURWbmuBL70MpffSFcY/mHLpnF2LvoFM3RWfCcvVcIhxFlB95hmpexzcxOeGebrKuQr0sRdx2BKdNrWMRAd+rsZhndGnZMYOGM1S0H5+xrfdJNFy2Kfh6moVM/NTM8kWXZPmjQMy8CIc7eVUm/MJnL5YkGKsqopYSh3ZwghP0GNcfzlchMA4RM+bnRcSHhoET1fWuC7gM73BLNOX0QjmLIZN0HxRt64MZ5QCvmXu6XlElYTM6bNZ7W7Qk/wnjapYKc3reGyb1eS3sEqPUhMgSeTxiuQydXVAJf ShOILJ4b 2G6Q8Gj9veE1mOmz4PAPtAsUiFssHv9uXVHcRbQFClp9wSFfkk2rZJvq12qVppC7DapmZpFgSA34cqpoMvUJsfR6Wb7Vxh+jYicdB9Q2Wo1Df8FxNcPIfFOw1BuOnGpCbJzvdoOOXTZ7IzhtkQwxbr8pAgmh7g74KwdwiuUy2WarngoLINr/Bvbgh2KMFUYOgG7wRgJvX+M2kZXv5xgxJVeE5M6rCVtxJMb62ev/RJeeYLCAhm+BwVyi4mUISeRar2UzKMb4ZkCX2yQ2IYfzXoroDNx5m2trHt83tM5AEBR+7guNiZSWe7YQHteHFLCCVpuYCtFx5kvpPaIZhlztP3K6IVobkLa/82p3t0UXqBLsZv9MgQjZ2KEPq/iHX2y/tw9z2OaF5KLNRBEHb30069KJYpIKZZwsM6YCyoMCCo1XARUp6Q8aRWAzVyvOrg37Ylltx X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Tony Battersby To represent the size of a single allocation, dmapool currently uses 'unsigned int' in some places and 'size_t' in other places. Standardize on 'unsigned int' to reduce overhead, but use 'size_t' when counting all the blocks in the entire pool. Signed-off-by: Tony Battersby Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 19 +++++++++++-------- 1 file changed, 11 insertions(+), 8 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index 20616b760bb9c..ee993bb59fc27 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -43,10 +43,10 @@ struct dma_pool { /* the pool */ struct list_head page_list; spinlock_t lock; - size_t size; struct device *dev; - size_t allocation; - size_t boundary; + unsigned int size; + unsigned int allocation; + unsigned int boundary; char name[32]; struct list_head pools; }; @@ -73,7 +73,7 @@ static ssize_t pools_show(struct device *dev, struct device_attribute *attr, cha mutex_lock(&pools_lock); list_for_each_entry(pool, &dev->dma_pools, pools) { unsigned pages = 0; - unsigned blocks = 0; + size_t blocks = 0; spin_lock_irq(&pool->lock); list_for_each_entry(page, &pool->page_list, page_list) { @@ -83,9 +83,10 @@ static ssize_t pools_show(struct device *dev, struct device_attribute *attr, cha spin_unlock_irq(&pool->lock); /* per-pool info, no real statistics yet */ - size += sysfs_emit_at(buf, size, "%-16s %4u %4zu %4zu %2u\n", + size += sysfs_emit_at(buf, size, "%-16s %4zu %4zu %4u %2u\n", pool->name, blocks, - pages * (pool->allocation / pool->size), + (size_t) pages * + (pool->allocation / pool->size), pool->size, pages); } mutex_unlock(&pools_lock); @@ -133,7 +134,7 @@ struct dma_pool *dma_pool_create(const char *name, struct device *dev, else if (align & (align - 1)) return NULL; - if (size == 0) + if (size == 0 || size > INT_MAX) return NULL; else if (size < 4) size = 4; @@ -146,6 +147,8 @@ struct dma_pool *dma_pool_create(const char *name, struct device *dev, else if ((boundary < size) || (boundary & (boundary - 1))) return NULL; + boundary = min(boundary, allocation); + retval = kmalloc(sizeof(*retval), GFP_KERNEL); if (!retval) return retval; @@ -306,7 +309,7 @@ void *dma_pool_alloc(struct dma_pool *pool, gfp_t mem_flags, { unsigned long flags; struct dma_page *page; - size_t offset; + unsigned int offset; void *retval; might_alloc(mem_flags); From patchwork Thu Jan 26 21:51:18 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117835 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id CA8E9C05027 for ; Thu, 26 Jan 2023 21:54:30 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 489FB8E0003; Thu, 26 Jan 2023 16:54:30 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 43A3C8E0001; Thu, 26 Jan 2023 16:54:30 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3299C8E0003; Thu, 26 Jan 2023 16:54:30 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 1C3928E0001 for ; Thu, 26 Jan 2023 16:54:30 -0500 (EST) Received: from smtpin29.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id E32A6A0EF2 for ; Thu, 26 Jan 2023 21:54:29 +0000 (UTC) X-FDA: 80398304658.29.6414401 Received: from mx0b-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf01.hostedemail.com (Postfix) with ESMTP id 0465940021 for ; Thu, 26 Jan 2023 21:54:27 +0000 (UTC) Authentication-Results: imf01.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=Kefr2vNT; spf=pass (imf01.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770068; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=UyoQbuDcWCkMLbCWVjg85By3HibyoyANdI6PglTOTlg=; b=xBLiKNgfDRQ5X9irUcpG6rJx6Bm5mMjB7cfxSf7fh9wWGqZkH94vGa2bS3rviiaMdSciW0 ZZv6432BWj1JgAi2e/+1rUyQOcT87+R0WT7Ge/y/InxblFq01G9aBB+e/cBlsew7McmUqC zHRQ0sD5jmO+1gtTwF6pT037d7T2uGg= ARC-Authentication-Results: i=1; imf01.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=Kefr2vNT; spf=pass (imf01.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770068; a=rsa-sha256; cv=none; b=EY11Lin1OE9WzKeSWok7I8P1Hjs0fdNYGZ1O/dlt3cHWIf/h7qtFYl3rvHf7o9JNVglCuh 8D94COnkihFkOr/4lGqjmInAffhR/GzJkhnMwehbsF8fOnTQ0jMfvvsXewQRA3X42qOLb1 XOis80yth9oOCCq2z0En0f9gRwRoSPo= Received: from pps.filterd (m0109331.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QKJF8L004994 for ; Thu, 26 Jan 2023 13:54:27 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=UyoQbuDcWCkMLbCWVjg85By3HibyoyANdI6PglTOTlg=; b=Kefr2vNT1NBrRgx/cIhqb29JdH3QfkFrzcMsv6RXzVT/Bt97zPsJi1ET99miCOlLfTaL VEDmvWx7lvbKlLrL3paXcIyf03+HCP3piWuL6Yp6G75d7u1xnOHXkDS2yurJSNQWBArZ dRQnHWxRwcNFBzfjxEzInlGlAimyfWyC54ieeApmniWm/EZsxawzWis1h/pAZMf5UrHB AHwBf7kdSicFV0rADI8j31EPcC+t/OjNLd6Rckkf4hXLuiPRVBHRuXADLX0faJzRFkXd vFAZ2qrs8T3pcZphxfizNaKjgvuuJq0R8smmoj+TbVJX3QeKyWqqcGcZthgBb7zMSyhA 6A== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nbb800ngc-2 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:54:27 -0800 Received: from twshared24547.08.ash9.facebook.com (2620:10d:c085:208::f) by mail.thefacebook.com (2620:10d:c085:21d::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:54:25 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 1F1EFFE80A97; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 05/12] dmapool: speedup DMAPOOL_DEBUG with init_on_alloc Date: Thu, 26 Jan 2023 13:51:18 -0800 Message-ID: <20230126215125.4069751-6-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: 5TnmCA6rfTE1zG4dSfmMi-b90MgKRqiI X-Proofpoint-GUID: 5TnmCA6rfTE1zG4dSfmMi-b90MgKRqiI X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 0465940021 X-Stat-Signature: woz7yi5d6yufjoqidqha7kzwwry5gsbn X-HE-Tag: 1674770067-682076 X-HE-Meta: U2FsdGVkX18+ooJRGBI7pdA+0js0E7sDafYD8tVQtwWvKNs3eOBXRHEhCG0En2mHFEONba1KskwR/YoxqvSDH1IEpJEAC8Lmly3VU7SVTznfL9Wt1aeiQIou+Xz2fonVEDNOaz0JYtMG/O8nRVvUP5OGEtzFMMI13s3KPl9mlk8LZirAQzpAQfP961ljK082Y1oqT72cc6jkCoxGdXdQpsEFeuPiomNhV+Rhl1xoB1cGbtgVuVIgHUXI7KRTCPr9A/SLEgbqisvgRSIXEiKizILFN5CTYPDD+MMxNXO0a4aBgdBuESFOGIR8uibVdw+l07Kwe7Obq8/OvWuPQL36wGw9Q40PxnJJGwlMZT2V1Wd7dg3F2+xeAIUMrc1i+Bvvwc1F0MGPgunHKWkABK46ZmoO8xqk0WcK7Cms+ZgrUCzYMWLE8R9aO+R3/gKnwL2UYITSpOxgn+dQNTEvLCqjikGsz/ke6S8unmhsqtuAKw+M0FXtk9HXS3xQ9ruxhbgq7J4ij/TpAJswJpv5utUCBpJ0S2H8+Lf19ebXiDOvU96m3FiK5DE8YjsQUAS7lDDr5w4wd7P36VLZHVvbz7JklZmQGqCXhkrUbrwjJt9kXvUG2QGHijWt/OpXi4KDmzfxNbrWfiZYz0Wzu1I6+3IenXYBWCS2oBXg5kqZnZLx0cJDeu6iFSvKWiWGq68e2hpgRmijDVKhCex5h5IyQ77duQcrnXl0ODMZImz/hwfBHeJnGRzFQuP9ixwx3mNM8OeUExzsuMeWNWcZOPMWAahK5HQhhIF7Vt5D4TpscJCT3xIR0pJ+gTamkf/e0oxMPUt9Dq/YniZoj+saCdslCbyrKPV9A00Dk5MZuzF8CbNBOvRvUwBt4l/RQ/mFWokMAG1A8fFEbOypBQtO+Q8IR8cDGAFtZUsT749/HTIPTmrFxAcjJhQQWzsMbtsNgq10Zd4buoi+tsuyDnPWMPxuexX OQbOcoJU neBPbmEmSbcOVszNTccx2i1/bpc+Ppk3Je8qv3J7mvleDl5Xlj2AWrNoLO70lu2w4a43MNXljpejXRXisbl0M6Tmj3Bja9wBEfTf97CeiZPS76YO4GUt1z93wXptAae/Y9maiknWcNfyzHr7FhfEqUALwgo7RNdyH6fZgiVuEE8fOKL0nV43BSP3OOpOX9SF4eldV/o+dRh/v1fdA8a5YsnCybb20UWt7/rFdVUcH0azgVAHK4sqGKddBzIRiQCeElNzuvBrV4kwqXKPefTPGfOCdcVsbVnVNGWOXI+ikv4FjbuSTdT7EJK3GRlPl7LycIq/ebG2lYT2pp7KyH5b9CFmrHHshRXmvyBpC+0HKDlgD3pHP+AZo/r3ObSrtZrGdBjah3zJkfUkU9htxim2LWjjMdlMZx12VVnk1E/WYLV5oBxHw+4M9IHg5QpZheWQRcyvMqoRK0QWephAsX8u95iY0b6cYvQBHLHm/M8czvrZKZjdpCayupQgxAg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Tony Battersby Avoid double-memset of the same allocated memory in dma_pool_alloc() when both DMAPOOL_DEBUG is enabled and init_on_alloc=1. Signed-off-by: Tony Battersby Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index ee993bb59fc27..eaed3ffb42aa8 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -356,7 +356,7 @@ void *dma_pool_alloc(struct dma_pool *pool, gfp_t mem_flags, break; } } - if (!(mem_flags & __GFP_ZERO)) + if (!want_init_on_alloc(mem_flags)) memset(retval, POOL_POISON_ALLOCATED, pool->size); #endif spin_unlock_irqrestore(&pool->lock, flags); From patchwork Thu Jan 26 21:51:19 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117836 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C00DEC05027 for ; Thu, 26 Jan 2023 21:54:33 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 54DD28E0001; Thu, 26 Jan 2023 16:54:33 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 4FE00900002; Thu, 26 Jan 2023 16:54:33 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3C5CF8E0005; Thu, 26 Jan 2023 16:54:33 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 2FA8B8E0001 for ; Thu, 26 Jan 2023 16:54:33 -0500 (EST) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 0EBEF1A0AF2 for ; Thu, 26 Jan 2023 21:54:33 +0000 (UTC) X-FDA: 80398304826.03.0AD21AB Received: from mx0b-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf18.hostedemail.com (Postfix) with ESMTP id 137F81C001E for ; Thu, 26 Jan 2023 21:54:30 +0000 (UTC) Authentication-Results: imf18.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=RlM4IqGS; dmarc=pass (policy=reject) header.from=meta.com; spf=pass (imf18.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770071; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=1lwwQceFe1QpSr5S2HcEA6wQaoE2HB/NZ5plRAcwhzo=; b=Wh9UnWBGoK/D/nfJXxvmDDOBi0jN5Rd3P3ljPtoI2z/cnj7CwMTRxa99b/17yAPL6t8jQF R/eHJBWMK7tdXasQWXM9aqpMxYv3hbrLIPd/8qYZUxnKUKI19/zzf6TFpiiMgUynZnsXo3 VBM48EI+TsHHYaC6pg+eaCEqzxFkGts= ARC-Authentication-Results: i=1; imf18.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=RlM4IqGS; dmarc=pass (policy=reject) header.from=meta.com; spf=pass (imf18.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com" ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770071; a=rsa-sha256; cv=none; b=dER2zfZeyroGqDvgt0sbq6+NMiMsCZCCF+iiYBKJOqhH8sL8ZqAdc3TDNZLm4r3MdFtvea c9MQPPLDkTAyHuH4aa4k1yE06snJZTfUEUo+BD9HuwM4n7F1/37MD4224KlWB+Pj6XdNXR N+nAEpRP1P8UOXuWBxBahvc+Pn5o19Q= Received: from pps.filterd (m0109331.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QJaLuk019827 for ; Thu, 26 Jan 2023 13:54:30 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=1lwwQceFe1QpSr5S2HcEA6wQaoE2HB/NZ5plRAcwhzo=; b=RlM4IqGShMBtciXSfpcTCQ9wuKUE+1aak4ZzvkdSMs+fZyMj39YuDO/SuJFPYEh4Pfeb WECHH2miD4rohu7Jj8Kw3+FRbjf9sJZIBxERj7YdWYOvl4BoA2cyKuk6PRtEPPyxb96z AAA/2ZD2Bx8uUc5bB6OON3iVCTk2kp+DU6bHmu9tYGs5RXeydSNbNc0qAY4eTXG67Aa4 vA5ftqD7PDnZRQwx8GDkGBuNSo47jBSC0hPk4v34aRLV9e65nE8As8OWzAqC+k+wmTIt UmGDtBm4InLZUN9JT5K9cxmi59GvreNWI6Mkx/BY3dJ27HHp1w9vZioi0bs2ndXRULxC Bw== Received: from maileast.thefacebook.com ([163.114.130.16]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nbb800nh8-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:54:30 -0800 Received: from twshared5320.05.ash8.facebook.com (2620:10d:c0a8:1b::d) by mail.thefacebook.com (2620:10d:c0a8:83::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:54:29 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 294DFFE80A9A; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 06/12] dmapool: move debug code to own functions Date: Thu, 26 Jan 2023 13:51:19 -0800 Message-ID: <20230126215125.4069751-7-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: hA6eCdq9onMLl9nayoNFwRV5eN_q017P X-Proofpoint-GUID: hA6eCdq9onMLl9nayoNFwRV5eN_q017P X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspam-User: X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 137F81C001E X-Stat-Signature: forwbgdup4xjwqkyf6dq3sihgnpg7yj3 X-HE-Tag: 1674770070-567623 X-HE-Meta: U2FsdGVkX1/xAJZ86Zb8D4/j7ds2xzZS7kct8VgK/4Hvj0dq1617JJdhV35sZmIEgKWBfk0q6NQLNWe4ISWvstnV73ehUG4Y0ajPgHLvGjw4pkDEQzj64q7h/txgA5o+R/H0ouH0KRO772cnSLuVIo8LuG68T1YenP6mEgK0GUG88TacRNm4tM1wcYE63Nc34MpQoeTjDam2K+rQgunpmuMoEEpZwmddGhDqWNgQk9xHvy/DyAnqDQC4VmpvcZRv2a+tbninNn72l+B95YG4wKxpWVPLL5x6NYQVB5dQtv925GuBdeWRIA0iu7ibSVnH4ZXqVEAl/JE8DxQG+0LPNohrJOsX+UwQfZXHWViSVqSX3HBrIahAEagvVlL7rYSEpAhsKnBPbxZYMaHz92nmEKfpGwaMpLsQxO9yYb2c3c47BilWVxJf2jyBeuNkuciG1pRVNjNMf91DJfnVwXnb+ue7ie7FUS+3A2EbSE08X9kuVIZSqfvbZvMw7isfvFeikTV07j/qPoVhnWj31T6d1ZtH/1Y8PWtNI14+qrj3SjRvunc6F0dvPMUbFNW3kKxVqpTCJh6kdyohQWrgHxxjUpcAAZd4j/DmxaLnfcwzavpde4WLhq667+pZE/X3VdeEuPGA73F8iWBi24il54xyNS6Om0KE0RLPoq+Z7oPRBzX1UofV2LnbtdXRX6hRfE40wj6KaL73SxU50zs++QAnRoxTlXOiyiLL/j68tP+rJLZzgWx+gLoBjvWJd1seQdVoWO1JZGisw0n1lov61YUbsd533rhY2jFMPxGkCXMCtZ/XripVZiO6iSea8hGKJYw2mvPcnBLxWSQjeymc8f73YhqaTz+J1jj82bZLnBoca+qKibY8Y8kpTCCMPJj/NemQ3htpJOAi4UkFRQZpf0GMIMG0fJ4RuJorxKeAoZQfsrEYnK6yJHFtBWLdYlPzZ+JxYYzwY7nt0yA9JEU+vTV WPeUAoeL z/CNfdsiZl+KMRLJEx/XuWXmQwOU21yP+8kVNy9Q65NlepZl8zPlpRm21B+0reaGDvO1IULqV9uTuYeJMHZBjLdrY9Z8K3/WvdYflU3J5S1/k84Uch7v1J4Na0IpcO2UqRQCTgERvf3++SrB4h3wkMl5K/bXA2hZXy8lhvZdaQOi+U+fx5KFWR9FGzCCwOi62Ke9X7CzwHKLWtMWmTC+L/f/FFETk2ZnIMDv/zHaukHYO6k66jbfUnf16jquokTefUox+T8HTcgLK4WxVRFRZ+gg6P/zMY3FX3lwy2p+vm+zA8KFklifV7tFNBajxZ/X79bnOPmjnULcyuCiOnIEGPtUnUckDWmt6J1bZYpSdVCzHyrVCQR6C2XWTo6gF+MsTmqiLnLy7s1QHC/N+/tiGmFZ4k3wk9m42c+Hqq+e5NAhTb9A= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Keith Busch Clean up the normal path by moving the debug code outside it. Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 128 +++++++++++++++++++++++++++++++-------------------- 1 file changed, 77 insertions(+), 51 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index eaed3ffb42aa8..30b069e999968 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -96,6 +96,78 @@ static ssize_t pools_show(struct device *dev, struct device_attribute *attr, cha static DEVICE_ATTR_RO(pools); +#ifdef DMAPOOL_DEBUG +static void pool_check_block(struct dma_pool *pool, void *retval, + unsigned int offset, gfp_t mem_flags) +{ + int i; + u8 *data = retval; + /* page->offset is stored in first 4 bytes */ + for (i = sizeof(offset); i < pool->size; i++) { + if (data[i] == POOL_POISON_FREED) + continue; + dev_err(pool->dev, "%s %s, %p (corrupted)\n", + __func__, pool->name, retval); + + /* + * Dump the first 4 bytes even if they are not + * POOL_POISON_FREED + */ + print_hex_dump(KERN_ERR, "", DUMP_PREFIX_OFFSET, 16, 1, + data, pool->size, 1); + break; + } + if (!want_init_on_alloc(mem_flags)) + memset(retval, POOL_POISON_ALLOCATED, pool->size); +} + +static bool pool_page_err(struct dma_pool *pool, struct dma_page *page, + void *vaddr, dma_addr_t dma) +{ + unsigned int offset = vaddr - page->vaddr; + unsigned int chain = page->offset; + + if ((dma - page->dma) != offset) { + dev_err(pool->dev, "%s %s, %p (bad vaddr)/%pad\n", + __func__, pool->name, vaddr, &dma); + return true; + } + + while (chain < pool->allocation) { + if (chain != offset) { + chain = *(int *)(page->vaddr + chain); + continue; + } + dev_err(pool->dev, "%s %s, dma %pad already free\n", + __func__, pool->name, &dma); + return true; + } + memset(vaddr, POOL_POISON_FREED, pool->size); + return false; +} + +static void pool_init_page(struct dma_pool *pool, struct dma_page *page) +{ + memset(page->vaddr, POOL_POISON_FREED, pool->allocation); +} +#else +static void pool_check_block(struct dma_pool *pool, void *retval, + unsigned int offset, gfp_t mem_flags) + +{ +} + +static bool pool_page_err(struct dma_pool *pool, struct dma_page *page, + void *vaddr, dma_addr_t dma) +{ + return false; +} + +static void pool_init_page(struct dma_pool *pool, struct dma_page *page) +{ +} +#endif + /** * dma_pool_create - Creates a pool of consistent memory blocks, for dma. * @name: name of pool, for diagnostics @@ -223,9 +295,7 @@ static struct dma_page *pool_alloc_page(struct dma_pool *pool, gfp_t mem_flags) page->vaddr = dma_alloc_coherent(pool->dev, pool->allocation, &page->dma, mem_flags); if (page->vaddr) { -#ifdef DMAPOOL_DEBUG - memset(page->vaddr, POOL_POISON_FREED, pool->allocation); -#endif + pool_init_page(pool, page); pool_initialise_page(pool, page); page->in_use = 0; page->offset = 0; @@ -245,9 +315,7 @@ static void pool_free_page(struct dma_pool *pool, struct dma_page *page) { dma_addr_t dma = page->dma; -#ifdef DMAPOOL_DEBUG - memset(page->vaddr, POOL_POISON_FREED, pool->allocation); -#endif + pool_init_page(pool, page); dma_free_coherent(pool->dev, pool->allocation, page->vaddr, dma); list_del(&page->page_list); kfree(page); @@ -336,29 +404,7 @@ void *dma_pool_alloc(struct dma_pool *pool, gfp_t mem_flags, page->offset = *(int *)(page->vaddr + offset); retval = offset + page->vaddr; *handle = offset + page->dma; -#ifdef DMAPOOL_DEBUG - { - int i; - u8 *data = retval; - /* page->offset is stored in first 4 bytes */ - for (i = sizeof(page->offset); i < pool->size; i++) { - if (data[i] == POOL_POISON_FREED) - continue; - dev_err(pool->dev, "%s %s, %p (corrupted)\n", - __func__, pool->name, retval); - - /* - * Dump the first 4 bytes even if they are not - * POOL_POISON_FREED - */ - print_hex_dump(KERN_ERR, "", DUMP_PREFIX_OFFSET, 16, 1, - data, pool->size, 1); - break; - } - } - if (!want_init_on_alloc(mem_flags)) - memset(retval, POOL_POISON_ALLOCATED, pool->size); -#endif + pool_check_block(pool, retval, offset, mem_flags); spin_unlock_irqrestore(&pool->lock, flags); if (want_init_on_alloc(mem_flags)) @@ -394,7 +440,6 @@ void dma_pool_free(struct dma_pool *pool, void *vaddr, dma_addr_t dma) { struct dma_page *page; unsigned long flags; - unsigned int offset; spin_lock_irqsave(&pool->lock, flags); page = pool_find_page(pool, dma); @@ -405,35 +450,16 @@ void dma_pool_free(struct dma_pool *pool, void *vaddr, dma_addr_t dma) return; } - offset = vaddr - page->vaddr; if (want_init_on_free()) memset(vaddr, 0, pool->size); -#ifdef DMAPOOL_DEBUG - if ((dma - page->dma) != offset) { + if (pool_page_err(pool, page, vaddr, dma)) { spin_unlock_irqrestore(&pool->lock, flags); - dev_err(pool->dev, "%s %s, %p (bad vaddr)/%pad\n", - __func__, pool->name, vaddr, &dma); return; } - { - unsigned int chain = page->offset; - while (chain < pool->allocation) { - if (chain != offset) { - chain = *(int *)(page->vaddr + chain); - continue; - } - spin_unlock_irqrestore(&pool->lock, flags); - dev_err(pool->dev, "%s %s, dma %pad already free\n", - __func__, pool->name, &dma); - return; - } - } - memset(vaddr, POOL_POISON_FREED, pool->size); -#endif page->in_use--; *(int *)vaddr = page->offset; - page->offset = offset; + page->offset = vaddr - page->vaddr; /* * Resist a temptation to do * if (!is_page_busy(page)) pool_free_page(pool, page); From patchwork Thu Jan 26 21:51:20 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117834 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7099BC05027 for ; Thu, 26 Jan 2023 21:54:26 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 06B418E0002; Thu, 26 Jan 2023 16:54:26 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 01B468E0001; Thu, 26 Jan 2023 16:54:25 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E25BE8E0002; Thu, 26 Jan 2023 16:54:25 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id D15B38E0001 for ; Thu, 26 Jan 2023 16:54:25 -0500 (EST) Received: from smtpin02.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 8384F40E4A for ; Thu, 26 Jan 2023 21:54:25 +0000 (UTC) X-FDA: 80398304490.02.73A6407 Received: from mx0a-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf22.hostedemail.com (Postfix) with ESMTP id 79998C0017 for ; Thu, 26 Jan 2023 21:54:23 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=EW66EzzZ; dmarc=pass (policy=reject) header.from=meta.com; spf=pass (imf22.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770063; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=GssxkqRHzywk5Sc3h7qaypNsDK+tSAkz3BBhF75F+wE=; b=hxEwgtkPdW6MuQVhKzO4W5U0qI3CrcEoQqXJmnB1SUi7V3ikup3l5ml/dKO0+Why0OzxFE mhQwP+GcfTdjtILU98Z8tSpG/Lw1qWhYcgRCJJwmwNF6SftkWDXFJrOL/IpIHknZHYoap9 DFVLBq0E1pCeuM68nESZy+uFiv3AxXs= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=EW66EzzZ; dmarc=pass (policy=reject) header.from=meta.com; spf=pass (imf22.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com" ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770063; a=rsa-sha256; cv=none; b=FdeiNCcRjrXV9NN5KV7HFDCEX66KL7A3YStJtSYNQZx5jIFF/2O20Eizbk0pxoelvsQ9C1 KK+nDX/20hCW1DebTjn6OLsUIhsS2ELX2D7xj7qrqgacCOPi6qQuQ+LJtGVkdWnvrhSihs ANQUGikhgvmz4IHuCoSQmo554VvxiO0= Received: from pps.filterd (m0001303.ppops.net [127.0.0.1]) by m0001303.ppops.net (8.17.1.19/8.17.1.19) with ESMTP id 30QH17S7029356 for ; Thu, 26 Jan 2023 13:54:22 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=GssxkqRHzywk5Sc3h7qaypNsDK+tSAkz3BBhF75F+wE=; b=EW66EzzZTYxhxkLjG2nAjPndtIL8LgcOKBBHD/sSSDMd31TgPu0CZWKSeSNRB/D6mSNa dt8c+/70JMd1fhW8sMd/GQB2mQ6ijYChIbRbJkEnPu5A3lVTMiT+K5SXTBS7IBZooSgl /6Q5fi9ryDlra82ARf9bFswTsfAilHAwZv6cK5HYODvGn0/iGaYxhPGYWjwGEJhMzPyg o3eCENiy864rN1NDEddVjj2fQ++ENMLr7FwVH5byL0Zl58Piuhf0mCxzaKG1ldF3hIsz cLuGoG7fMBu8A1TwmCZ4NWzF1qpnle/lWci29BDJ4Mts+COFT4eBwAaLIvgHiZQWRQAz pQ== Received: from mail.thefacebook.com ([163.114.132.120]) by m0001303.ppops.net (PPS) with ESMTPS id 3nbe8yye18-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:54:22 -0800 Received: from twshared24547.08.ash9.facebook.com (2620:10d:c085:108::4) by mail.thefacebook.com (2620:10d:c085:11d::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:54:21 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 3DA2DFE80A9C; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 07/12] dmapool: rearrange page alloc failure handling Date: Thu, 26 Jan 2023 13:51:20 -0800 Message-ID: <20230126215125.4069751-8-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: WUvm-yqcGak3y8lgPNXk4QAHX47oDyx1 X-Proofpoint-GUID: WUvm-yqcGak3y8lgPNXk4QAHX47oDyx1 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspamd-Queue-Id: 79998C0017 X-Rspamd-Server: rspam09 X-Rspam-User: X-Stat-Signature: oo7eptnwfy7fzdwdk6apn3rdg9pwsxq7 X-HE-Tag: 1674770063-766303 X-HE-Meta: U2FsdGVkX18Au2DMiML9Jfsk3cnF+EMKBIDv6GgYiN1ldwUQotrN5ZzUPpuT8NGn/eE/GqJQIId3iM/jNF512j1IWJyS3CMvKy/XylQs0iF2l39PiFjcNoYC/8NfvH1TzKxI1w3B+zbkHXswVux+0u+3E2TaZorXXulsatT+Ah0VEuFBUlYCCdtIntE3rrV7vcUevu0MZ4GeXOwAn90vt+qKj+J7QDMMX9qin+Y075mk/mxy4FYeXoOwZ7/AeY3VrSSNekaph6CQe0VQEhoK68uOT4yyBa+u9SBiaKxTgOKe7TZq7Dtdq/W0E3gZd4v8WM3oA+vLRGjMdG3abB3kjsroZTscu4W1aO7FinVeNECsDC7UnMPyZXf1xzs1pzMT5++FB5oTjEeZceDN57E/tS5OEMreDATZxTKcqhZ54err4NRJocUyj/KXbo5nQnpNQ+91Oahy2Kx6hpi5TECW+BSSPINa4tVtNmE5K9SiPvzAj3wQbqOCIeeNulrBb7cwOqxU3jO+qZn7jjTuPgor7+d+521d/SvQ+My/TsmkkkfAtzdaLDRlppV514lWVeysTAG4IwGXhL7h4u0ducCIuk50NgNSNOOnjTlyduvDNg53w12rBXz1u49GuJqW0+AT/+1uD3GadY0CH7pk78WjvI7ybaplnIMvPtYtxmcaUKFDosNf3HVhUMZ0TY6JwC31iQRZ6nwXTDY8pbyteoTb1IijuCdQhxim79UkqwMulTCbJAqqNq5sMD89uf0WmMUs9kY/zd8O8agzXc2SCUysLgOA9gYFrw5Lb3CozH3+YGJn+YeQah4HEeB8zOP3GRPaXdEtkyiEYqheJFj0s1dwe4BPPnS37V6BfN8HoVAyW6E1JiMJipmdfCXWTL0Ty3WyE4xSYept1Hbep0CyHSEjsFkKWUe86X4mUgwGWsaiIymT8xJ3mHBOQyczriO2LlzNd/7wTSJNfiayFcb9AKr GOsKC3Lb sx17qD2LUi2FNMcH/Hvv6SuT3IOkk9qCMx+B1MWWgJAXC4SbX6FDPcfM0EB5xortul107acTwyAHRlQtcB6zzfY/QES+8DXqwKm+EMJn75yCgQ92A5XtsLZcPKMFSgrZvPEvdhI+HD/v41IrliMl1T9pytyZG79FsxF04uvhvE4cJ6SCzPQSyhBNgL9m4n2IInxDK6b5TGw/DknZccOn8NH8MMqngdemJgmBRcST4NyAr7/2fc8OXm5IC77Ukrbm/VuqITooCTl7e9V6X+vqdEqdPgKwcPh9MWTuBvHTpJhyX1zr6UF6Z0NPmlBkxO9/ak58GipftVhjeHnl8wqnUwGh9gsIcZoWoIVSqyayyZUeJIz48CrUwPbHzEMLSDZI5pif63mvF7X6whas= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Keith Busch Handle the error in a condition so the good path can be in the normal flow. Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 16 +++++++++------- 1 file changed, 9 insertions(+), 7 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index 30b069e999968..900f2afa363a9 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -292,17 +292,19 @@ static struct dma_page *pool_alloc_page(struct dma_pool *pool, gfp_t mem_flags) page = kmalloc(sizeof(*page), mem_flags); if (!page) return NULL; + page->vaddr = dma_alloc_coherent(pool->dev, pool->allocation, &page->dma, mem_flags); - if (page->vaddr) { - pool_init_page(pool, page); - pool_initialise_page(pool, page); - page->in_use = 0; - page->offset = 0; - } else { + if (!page->vaddr) { kfree(page); - page = NULL; + return NULL; } + + pool_init_page(pool, page); + pool_initialise_page(pool, page); + page->in_use = 0; + page->offset = 0; + return page; } From patchwork Thu Jan 26 21:51:21 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117837 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 43C33C05027 for ; Thu, 26 Jan 2023 21:54:37 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 9459F900005; Thu, 26 Jan 2023 16:54:36 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 8F638900002; Thu, 26 Jan 2023 16:54:36 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7BEE3900004; Thu, 26 Jan 2023 16:54:36 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 6D6BE900002 for ; Thu, 26 Jan 2023 16:54:36 -0500 (EST) Received: from smtpin10.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 4BD69AAE4B for ; Thu, 26 Jan 2023 21:54:36 +0000 (UTC) X-FDA: 80398304952.10.DAC3E61 Received: from mx0b-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf14.hostedemail.com (Postfix) with ESMTP id 4F74C100011 for ; Thu, 26 Jan 2023 21:54:34 +0000 (UTC) Authentication-Results: imf14.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=DLPow7rF; spf=pass (imf14.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770074; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=TUPS34rQ0CeKMzaTGv3b3tvstwJOY1BaeTHmyPVxUHY=; b=shANDEgYkENzOBp76WtOCtJjmvjo0pqiWbCSsm2qoqYQYqiBQ45LDVU7rS5Kiyclkg4QS/ 1azlJV+C0X61sA3g0iOB6Cf+UPVbOcG8QZXKzTF1SzNNdc6zsMNpDwx98rVC4+e0VMMTgK 0h+s/wWvc4mpRUukdTcty32ub72etZA= ARC-Authentication-Results: i=1; imf14.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=DLPow7rF; spf=pass (imf14.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770074; a=rsa-sha256; cv=none; b=PearuDS8WwMA2/Er2QxZRaq7FBqV4zuIazc5xoUYm0JB1n09oXW+0ZKvG3xVvgnyaSRfU8 CY7k2gjxG0tRz13X0XilQwKwauUMAItPe1jOtfWUXfMTCoc+D9r2iYgUKLBt+Ert4L1pHp F5mi6saPoDT7VrvuMR9MbHUM9AMbXsg= Received: from pps.filterd (m0109331.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QJ4q3H024956 for ; Thu, 26 Jan 2023 13:54:33 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=TUPS34rQ0CeKMzaTGv3b3tvstwJOY1BaeTHmyPVxUHY=; b=DLPow7rFpO3/AwGHtO7lXvlG7VUjLgPQEBGpGszyW4ismx8epXy91eGg9nefHbBeSA6v YD3sejAge4Wqo3/2dbwF/3X0PDGGK3jZZ07Zn39oZ7R6OtImBVJsIvuuqPUUsu2A15Te l2Y8/M4A9R8K6HKl8/DBrWPexLW1F6GuhPjxlaSxHhZ5SUVNUXTMVOXZOPKrf6QpXyfV idITyjBi4jeCNTcD7vlZjTEvCffvefclPZQ+lpcDQh+O8yyIcZDUwnmqRPW9jwvmw9us iaNWnLnP/d7gVlTVwa8YVS2D+d2sDbR6NkCT0jPsygucEH/wdytqsfB8EJ/WRlXIKSMV qQ== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nbb800nhb-4 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:54:33 -0800 Received: from twshared9608.03.ash7.facebook.com (2620:10d:c085:208::f) by mail.thefacebook.com (2620:10d:c085:21d::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:54:31 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 41B56FE80A9E; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 08/12] dmapool: consolidate page initialization Date: Thu, 26 Jan 2023 13:51:21 -0800 Message-ID: <20230126215125.4069751-9-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: INcDSYzKdOWQqdCsWdJ80LcmIyyZM2Rj X-Proofpoint-GUID: INcDSYzKdOWQqdCsWdJ80LcmIyyZM2Rj X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspam-User: X-Rspamd-Server: rspam03 X-Stat-Signature: 7eataawh6qxowb9qa45a4keag996h41s X-Rspamd-Queue-Id: 4F74C100011 X-HE-Tag: 1674770074-277430 X-HE-Meta: U2FsdGVkX199kmgzwvaE+XpMphTogk5eKcg5DhxQgBllQE5yRl46leHrJJXrxPdtoRh80hL0CKZvbfo5CwN6+/Z1scUx7xAz0mMNanc9izKWgKJLgvxeA9yZ0BbVEETS7OFWRYGL1osTN50k2BetVbc8Bx9TQVeufZluk45BO+d9lZOQbDe+vpmn0xNvTpM/fHlHt+kb1nDtOWWb4hRYoZX1cncadv9xtcNxErDeQ1pe9e0NW+cdot82bgWIMobI+C0Bf6XNAagNNUPwj7XuZNdka2Bla26qiKlCTucaOerAp3lUhyMVsF6jgoA2prATvp+gudhTK2yMlCc9tYJGLWpuAMoU4w3PCf7yuq3zVq4vJrelJ+GBAPlrjnzYrG+yr4AqDegO9Zhe4rkwJZ3zNPvjVmpqcwpStznC/Ss1+NtlRtnxaN0sDKTg2kyKjKN/qCMthw0o6OXMWhZmHVUFpg3mcq03F4jDhHyZn44aCrBa7zsLkeZUifas8ElWXJp+syHF5c7Gi6D6VokQmS6VTODNhfzHkxPWLWc1NBwqf4cFuqEVWygJEZ75WCiYQVUu5p8u/gMopkwec3A9WwlKOU5+aN8MJ/4X8ZzDLQQ0Xa828RJFzh8ssMA7ECPk76nUkAOLrrlLjfeV8t9jxf+JRpPTf/kMx9DiGwWk8+3nGzc7kb9kKBM0ddE5PyIgLgE6KALs3sDL+xv1BXmOgL/5nDQCwcmjSe4q2xwmyTrHi11MMH94+ExOJIQ/6kRcqbh9aGfCal+QC9GZTHKiRm8KfBruD2M9s44nRgrrxueooAV3lyD76dUjRRy5Ct+2tb4Z1VwuttT/IrfMVqytnzIVSTEZqriF7pwZznaRhrp+dZMvqe5wLagceBEAE+YgzTBLYRHcovEiCO6ZoYZwSQIR23AsUs/y6Z96pvXsLCur9in0IqLb0KMUVse/sSuRg/9f2dljISnZ85snUKzL6Jo p4XxxoR2 c5sOUHZ/SHWgakXyv9/XKyJDvmffWJbf5FxffC+5egePuG0RrG88WZ8UW03VW7AJnnOVjhq1S2s8yTxps+EVWrYsXCaHGE/19gvbgOhDdP7c0ShSyKRMLryVzMtaDRHW3r3feLEt1wxW50hiwBhVeQ9AJtabDOgsWRgbYhZdra79OnUUqgL2Md8AmIte9MyRamyWXTF4RZE27OuPxNroIqn692RTnD78rLQWbxGe8rMTt2BDzr2RQj5H7hJPcdECRBbHkePt89fy+lJ4qGo+KfD80oihrAG2HTExZ+XTRC/p2UxWR3pBf6dp62mVeuHvT3LP2e64rcpAUPSF8nxJXcwotkbchWoZzEVFVrZWFIvqIM0a5z4Szea6zErfSB5umFk5KLqZc+GFayvY= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Keith Busch Various fields of the dma pool are set in different places. Move it all to one function. Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 7 +++---- 1 file changed, 3 insertions(+), 4 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index 900f2afa363a9..9e98065a68b1f 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -274,6 +274,9 @@ static void pool_initialise_page(struct dma_pool *pool, struct dma_page *page) unsigned int offset = 0; unsigned int next_boundary = pool->boundary; + pool_init_page(pool, page); + page->in_use = 0; + page->offset = 0; do { unsigned int next = offset + pool->size; if (unlikely((next + pool->size) >= next_boundary)) { @@ -300,11 +303,7 @@ static struct dma_page *pool_alloc_page(struct dma_pool *pool, gfp_t mem_flags) return NULL; } - pool_init_page(pool, page); pool_initialise_page(pool, page); - page->in_use = 0; - page->offset = 0; - return page; } From patchwork Thu Jan 26 21:51:22 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117839 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 45176C61D97 for ; Thu, 26 Jan 2023 21:54:43 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D6381900007; Thu, 26 Jan 2023 16:54:42 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id D15B5900002; Thu, 26 Jan 2023 16:54:42 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BDBA5900007; Thu, 26 Jan 2023 16:54:42 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id AF145900002 for ; Thu, 26 Jan 2023 16:54:42 -0500 (EST) Received: from smtpin28.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 785D3AB648 for ; Thu, 26 Jan 2023 21:54:42 +0000 (UTC) X-FDA: 80398305204.28.5688FA8 Received: from mx0a-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf26.hostedemail.com (Postfix) with ESMTP id 6F13114000A for ; Thu, 26 Jan 2023 21:54:40 +0000 (UTC) Authentication-Results: imf26.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=KqkMTtrM; spf=pass (imf26.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770080; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=7ImpmxP7Ob9uAWzmNXAlXZ2GzYOCB24lKi0O9CGQzBc=; b=3VEsHeXd4QbUN34S/WNeLzuiLsxf+S/96heTxYcZsOzviFvfTnKvu9I2LhqD1fDnWgx6xa LNqxTCDTPQ/5uM7rV+fseWUix90T5fBQpLy0huGXBXN3RAbzNyt0AKaiTnjA/CDmKaLOOS 00mO1o4LAJCoNuo2BKPbWsuaHxVM6/w= ARC-Authentication-Results: i=1; imf26.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=KqkMTtrM; spf=pass (imf26.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770080; a=rsa-sha256; cv=none; b=GMe1O+zwoFlyTpCioawYsM7r1EFDZds3ksaNkW1CWaxSq0jeaRpku32cv152nd02Nh/X3s ZEDUjlrn8lar4KvQtPQxfHeBlZDF8erzJcM0Dd6fODszvfEmNRHrSo5YnCtZG9S1zoQ2JM jWELx0DQYg/v+Bc5yvA19MLFejHmLQY= Received: from pps.filterd (m0089730.ppops.net [127.0.0.1]) by m0089730.ppops.net (8.17.1.19/8.17.1.19) with ESMTP id 30QGVnw3012820 for ; Thu, 26 Jan 2023 13:54:39 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=7ImpmxP7Ob9uAWzmNXAlXZ2GzYOCB24lKi0O9CGQzBc=; b=KqkMTtrMb15nIb7/axhvbitnXLLvlYSUU9bym5ow/oBPECtZ0nCOB0cH8R+xCd6UaCBc 9tFpsWOoTWmmOjgYUHxWWRQtQTHjIN4fas16vA2+GVyUBzJ6r86JRToq7ciYYGGz/s5j dg09UWI68EtCRR2UNEQfCoBbaC4VjGK4AY+zu9GedW7XT8/TrQDzeWs5iQjWg4nxKrEZ lfVOMPtII6Rn5aIfIzvkGtT4hskD6sUU7LPaHf1myacSufQo5LCD0RJrBspYMnYW/Vk5 Sj/mBR4w9rGmwSrmtIsXVJBT+xujjhWGJ4loJ/nG10u6loVgGYtsuP0qEZEZ5iLfVCGk RA== Received: from mail.thefacebook.com ([163.114.132.120]) by m0089730.ppops.net (PPS) with ESMTPS id 3nbw49tupx-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:54:39 -0800 Received: from twshared16996.15.frc2.facebook.com (2620:10d:c085:208::f) by mail.thefacebook.com (2620:10d:c085:21d::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:54:37 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 4BE6AFE80AA0; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 09/12] dmapool: simplify freeing Date: Thu, 26 Jan 2023 13:51:22 -0800 Message-ID: <20230126215125.4069751-10-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: R8TWBVgzVEmS-BeCco1OobRRRQFl-D_T X-Proofpoint-GUID: R8TWBVgzVEmS-BeCco1OobRRRQFl-D_T X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspam-User: X-Rspamd-Server: rspam03 X-Stat-Signature: yfsm57ifrhmm74ensn5gnf3q7hjh9otm X-Rspamd-Queue-Id: 6F13114000A X-HE-Tag: 1674770080-835753 X-HE-Meta: U2FsdGVkX1+ggF4OAo1gZLZHtAWGPmgA/zfgtibRDd5I9Cm+7EGXF6ajfgfCii8g9pOSDViLACWtx+xiMQionMNJeYZyvdcbKc1+FlbyXbPUa8+8jOL02kmZDwIst9CBY1KSN3ywMN3lfI7ZTIb8xmqlcGPhKpyw9QRfdV4CGzci5MQW5rQsj9mumMTsyepm0abvafP4iU+vOeWZ5a2Fofz/brz/YGx7Owe2LFdhWxbhY9dqYFT6YxyuZGI8v3zXsUII4reTsvT7DKariR3G4D6qKzltaWq1Oo3CzjhhpLgFwTt8uHij+Pjz0o8NtkFmJdFf91ZbVAGwjDOp6m2JFcLEeRQ6G8a60sVw2WQFg5dqO/6b48DsdQfRanaBioPs3eRUSE5mOBSg0oU5V0hIXuETEXTyCcLGfNAmJvRWiZ8vTOJW68f5qbuCp7L92XtspP7h4/suoZntGI4IrWAuLLDXgOYE7RBQ/iEdallmhFrPKeui+meCuTI6SVYHtlNT8ZLmHHnyObatWdj6Hiwq31sV/8UnguXcOcTxzOq3YWVuW7fOLpJqOg4gpCFFbuUZvQzaHb9GwTWaZvFp+Z33fJ0BRLyjWx5QycyNa7v210MbTXCbsBqFviw2JVnlR/QPWt7kCl3pIAtEd+pJajgQvgUPMjbMMGPEWW9GzEScH5v74C5eaOsBE+pewRfyiP461fE3FyKs9arukg+sWv5bSWBX0pzJo8C6lywrSaqeiubm7pfDameROqpUE3pyaJDEsG0dFK/9DQ6ZEJ2fbrc4ffZaMnozMHcoU43Lw7irWM5XiiC0xYxQTAOM/eCED0s7DZDIkAszfGQKUKcBy4Vxzox+TE0RS4HiSc5NaCDLNr/MjqJ1ojaNJ+vNI9ghdhE7PolBFaQtQa781l3pntFwsbZylL/+Q1DE/3IUEXC0iJXu6AWao9cLz+H9U5gFZ//pwAkgN5uuegN3aGMK/L7 knxCeq/m rH1shsa7BOvPVY+WPNEWmbDZ9nrsC0JM8eFk0T2qW7od1V21riSvfOznHN0hdnY9TipH2jKcaIhjUGt0d5ihCCCpSIPiW2zX53km99yZPIeM7xyt13D/IdgO9qdky16vtVwexSCvmTbrF21J7hC4MCtSwFnooUIcjEujnoDL6CAQZrM/xWfQ229CA4VcQMNzneRbSkRc1l4+tei95y+A9+9rUwDwhqs20ZH66jrlueOdzgBSTDQvpnhvGbwkk69382R2ZNmg9fb+ESuqh6RxAGzyWWslcObNV0N8VflpcqvhfDfpxB393YAXjt5NVy+x8jXclyXZbRntzk8jipI7RE8WgdT2jg23L1x+oFkCFBeDdrqJPTqYHc1Le8LyD00NlKgwI X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Keith Busch The actions for busy and not busy are mostly the same, so combine these and remove the unnecessary function. Also, the pool is about to be freed so there's no need to poison the page data since we only check for poison on alloc, which can't be done on a freed pool. Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 22 ++++++---------------- 1 file changed, 6 insertions(+), 16 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index 9e98065a68b1f..4dea2a0dbd336 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -312,16 +312,6 @@ static inline bool is_page_busy(struct dma_page *page) return page->in_use != 0; } -static void pool_free_page(struct dma_pool *pool, struct dma_page *page) -{ - dma_addr_t dma = page->dma; - - pool_init_page(pool, page); - dma_free_coherent(pool->dev, pool->allocation, page->vaddr, dma); - list_del(&page->page_list); - kfree(page); -} - /** * dma_pool_destroy - destroys a pool of dma memory blocks. * @pool: dma pool that will be destroyed @@ -349,14 +339,14 @@ void dma_pool_destroy(struct dma_pool *pool) mutex_unlock(&pools_reg_lock); list_for_each_entry_safe(page, tmp, &pool->page_list, page_list) { - if (is_page_busy(page)) { + if (!is_page_busy(page)) + dma_free_coherent(pool->dev, pool->allocation, + page->vaddr, page->dma); + else dev_err(pool->dev, "%s %s, %p busy\n", __func__, pool->name, page->vaddr); - /* leak the still-in-use consistent memory */ - list_del(&page->page_list); - kfree(page); - } else - pool_free_page(pool, page); + list_del(&page->page_list); + kfree(page); } kfree(pool); From patchwork Thu Jan 26 21:51:23 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117842 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id BD79FC05027 for ; Thu, 26 Jan 2023 21:58:34 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 598BC8E0003; Thu, 26 Jan 2023 16:58:34 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 5489E8E0001; Thu, 26 Jan 2023 16:58:34 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3E9A18E0003; Thu, 26 Jan 2023 16:58:34 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 29D2B8E0001 for ; Thu, 26 Jan 2023 16:58:34 -0500 (EST) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id F170580EE8 for ; Thu, 26 Jan 2023 21:58:33 +0000 (UTC) X-FDA: 80398314906.30.6DADAF6 Received: from mx0b-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf21.hostedemail.com (Postfix) with ESMTP id 023FE1C000F for ; Thu, 26 Jan 2023 21:58:31 +0000 (UTC) Authentication-Results: imf21.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=Hbx4OUL1; spf=pass (imf21.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770312; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=sTD50cTBzUMl+kZHjpCHKooMyDr+UIBBgnaoHVk+PWQ=; b=pygixLtqRBgGlGd9RY9kX451Jdp1XMxqXCvf7xWDK4VPhl5lbhpa3qCb1UWaQbE90Bpznq q8x+azhNpJh9L5gxZ/fXWV9JdRXoFUGvaSc4eXbOvTz9C5QZuwT5B2+YxbDNRifjV/te+U H9+7/vK9KARXjRBbKy8HICoWYxq18BU= ARC-Authentication-Results: i=1; imf21.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=Hbx4OUL1; spf=pass (imf21.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770312; a=rsa-sha256; cv=none; b=i9zWqZhqsXdm/KtE/TdzVVVRbg09mAkIq5VUoIqj3CvXK1LWzsKvPsJ0eMXCaO/lJw7/7i CSKdrr9eQP0X2kK5J/66CGS0k9lq5DjouNdNv5/9a/k2OzWGNaFee6KKm2+nKlhwE4ngqE +Q5vgznUcT8r1ogQz+VLYPDIR0Qefl4= Received: from pps.filterd (m0148460.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 30QKirom032695 for ; Thu, 26 Jan 2023 13:58:31 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=sTD50cTBzUMl+kZHjpCHKooMyDr+UIBBgnaoHVk+PWQ=; b=Hbx4OUL16Tu9e9qaQ44WJAfgoEPgn4JxNkq1VOs97Vy9ItigT2b8Q4kLJKrJbIpuQUZP +6BiNBTANridfBxVWSRcnd1uKjAIbLGzazO+eMxPGgsemIMwmQzLwD8+7LEgOYHude5P OuI+CbVVzPzVVFX3EwgkHACOV0tHMtvI9v4WEsRwFoUNopz9zaTpAv8y7yb4571iArwU vWQ8OpqrtrCWj9eV4VWu9NiyRi0Be2k36q4NhhIKYxyJkpZLwtSMF+xWmZg8s2tYFs/q BAUPjfJuceJOT72O6RGCY5/gBP/oNNDLo3iVnmZT9fOn9A627qyVFC+HFB1zD3MM+EED 0Q== Received: from mail.thefacebook.com ([163.114.132.120]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3nbvft37wg-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:58:31 -0800 Received: from twshared24547.08.ash9.facebook.com (2620:10d:c085:108::4) by mail.thefacebook.com (2620:10d:c085:21d::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:58:29 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 581ACFE80AA2; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 10/12] dmapool: don't memset on free twice Date: Thu, 26 Jan 2023 13:51:23 -0800 Message-ID: <20230126215125.4069751-11-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: hohyhMCUkHEpLWgIUPlVkqXN3LW1AWmc X-Proofpoint-GUID: hohyhMCUkHEpLWgIUPlVkqXN3LW1AWmc X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: 023FE1C000F X-Rspam-User: X-Stat-Signature: i6npspqhrmackgdxgyeu6wck3ka1uim7 X-HE-Tag: 1674770311-447777 X-HE-Meta: U2FsdGVkX18JZNmCgAmZyOr5eedMC9LAK8VOavXoZ+i/QWOmYcioySNXIQmfiq60bPOzpXPZjSTGCgGjq9BsMPG1hRZXl8Cg+aRJe9JgZ7dDmDJD+IeMsfXw54PJYlzq7IPxl1EqIu+GROnIZRqieICTJhw6/dQyHSNz4cBdI3AtRCRQXdnnQiXDjq4VxQvuLgUhI05B6mYrihGTYXM4SxpLKWZlHercgg/dUfwioi+TryLR/oGdKMzI7UslJJK5Jv3Cd7uzPPmdV72q5uFHOmx49Rtj3rkA9Z9SNLvVFAysb175eH9yrDQNceiXJDbWrPz7fnZnucjyer9bRcgbo3+D+dVxG9P03fOKQSTbJj/zqhnHVxbKAfOcjNLTnwGotG3No6kjIaJ0McabsH1JHeQxGgByn+o0w8SP810oabtKpwjaAhZ+VZNgoR/UddXPXTvUEHqTHqDHHmPVIUOSyPZFVDfBzDxegdMPNq6+uFq5neqvBLg7+wyxLA32dDZRv1aZvflg0VJV7kw9BkcX4CFZftxBWVKRZsVz5f05TVhQJL8Gm74K+goTsna7vn6UQI5YfVvetcQhguqmBu8mW6odup5Kv09qfts2TH8OlF/t/htFfUSJUNF2jsLG8A2MCSR7r7AqsZgNyocVdMAtuHe28VVN0iKFMpGVvkk7c+jZiZnEm4g84SrS24aEXTha3wHqzCZFCCnyyip9uI52u7pKDA/JZyWZkoxnw8jUm9723QsYJM7FMMkEfhMN26US+rc74S3M6Tr82Tvr7lI+i4C9U5oDzw89jL1N9dGpbT3lm7yT2rRpLQPwBU66yHlMfYcjk18PiywAupRoIrUuST300BQ6nMEqxDx2K+qDwNow0Q1rJE4jytjeOoIvsBmuqirbf1m/3EI8imzuROL1bhog19bjdWHkxEFLTst6AHaHa9XFnQ/73qJ2+IkRBGCulYPljk+yFwcMr8MSEJf rtuF0Y/C 5KUrz3Zrx0mH7yz3TXZJCbbTkZchHpXkegQ0FNFDJGYbzU5INmzIx3ZIrTBP68ZrtcXXqIVgynGkmGQAF19URUudvahVBJGb/je0qymVNFS4hRa8GyOf30AdvdDOsNC4Em7y8XLvIb1B+exNmmEUr4EtH9eQRipoJdIqc8DBSDoWdTKU1l0rGvOVCcxEzNEmib6rIfXS5C8GyflLww34S/6JXltpaXsyBVzD/HbNeyrq9d+k7FH/gXF3CcXgg/UTTVneiZihlYwM/hNgNdMYM6cJqTTPWNSLzY5OdbZ9TcZHHt3DnerdGGNoetEA7WWG91M9pat4GvJ0hOKUuDbKAZiik5Zo73PNCJyxJcqqaYxfpeDSd/4nYc7cyw6kA9mDjNHcbXohNm7Z1MB8= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Keith Busch If debug is enabled, dmapool will poison the range, so no need to clear it to 0 immediately before writing over it. Signed-off-by: Keith Busch Reviewed-by: Christoph Hellwig --- mm/dmapool.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index 4dea2a0dbd336..21e6d362c7264 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -160,6 +160,8 @@ static void pool_check_block(struct dma_pool *pool, void *retval, static bool pool_page_err(struct dma_pool *pool, struct dma_page *page, void *vaddr, dma_addr_t dma) { + if (want_init_on_free()) + memset(vaddr, 0, pool->size); return false; } @@ -441,8 +443,6 @@ void dma_pool_free(struct dma_pool *pool, void *vaddr, dma_addr_t dma) return; } - if (want_init_on_free()) - memset(vaddr, 0, pool->size); if (pool_page_err(pool, page, vaddr, dma)) { spin_unlock_irqrestore(&pool->lock, flags); return; From patchwork Thu Jan 26 21:51:24 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117841 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4758EC61D97 for ; Thu, 26 Jan 2023 21:54:50 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D8A6F900003; Thu, 26 Jan 2023 16:54:49 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id D3A69900002; Thu, 26 Jan 2023 16:54:49 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BDB5E900003; Thu, 26 Jan 2023 16:54:49 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id AD2BF900002 for ; Thu, 26 Jan 2023 16:54:49 -0500 (EST) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 919351A061D for ; Thu, 26 Jan 2023 21:54:49 +0000 (UTC) X-FDA: 80398305498.30.5C3C3EA Received: from mx0a-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf29.hostedemail.com (Postfix) with ESMTP id 813AA120002 for ; Thu, 26 Jan 2023 21:54:47 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=RVvlQC09; spf=pass (imf29.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770087; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=ym3OD4osXtfaDQhL4tTO/DBJCAlv3VdEBPxNqiwImY0=; b=hSRyQLYrOLGxeWKzguxFWBZ3DfE/eR5qHMbQIillBosnlHzHqdD0EnsT4dfX6WU0w2q6I+ KNn8NOmW5st4Tjc98v1yqNbeGGl0xRehFQiwVBijzKQly7M/AzINFMXnsUil7mMdt/xRnk 05wDFS/1+ILX6Zx4O2CEmi6ZxEU5x9Q= ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=RVvlQC09; spf=pass (imf29.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770087; a=rsa-sha256; cv=none; b=8IxL7QQNimgL13rArzI+7kaLfgVvkVsSNzI9OlX5/qmXH5KNX5iTj9ePBzZKTA3t5+d2K/ 7ppk/Xs9p+tMAxA/j+E9E+Sm7FAUvX80RMsvGpWoRf4kQUE/F9NuVuWK9l7VABuO8LJk/T 2bsVsHfsRdXvT/+Im5+msbQ60S/iVyo= Received: from pps.filterd (m0089730.ppops.net [127.0.0.1]) by m0089730.ppops.net (8.17.1.19/8.17.1.19) with ESMTP id 30QLqtUm013349 for ; Thu, 26 Jan 2023 13:54:46 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=ym3OD4osXtfaDQhL4tTO/DBJCAlv3VdEBPxNqiwImY0=; b=RVvlQC09tRlp1FaZCVNYTVshbDd+oPbzGeSyjBYtM1Gg9y/bwETi+MbIjGV1qhJgdtRc l1aCwxnJpRFQHxsYzS36Qv67g/U/K1ASZ5vJjW3C8Y8L0adqlh7J5QMqZTeviB3K752x HDITA35Z7Erhy4mMYFagxa6fK9uS4e2pnU2nRyQ9KOwTrF1WW4/trTMW4eqRiQgzvacn bYuBEtkl4cUEmNmX+QpSIY0n42j8y+B5KUl3i1lhbZqfcqkLl3cZffc9akcb/niWvN7u tssLzoWcryK95hWiR3HoS0bcL3Z/X3ofxAI880/hiLwTgQrRq9TXiVQfFZ2Qa3u1y7RW jw== Received: from mail.thefacebook.com ([163.114.132.120]) by m0089730.ppops.net (PPS) with ESMTPS id 3nbw49tur4-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:54:46 -0800 Received: from twshared24547.08.ash9.facebook.com (2620:10d:c085:108::8) by mail.thefacebook.com (2620:10d:c085:11d::4) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:54:45 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 6452FFE80AA4; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 11/12] dmapool: link blocks across pages Date: Thu, 26 Jan 2023 13:51:24 -0800 Message-ID: <20230126215125.4069751-12-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: 025HVp-hWsHgbwiXIoXFp4hFh9djlX0t X-Proofpoint-GUID: 025HVp-hWsHgbwiXIoXFp4hFh9djlX0t X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: 813AA120002 X-Rspam-User: X-Stat-Signature: zgbmq5mnyf636in1iy4onupd38fzgpgq X-HE-Tag: 1674770087-84547 X-HE-Meta: U2FsdGVkX19SwKHeSmMpGh6E9DkZw7x4mkW2B560TysY99UmAVqUV/zfs5zyFIbXWBZcoZb3qEoLmcX4nk8EEj97vNQRJcWBs9spkxUzUwjK5fWuNNl1P30fRU3xDkLqWp98QFl25Pq9tYa7K2xx1qqUuddZP907YzInEEu6y8Lw4kPCMwjiuNAtB3hvyGeTporIE2LZP393bQYkI2p2t29J1F9mOKxPJ7/OId9lD1/1iTYJScRFYi0QtjZBx1X0XB701odQCkCx50DJabQrKQ8epxkIqOlLv12zZCFNWQts4z/iCb5DLdPTOz44RBQ77ZNwQxsAU2kozF0CPQE4pHKVB7/o+tbM1o9yxDH1ras21MttjYT5JS0BZzP7GlZlNh7Xn1eROTka0a8qbwSlHgxJO/LyEiUDLJ9Q1hAzAHDOHWhVpEVFTwDZz0s0+7g10np3YVPqAcUcXDoeuhJuDc7BhIDKdaBCNPuL4iL/w3mqd3T4+apwzYEyRiJzt12HhBRXBCITPNkHioAnHbHlxC+z8F1OiIM2rl8FqoiI0eDS88o75LRPtwSoaoh9Gy9jIOUdigUAlT2lkMHoZvTlY314snTwd8yMLAnGCgXjItJcC3jAvFzixuowMAVMo/91KiLJIsVKbQKbnK12KAw5jUVgwiyWWaZHmOmpR3bykk9sxH9MaD75lYkpvSFQ52EVakMKQmE6xk/jC7y4Zp37w5DY181WtsdAt+/UrBfvvPv/mcrqjeXvNU6puvX9g7kSDLh/FdGyf8WYehWi4VOqe5W4SV5GxDTeJ2o4r4613WDrNF8FHUhf8vXUQkG4bxlNJYEmefc8FyeHJ/oOzUhHHB7BVJil75e0JxXdYaik0bcvs945oSMUllCrayy8sE3hHHcEEaHWMORmmZTgIFo+h4vXJ1Kg9nM7x/ZjynZIc6SZd9z3p8dLRghhPbasmzpREaFXnlRJwlTeuw/1zNq eBPaNcJy ehy2/FOJuUBXV7eH1CP7t34LwsGPab2YB0ZPfnRSY/kkuFcOhIlk8D4xtFrkXH6oi3brJcNl34q0MCnnODTo43XSIjfe0gV1Mn0sPogc+7/yjRTlu+t7Kr80eVBzJXM7Q658qLYQuFh+Tr2fH1naAoDLApdX3nKYjmHduK8CkP0nBb4zCN+HmcEu+MZkr46khJKd1o1zYgZF6IjoMtW1qdWr9cwqch7vshhf64KKpkWfDjH1QD1aK9tPu75CfnXU9b6WIcX9o8EcFXjw4kkf/y7hgcxrNtgzmn9mXagpbnTlwZIC+1RpXV9qTi/TVq5f5ljEJU8d7F6uFcov4eza9OfCkKh1GI/Qmk2JfD2k4hy+PAX5pLEM3DK/INeCa1Vta1lRE7poAhj91ZCo= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Keith Busch The allocated dmapool pages are never freed for the lifetime of the pool. There is no need for the two level list+stack lookup for finding a free block since nothing is ever removed from the list. Just use a simple stack, reducing time complexity to constant. The implementation inserts the stack linking elements and the dma handle of the block within itself when freed. This means the smallest possible dmapool block is increased to at most 16 bytes to accomodate these fields, but there are no exisiting users requesting a dma pool smaller than that anyway. Removing the list has a significant change in performance. Using the kernel's micro-benchmarking self test: Before: # modprobe dmapool_test dmapool test: size:16 blocks:8192 time:57282 dmapool test: size:64 blocks:8192 time:172562 dmapool test: size:256 blocks:8192 time:789247 dmapool test: size:1024 blocks:2048 time:371823 dmapool test: size:4096 blocks:1024 time:362237 After: # modprobe dmapool_test dmapool test: size:16 blocks:8192 time:24997 dmapool test: size:64 blocks:8192 time:26584 dmapool test: size:256 blocks:8192 time:33542 dmapool test: size:1024 blocks:2048 time:9022 dmapool test: size:4096 blocks:1024 time:6045 The module test allocates quite a few blocks that may not accurately represent how these pools are used in real life. For a more marco level benchmark, running fio high-depth + high-batched on nvme, this patch shows submission and completion latency reduced by ~100usec each, 1% IOPs improvement, and perf record's time spent in dma_pool_alloc/free were reduced by half. Reviewed-by: Christoph Hellwig Signed-off-by: Keith Busch --- mm/dmapool.c | 246 +++++++++++++++++++++++++-------------------------- 1 file changed, 119 insertions(+), 127 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index 21e6d362c7264..bb8893b4f4b96 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -15,7 +15,7 @@ * represented by the 'struct dma_pool' which keeps a doubly-linked list of * allocated pages. Each page in the page_list is split into blocks of at * least 'size' bytes. Free blocks are tracked in an unsorted singly-linked - * list of free blocks within the page. Used blocks aren't tracked, but we + * list of free blocks across all pages. Used blocks aren't tracked, but we * keep a count of how many are currently allocated from each page. */ @@ -40,9 +40,18 @@ #define DMAPOOL_DEBUG 1 #endif +struct dma_block { + struct dma_block *next_block; + dma_addr_t dma; +}; + struct dma_pool { /* the pool */ struct list_head page_list; spinlock_t lock; + struct dma_block *next_block; + size_t nr_blocks; + size_t nr_active; + size_t nr_pages; struct device *dev; unsigned int size; unsigned int allocation; @@ -55,8 +64,6 @@ struct dma_page { /* cacheable header for 'allocation' bytes */ struct list_head page_list; void *vaddr; dma_addr_t dma; - unsigned int in_use; - unsigned int offset; }; static DEFINE_MUTEX(pools_lock); @@ -64,30 +71,18 @@ static DEFINE_MUTEX(pools_reg_lock); static ssize_t pools_show(struct device *dev, struct device_attribute *attr, char *buf) { - int size; - struct dma_page *page; struct dma_pool *pool; + unsigned size; size = sysfs_emit(buf, "poolinfo - 0.1\n"); mutex_lock(&pools_lock); list_for_each_entry(pool, &dev->dma_pools, pools) { - unsigned pages = 0; - size_t blocks = 0; - - spin_lock_irq(&pool->lock); - list_for_each_entry(page, &pool->page_list, page_list) { - pages++; - blocks += page->in_use; - } - spin_unlock_irq(&pool->lock); - /* per-pool info, no real statistics yet */ - size += sysfs_emit_at(buf, size, "%-16s %4zu %4zu %4u %2u\n", - pool->name, blocks, - (size_t) pages * - (pool->allocation / pool->size), - pool->size, pages); + size += sysfs_emit_at(buf, size, "%-16s %4zu %4zu %4u %2zu\n", + pool->name, pool->nr_active, + pool->nr_blocks, pool->size, + pool->nr_pages); } mutex_unlock(&pools_lock); @@ -97,17 +92,17 @@ static ssize_t pools_show(struct device *dev, struct device_attribute *attr, cha static DEVICE_ATTR_RO(pools); #ifdef DMAPOOL_DEBUG -static void pool_check_block(struct dma_pool *pool, void *retval, - unsigned int offset, gfp_t mem_flags) +static void pool_check_block(struct dma_pool *pool, struct dma_block *block, + gfp_t mem_flags) { + u8 *data = (void *)block; int i; - u8 *data = retval; - /* page->offset is stored in first 4 bytes */ - for (i = sizeof(offset); i < pool->size; i++) { + + for (i = sizeof(struct dma_block); i < pool->size; i++) { if (data[i] == POOL_POISON_FREED) continue; - dev_err(pool->dev, "%s %s, %p (corrupted)\n", - __func__, pool->name, retval); + dev_err(pool->dev, "%s %s, %p (corrupted)\n", __func__, + pool->name, block); /* * Dump the first 4 bytes even if they are not @@ -117,31 +112,46 @@ static void pool_check_block(struct dma_pool *pool, void *retval, data, pool->size, 1); break; } + if (!want_init_on_alloc(mem_flags)) - memset(retval, POOL_POISON_ALLOCATED, pool->size); + memset(block, POOL_POISON_ALLOCATED, pool->size); +} + +static struct dma_page *pool_find_page(struct dma_pool *pool, dma_addr_t dma) +{ + struct dma_page *page; + + list_for_each_entry(page, &pool->page_list, page_list) { + if (dma < page->dma) + continue; + if ((dma - page->dma) < pool->allocation) + return page; + } + return NULL; } -static bool pool_page_err(struct dma_pool *pool, struct dma_page *page, - void *vaddr, dma_addr_t dma) +static bool pool_block_err(struct dma_pool *pool, void *vaddr, dma_addr_t dma) { - unsigned int offset = vaddr - page->vaddr; - unsigned int chain = page->offset; + struct dma_block *block = pool->next_block; + struct dma_page *page; - if ((dma - page->dma) != offset) { - dev_err(pool->dev, "%s %s, %p (bad vaddr)/%pad\n", + page = pool_find_page(pool, dma); + if (!page) { + dev_err(pool->dev, "%s %s, %p/%pad (bad dma)\n", __func__, pool->name, vaddr, &dma); return true; } - while (chain < pool->allocation) { - if (chain != offset) { - chain = *(int *)(page->vaddr + chain); + while (block) { + if (block != vaddr) { + block = block->next_block; continue; } dev_err(pool->dev, "%s %s, dma %pad already free\n", __func__, pool->name, &dma); return true; } + memset(vaddr, POOL_POISON_FREED, pool->size); return false; } @@ -151,14 +161,12 @@ static void pool_init_page(struct dma_pool *pool, struct dma_page *page) memset(page->vaddr, POOL_POISON_FREED, pool->allocation); } #else -static void pool_check_block(struct dma_pool *pool, void *retval, - unsigned int offset, gfp_t mem_flags) - +static void pool_check_block(struct dma_pool *pool, struct dma_block *block, + gfp_t mem_flags) { } -static bool pool_page_err(struct dma_pool *pool, struct dma_page *page, - void *vaddr, dma_addr_t dma) +static bool pool_block_err(struct dma_pool *pool, void *vaddr, dma_addr_t dma) { if (want_init_on_free()) memset(vaddr, 0, pool->size); @@ -170,6 +178,26 @@ static void pool_init_page(struct dma_pool *pool, struct dma_page *page) } #endif +static struct dma_block *pool_block_pop(struct dma_pool *pool) +{ + struct dma_block *block = pool->next_block; + + if (block) { + pool->next_block = block->next_block; + pool->nr_active++; + } + return block; +} + +static void pool_block_push(struct dma_pool *pool, struct dma_block *block, + dma_addr_t dma) +{ + block->dma = dma; + block->next_block = pool->next_block; + pool->next_block = block; +} + + /** * dma_pool_create - Creates a pool of consistent memory blocks, for dma. * @name: name of pool, for diagnostics @@ -210,8 +238,8 @@ struct dma_pool *dma_pool_create(const char *name, struct device *dev, if (size == 0 || size > INT_MAX) return NULL; - else if (size < 4) - size = 4; + if (size < sizeof(struct dma_block)) + size = sizeof(struct dma_block); size = ALIGN(size, align); allocation = max_t(size_t, size, PAGE_SIZE); @@ -223,7 +251,7 @@ struct dma_pool *dma_pool_create(const char *name, struct device *dev, boundary = min(boundary, allocation); - retval = kmalloc(sizeof(*retval), GFP_KERNEL); + retval = kzalloc(sizeof(*retval), GFP_KERNEL); if (!retval) return retval; @@ -236,7 +264,6 @@ struct dma_pool *dma_pool_create(const char *name, struct device *dev, retval->size = size; retval->boundary = boundary; retval->allocation = allocation; - INIT_LIST_HEAD(&retval->pools); /* @@ -273,21 +300,25 @@ EXPORT_SYMBOL(dma_pool_create); static void pool_initialise_page(struct dma_pool *pool, struct dma_page *page) { - unsigned int offset = 0; - unsigned int next_boundary = pool->boundary; + unsigned int next_boundary = pool->boundary, offset = 0; + struct dma_block *block; pool_init_page(pool, page); - page->in_use = 0; - page->offset = 0; - do { - unsigned int next = offset + pool->size; - if (unlikely((next + pool->size) >= next_boundary)) { - next = next_boundary; + while (offset + pool->size <= pool->allocation) { + if (offset + pool->size > next_boundary) { + offset = next_boundary; next_boundary += pool->boundary; + continue; } - *(int *)(page->vaddr + offset) = next; - offset = next; - } while (offset < pool->allocation); + + block = page->vaddr + offset; + pool_block_push(pool, block, page->dma + offset); + offset += pool->size; + pool->nr_blocks++; + } + + list_add(&page->page_list, &pool->page_list); + pool->nr_pages++; } static struct dma_page *pool_alloc_page(struct dma_pool *pool, gfp_t mem_flags) @@ -305,15 +336,9 @@ static struct dma_page *pool_alloc_page(struct dma_pool *pool, gfp_t mem_flags) return NULL; } - pool_initialise_page(pool, page); return page; } -static inline bool is_page_busy(struct dma_page *page) -{ - return page->in_use != 0; -} - /** * dma_pool_destroy - destroys a pool of dma memory blocks. * @pool: dma pool that will be destroyed @@ -325,7 +350,7 @@ static inline bool is_page_busy(struct dma_page *page) void dma_pool_destroy(struct dma_pool *pool) { struct dma_page *page, *tmp; - bool empty = false; + bool empty = false, busy = false; if (unlikely(!pool)) return; @@ -340,13 +365,15 @@ void dma_pool_destroy(struct dma_pool *pool) device_remove_file(pool->dev, &dev_attr_pools); mutex_unlock(&pools_reg_lock); + if (pool->nr_active) { + dev_err(pool->dev, "%s %s busy\n", __func__, pool->name); + busy = true; + } + list_for_each_entry_safe(page, tmp, &pool->page_list, page_list) { - if (!is_page_busy(page)) + if (!busy) dma_free_coherent(pool->dev, pool->allocation, page->vaddr, page->dma); - else - dev_err(pool->dev, "%s %s, %p busy\n", __func__, - pool->name, page->vaddr); list_del(&page->page_list); kfree(page); } @@ -368,58 +395,40 @@ EXPORT_SYMBOL(dma_pool_destroy); void *dma_pool_alloc(struct dma_pool *pool, gfp_t mem_flags, dma_addr_t *handle) { - unsigned long flags; + struct dma_block *block; struct dma_page *page; - unsigned int offset; - void *retval; + unsigned long flags; might_alloc(mem_flags); spin_lock_irqsave(&pool->lock, flags); - list_for_each_entry(page, &pool->page_list, page_list) { - if (page->offset < pool->allocation) - goto ready; - } - - /* pool_alloc_page() might sleep, so temporarily drop &pool->lock */ - spin_unlock_irqrestore(&pool->lock, flags); - - page = pool_alloc_page(pool, mem_flags & (~__GFP_ZERO)); - if (!page) - return NULL; + block = pool_block_pop(pool); + if (!block) { + /* + * pool_alloc_page() might sleep, so temporarily drop + * &pool->lock + */ + spin_unlock_irqrestore(&pool->lock, flags); - spin_lock_irqsave(&pool->lock, flags); + page = pool_alloc_page(pool, mem_flags & (~__GFP_ZERO)); + if (!page) + return NULL; - list_add(&page->page_list, &pool->page_list); - ready: - page->in_use++; - offset = page->offset; - page->offset = *(int *)(page->vaddr + offset); - retval = offset + page->vaddr; - *handle = offset + page->dma; - pool_check_block(pool, retval, offset, mem_flags); + spin_lock_irqsave(&pool->lock, flags); + pool_initialise_page(pool, page); + block = pool_block_pop(pool); + } spin_unlock_irqrestore(&pool->lock, flags); + *handle = block->dma; + pool_check_block(pool, block, mem_flags); if (want_init_on_alloc(mem_flags)) - memset(retval, 0, pool->size); + memset(block, 0, pool->size); - return retval; + return block; } EXPORT_SYMBOL(dma_pool_alloc); -static struct dma_page *pool_find_page(struct dma_pool *pool, dma_addr_t dma) -{ - struct dma_page *page; - - list_for_each_entry(page, &pool->page_list, page_list) { - if (dma < page->dma) - continue; - if ((dma - page->dma) < pool->allocation) - return page; - } - return NULL; -} - /** * dma_pool_free - put block back into dma pool * @pool: the dma pool holding the block @@ -431,31 +440,14 @@ static struct dma_page *pool_find_page(struct dma_pool *pool, dma_addr_t dma) */ void dma_pool_free(struct dma_pool *pool, void *vaddr, dma_addr_t dma) { - struct dma_page *page; + struct dma_block *block = vaddr; unsigned long flags; spin_lock_irqsave(&pool->lock, flags); - page = pool_find_page(pool, dma); - if (!page) { - spin_unlock_irqrestore(&pool->lock, flags); - dev_err(pool->dev, "%s %s, %p/%pad (bad dma)\n", - __func__, pool->name, vaddr, &dma); - return; + if (!pool_block_err(pool, vaddr, dma)) { + pool_block_push(pool, block, dma); + pool->nr_active--; } - - if (pool_page_err(pool, page, vaddr, dma)) { - spin_unlock_irqrestore(&pool->lock, flags); - return; - } - - page->in_use--; - *(int *)vaddr = page->offset; - page->offset = vaddr - page->vaddr; - /* - * Resist a temptation to do - * if (!is_page_busy(page)) pool_free_page(pool, page); - * Better have a few empty pages hang around. - */ spin_unlock_irqrestore(&pool->lock, flags); } EXPORT_SYMBOL(dma_pool_free); From patchwork Thu Jan 26 21:51:25 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Keith Busch X-Patchwork-Id: 13117840 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id F1F81C05027 for ; Thu, 26 Jan 2023 21:54:45 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 8F67A900008; Thu, 26 Jan 2023 16:54:45 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 8A6EF900002; Thu, 26 Jan 2023 16:54:45 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 76EBA900008; Thu, 26 Jan 2023 16:54:45 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 66269900002 for ; Thu, 26 Jan 2023 16:54:45 -0500 (EST) Received: from smtpin07.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 4BAA5A0EF2 for ; Thu, 26 Jan 2023 21:54:45 +0000 (UTC) X-FDA: 80398305330.07.A5B80A2 Received: from mx0a-00082601.pphosted.com (mx0b-00082601.pphosted.com [67.231.153.30]) by imf28.hostedemail.com (Postfix) with ESMTP id 5655DC0010 for ; Thu, 26 Jan 2023 21:54:43 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=lVrUtV7e; spf=pass (imf28.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674770083; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=3bZHL2Z78cKAF6RylfMcYGJJt43dfPQsNy0PbvPE3is=; b=zt2bN+AE5nYEGbMGkF9GEIVn+w4SNXzbzLAwl1RDPvMknbQAQN7m++qWsMiDhzUlCEddcP EOfQzL1rmBVbo7Q95J1y1E44HCIyz3q69SWeZqz89pknxUA4ASs0elKQYp3tMhcXPUfEmm LIjeovezO6FEZs+ZoDxup/J8rHaIrE0= ARC-Authentication-Results: i=1; imf28.hostedemail.com; dkim=pass header.d=meta.com header.s=s2048-2021-q4 header.b=lVrUtV7e; spf=pass (imf28.hostedemail.com: domain of "prvs=4390123481=kbusch@meta.com" designates 67.231.153.30 as permitted sender) smtp.mailfrom="prvs=4390123481=kbusch@meta.com"; dmarc=pass (policy=reject) header.from=meta.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674770083; a=rsa-sha256; cv=none; b=ZaRp1XJcSryG3C4zaqKfgbg+UdV9WFNeU8VV4Ursjjdnnij3TN4mdM/Ikti/qMaXdqh9KN UI2zM22DsTXOYVW+/TB4Lgb2rlvFbBfUosNrDPi+Wc9RPjc9WClPrMeJ1l/ueStL8V8pu9 Vcp8C6NUD1qvGgW2LeK3pnjt8jK5L58= Received: from pps.filterd (m0001303.ppops.net [127.0.0.1]) by m0001303.ppops.net (8.17.1.19/8.17.1.19) with ESMTP id 30QJ9NFU028224 for ; Thu, 26 Jan 2023 13:54:42 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meta.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=s2048-2021-q4; bh=3bZHL2Z78cKAF6RylfMcYGJJt43dfPQsNy0PbvPE3is=; b=lVrUtV7eIfA+pTjKwQ4ayJK+j8lGNrnWZANTogfISnYDcFY9OF80Vn5S04uuKHS/jvMb EeIGIEZdjrEWbgNpuS8LBQAaHrWV0XYxLUVb/6Ed1igPwjGL2oDsIWOAwyfA9vMPoAg/ FSab2TSFYmid8os9V6E+9I8CkMTsyXS9OMoypXZdyoOYM+Eh4FSii6xiMosOSPIu8Ugm Fe4yICWSigw/3zCpzzISOciiyvIN1f0JvD8MxwEtigJPCeUM4eEqHqzxGcg0HvCEt4Qy y3+QrA+qmX6r+kanWgp4UYVU9/3jM5IO4hErIm4/A4RrjzXCeXZNVhz5SakVnWoRMigx Sw== Received: from maileast.thefacebook.com ([163.114.130.16]) by m0001303.ppops.net (PPS) with ESMTPS id 3nbe8yye5b-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Thu, 26 Jan 2023 13:54:42 -0800 Received: from twshared1408.04.ash8.facebook.com (2620:10d:c0a8:1b::d) by mail.thefacebook.com (2620:10d:c0a8:82::f) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.17; Thu, 26 Jan 2023 13:54:41 -0800 Received: by devbig007.nao1.facebook.com (Postfix, from userid 544533) id 72918FE80AA6; Thu, 26 Jan 2023 13:51:26 -0800 (PST) From: Keith Busch To: , , , , , CC: , Keith Busch Subject: [PATCHv4 12/12] dmapool: create/destroy cleanup Date: Thu, 26 Jan 2023 13:51:25 -0800 Message-ID: <20230126215125.4069751-13-kbusch@meta.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20230126215125.4069751-1-kbusch@meta.com> References: <20230126215125.4069751-1-kbusch@meta.com> MIME-Version: 1.0 X-FB-Internal: Safe X-Proofpoint-ORIG-GUID: GSrII1cJIgj5cG6Z78bsXS52FzT54NHW X-Proofpoint-GUID: GSrII1cJIgj5cG6Z78bsXS52FzT54NHW X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-01-26_09,2023-01-26_01,2022-06-22_01 X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: 5655DC0010 X-Rspam-User: X-Stat-Signature: 6x4qcxfutizf5uk7pdm9rsogwsqoxnb8 X-HE-Tag: 1674770083-14214 X-HE-Meta: U2FsdGVkX1+JGRRUAwcSk/cWId+Sn6DlBuuubMQQHh8IH95APyRB7kmdyeyeV7hzryz4FBUpfx26BdzVbvd7gDRp/5DgxerAWfQ+5QxZX2pzD8heJ+TVnt+jfKrtjUDad5aCIvmXjE5MLiWCLcPjvurx2kEiVB+DFdTEIQVcCtQrNqlZCe7hu1uhNMahwuejIHReN09eHFfrxT6aU5GCyP2RLUux2SQrE29ZqC+MhpitxjuS17eOlsgmYuMpWB2gK6PFzOG24G6RJ36pUBhM1+K67FQX5MZ9pyzb1py9QV0FdacFiEIkpHiXBDRWWCgLbcXGx8SEmmtwQBtO1Lb/6uL28vddAolFDVqO58RhidM1POuByNXIhFr4gcQDrSTCL7Z8fLvcQxAccxVRmd1PylG6nL0jO0BZrJmIKhnMGrp8AtixDYJTdjWu7LpKeQnC5N8D3f8vdoyk6UbZmANEqxYZzt+dxoEpdmARSPy7jUrL4M9VNRh3bx/bXHNjcjZlLeo12G3dMPc31h6hRrlbduRI1+ker11VJY1ZvuA68gNFJtZGmyfXGiOqH1WF3G890TvwltMW3jwh6GUelb6sn3HRjapM40xo3sNBoKGB4XeD7eDWabO5jI86zI+Fz3/pDxLDFl9ZRDwQGJaJdb7SVULFyUu/WjWnsFcuK57Yz+skP6d8tFuPn3GRbntpB2DqIPf29vPK1q4Olq4FJTOFHzlvHE8xDoLFVvK9HiwjFQ2IzriFGQZPjr4cuMEJqhvZGPgp98VGLK45YnFq67XmhnKgF2cyPbEegmPudMrkYuX0W8NWQnK+DxXy56cO35+lVOND8bh4biTl8oLNomv+4rx9SJusjVbphSWDPC4u38FGYhro9mYOvY69AKvNRl7X1Xj9G3hHfcVal/eoRb7Ns76IGzydell097piKG9xCaa+EzbIgpSpMl3epuDAkJypyJOvHgXmhp4tULclNU8 pJBS4CnC +v7r91Fqu8V4b0zz3MFlEWjPeEA6trxy49aBzwlSZyUYWZBUArzHc1B44y2QnM7RNx8LhjBIFjVi2++jspIUXTFpMAb+MbZfeQJ3P0CzKNLsugHOT+K3TlW7MofUz2uX2avj27PfERo+t87WWTvdZnhKCsMmJE6iqaqoCelMZjcF3m64d7rVEw4PrMaJBAJO7jEWRjera1ghJCV7KU4ymFg8urPdz6GfjUaGUO+Gga3gO6REzt6o1T+LS3/4ST7FPrrFcSReWA/bDGgTXtkoODOGav3uVxIdZGrJqohDxwOD2J96Or6PKXzCejtY795Sk5sotIIdEQ1o+1ubTf8vn2VDBD8a1SOyzmMkDchk9mTR0U9pjApsO/q3dqYMC+qOdv3vkYKsFdC1VUMg= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Keith Busch Set the 'empty' bool directly from the result of the function that determines its value instead of adding additional logic. Reviewed-by: Christoph Hellwig Signed-off-by: Keith Busch --- mm/dmapool.c | 10 ++++------ 1 file changed, 4 insertions(+), 6 deletions(-) diff --git a/mm/dmapool.c b/mm/dmapool.c index bb8893b4f4b96..1920890ff8d3d 100644 --- a/mm/dmapool.c +++ b/mm/dmapool.c @@ -226,7 +226,7 @@ struct dma_pool *dma_pool_create(const char *name, struct device *dev, { struct dma_pool *retval; size_t allocation; - bool empty = false; + bool empty; if (!dev) return NULL; @@ -276,8 +276,7 @@ struct dma_pool *dma_pool_create(const char *name, struct device *dev, */ mutex_lock(&pools_reg_lock); mutex_lock(&pools_lock); - if (list_empty(&dev->dma_pools)) - empty = true; + empty = list_empty(&dev->dma_pools); list_add(&retval->pools, &dev->dma_pools); mutex_unlock(&pools_lock); if (empty) { @@ -350,7 +349,7 @@ static struct dma_page *pool_alloc_page(struct dma_pool *pool, gfp_t mem_flags) void dma_pool_destroy(struct dma_pool *pool) { struct dma_page *page, *tmp; - bool empty = false, busy = false; + bool empty, busy = false; if (unlikely(!pool)) return; @@ -358,8 +357,7 @@ void dma_pool_destroy(struct dma_pool *pool) mutex_lock(&pools_reg_lock); mutex_lock(&pools_lock); list_del(&pool->pools); - if (list_empty(&pool->dev->dma_pools)) - empty = true; + empty = list_empty(&pool->dev->dma_pools); mutex_unlock(&pools_lock); if (empty) device_remove_file(pool->dev, &dev_attr_pools);