From patchwork Sun Mar 12 11:26:11 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Kirill A. Shutemov" X-Patchwork-Id: 13171311 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 45C2AC6FA99 for ; Sun, 12 Mar 2023 11:27:14 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C9BD48E0013; Sun, 12 Mar 2023 07:27:13 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id C237D8E0014; Sun, 12 Mar 2023 07:27:13 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 916FB8E0013; Sun, 12 Mar 2023 07:27:13 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 8205F8E000E for ; Sun, 12 Mar 2023 07:27:13 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 61D0940967 for ; Sun, 12 Mar 2023 11:27:13 +0000 (UTC) X-FDA: 80560019946.16.F7D1368 Received: from mga06.intel.com (mga06b.intel.com [134.134.136.31]) by imf23.hostedemail.com (Postfix) with ESMTP id 1FBED14000B for ; Sun, 12 Mar 2023 11:27:10 +0000 (UTC) Authentication-Results: imf23.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=HYxkFnDy; dmarc=pass (policy=none) header.from=intel.com; spf=none (imf23.hostedemail.com: domain of kirill.shutemov@linux.intel.com has no SPF policy when checking 134.134.136.31) smtp.mailfrom=kirill.shutemov@linux.intel.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1678620431; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=69xvf/JgEEAl7d6NLv74/ovYVtBOKl6f6shs5hVJmMY=; b=lOWHFOzsb8gD303g5vr0RWjXw0xG5DxVtCpvrvKLxappJkNQD8vuNV5J9R+c4LWb7e0kmW geSmzoRhBE6RvTQi402Wa625fTT6QjZLPFIOh5faJOCUh7Otx2IXPswGoN1f5EGDs2PnaF kwlZVueCBZEP7UKdY0Gqn0QTZ9tvULU= ARC-Authentication-Results: i=1; imf23.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=HYxkFnDy; dmarc=pass (policy=none) header.from=intel.com; spf=none (imf23.hostedemail.com: domain of kirill.shutemov@linux.intel.com has no SPF policy when checking 134.134.136.31) smtp.mailfrom=kirill.shutemov@linux.intel.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1678620431; a=rsa-sha256; cv=none; b=UDbGCQOQGzdOuSzamP+4GQau7W3c0ZwMjZ3fQe3DqtnrVhLbUQGGUL2XZF39vzc73Kn8Z2 T4bjQAhpcKkNr2i0QA104MBOVXptly6EvEXgyXPI7+LA1Ps4oFSydxFnaxMoEC1B4k+S+M U1wD5G1clZuDrWXmzqh+qQOLEwXY1ms= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1678620431; x=1710156431; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=vqjgq0aq/HN6otn18FAaGaVeHvXItWk0KcS4vZFq+qs=; b=HYxkFnDyJl7ExV0+fFqfKnp0x5gjWQUOj61j5ixDXbavkjmM+tM7dyma ACRSW7jFklZ+ScaDZIwdKThEmvYyPcJbTi5RTVzADOrPhwws+hUjOHE1U 9yy6zHpg4+7DC0YrbI0GPJG5fdvNB4U10YvA1boHkKUSvvC289B1yJ3ox GLzxi5rAOduWYiloxxd9LSx69IvzAHgkzvAsUnkX+gXgXjhc0yLzknJXf LxGux8hHY0GGUXBf+vXFcaKVh59yZ+1lhlJtMK2XvBxOVF225GEAsnehB do7kB4mKG+31FGuQUQn34mBDNVrkGF9teCeZyN8rfqZvivPD/8nuFkFZB A==; X-IronPort-AV: E=McAfee;i="6500,9779,10646"; a="399577666" X-IronPort-AV: E=Sophos;i="5.98,254,1673942400"; d="scan'208";a="399577666" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by orsmga104.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Mar 2023 04:26:43 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10646"; a="671580757" X-IronPort-AV: E=Sophos;i="5.98,254,1673942400"; d="scan'208";a="671580757" Received: from nmoazzen-mobl1.amr.corp.intel.com (HELO box.shutemov.name) ([10.251.219.215]) by orsmga007-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Mar 2023 04:26:38 -0700 Received: by box.shutemov.name (Postfix, from userid 1000) id 01B1710D7BE; Sun, 12 Mar 2023 14:26:20 +0300 (+03) From: "Kirill A. Shutemov" To: Dave Hansen , Andy Lutomirski , Peter Zijlstra Cc: x86@kernel.org, Kostya Serebryany , Andrey Ryabinin , Andrey Konovalov , Alexander Potapenko , Taras Madan , Dmitry Vyukov , "H . J . Lu" , Andi Kleen , Rick Edgecombe , Bharata B Rao , Jacob Pan , Ashok Raj , Linus Torvalds , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Weihong Zhang , "Kirill A . Shutemov" Subject: [PATCHv16 16/17] selftests/x86/lam: Add ARCH_FORCE_TAGGED_SVA test cases for linear-address masking Date: Sun, 12 Mar 2023 14:26:11 +0300 Message-Id: <20230312112612.31869-17-kirill.shutemov@linux.intel.com> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20230312112612.31869-1-kirill.shutemov@linux.intel.com> References: <20230312112612.31869-1-kirill.shutemov@linux.intel.com> MIME-Version: 1.0 X-Rspamd-Queue-Id: 1FBED14000B X-Rspamd-Server: rspam09 X-Rspam-User: X-Stat-Signature: urujzgkgckkqotiiegkros6hpdb9nt1u X-HE-Tag: 1678620430-474388 X-HE-Meta: U2FsdGVkX1/1rYtTeblP8Mg4E5JPMHL4lbOgvb267Vrg9y10hOgMM1tqeppwbu5OPp23aLG055rzOGLWfeCPuMb6BJFJvX6VsCHrg2I/b+0OQgps6GpygmQtfBDgEPH5z3IbooreHyBVhr7n7a9ax/ikt4MNMOnk6tYzgYRptlvVhnuGKy/Ajd7j27lR30AIoAUJfi4nRfiOn/mquatyROuz8HxXM0OFm6ISuRow1H+kCZwhksmicc1vjXla37mJRR386ubaCqCGDzEiERqsuYzELbnGT1M0DevSBjd2g4KF8ngfIaHC9mefJnmOaV1cz/hAICPM7L+ZNsBPQEjnmFxVTvAGApRn49E5+De3dDhKfexp+v7XTCo12Os8kLi38tk4C+u6v1sV/ePfIg0T2PH9/MXeVVJaxQacfQklMYPtHrnUheC5kwSbv9A2hQ90Ux48b8CvWyesRY3/vk2AfywmZ0aJPNnCJ91piR8OAUlBsgDok/MopE319cQ6v7Hz/SfBwGmtdmLQNiblbykSENx7nHm4VTujp7EoU0XX51FTVKoRIEeVyVasbjr796bzIVr8E1tlve8M33UkBk/TpcfAbtsOtmuztaEZL+qajMjBVnMtYmKQI7HcpNlKAp+kFLi5gJXkG7BoypCgb5LcMP1rH1fdRkLXKYTsKG3R5Jd61shXWvCEtGgdyCpkqXvnnjXLwK/6PHoxN81RHHCyyTL0nBvJI/QKkyudnmMIN8uQVPdH7cuD+2vO1chDyoFjE5gi+DRaL+o7fwq6R72Nt5tOEoEYxvKGSHm0UK8ZdpcEaH/ZqVfiiZnN5bgVEWitLDhyoMpMIMwHhVPxqu1xRdyNmDHJt9Yc+ebEg0z6SBpQOuCtkHcZ/WBT0kax5yZ8KoY/U9t8rDoJrp4L6392pRhcEBhBzoQwutMMi9pLNcpFCZHvR7BXK9YEuK9GHCEhsngJSgtpNXUeU6BPwGf rSycElbl AMf0eMNfmR2nIQWQIKNJmf7WH/1S4yLtP1+YvfV9EoS7xe0GNrLzHDyDC5SfQh2GqDE+yd8izcvqWORF2hnlXKbE0czT01w+ca5AmBMmDfsnl4PR2XPtoZZBJUTWEP3e7MtxDixxlU3k3utmrWCon10m9e2429r0/sb06MWBLoxdLyg2Djzua5Vl5CKZwZWFRwrMKkmDDNUc9FpBl1EZvSMDIW6+4fVeCleI6Ql7AgM7J+mF73i/SJYp0o/ClJbPPjsZHb54DdsZjdX3YLoyTkse5TkaSAyJBSrC9JOBAKPnKHgrKO+eanzhIdxOwaUBT87Pf441ApHEj9sZeqwmZtydZjQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Weihong Zhang By default do not allow to enable both LAM and use SVA in the same process. The new ARCH_FORCE_TAGGED_SVA arch_prctl() overrides the limitation. Add new test cases for the new arch_prctl: Before using ARCH_FORCE_TAGGED_SVA, should not allow to enable LAM/SVA coexisting. the test cases should be negative. The test depands on idxd driver and iommu. before test, need add "intel_iommu=on,sm_on" in kernel command line and insmod idxd driver. Signed-off-by: Weihong Zhang Signed-off-by: Kirill A. Shutemov Acked-by: Peter Zijlstra (Intel) --- tools/testing/selftests/x86/lam.c | 237 +++++++++++++++++++++++++++++- 1 file changed, 235 insertions(+), 2 deletions(-) diff --git a/tools/testing/selftests/x86/lam.c b/tools/testing/selftests/x86/lam.c index ebabd4333b7d..a8c91829b616 100644 --- a/tools/testing/selftests/x86/lam.c +++ b/tools/testing/selftests/x86/lam.c @@ -30,6 +30,7 @@ #define ARCH_GET_UNTAG_MASK 0x4001 #define ARCH_ENABLE_TAGGED_ADDR 0x4002 #define ARCH_GET_MAX_TAG_BITS 0x4003 +#define ARCH_FORCE_TAGGED_SVA 0x4004 /* Specified test function bits */ #define FUNC_MALLOC 0x1 @@ -38,8 +39,9 @@ #define FUNC_SYSCALL 0x8 #define FUNC_URING 0x10 #define FUNC_INHERITE 0x20 +#define FUNC_PASID 0x40 -#define TEST_MASK 0x3f +#define TEST_MASK 0x7f #define LOW_ADDR (0x1UL << 30) #define HIGH_ADDR (0x3UL << 48) @@ -55,11 +57,19 @@ #define URING_QUEUE_SZ 1 #define URING_BLOCK_SZ 2048 +/* Pasid test define */ +#define LAM_CMD_BIT 0x1 +#define PAS_CMD_BIT 0x2 +#define SVA_CMD_BIT 0x4 + +#define PAS_CMD(cmd1, cmd2, cmd3) (((cmd3) << 8) | ((cmd2) << 4) | ((cmd1) << 0)) + struct testcases { unsigned int later; int expected; /* 2: SIGSEGV Error; 1: other errors */ unsigned long lam; uint64_t addr; + uint64_t cmd; int (*test_func)(struct testcases *test); const char *msg; }; @@ -556,7 +566,7 @@ int do_uring(unsigned long lam) struct file_io *fi; struct stat st; int ret = 1; - char path[PATH_MAX]; + char path[PATH_MAX] = {0}; /* get current process path */ if (readlink("/proc/self/exe", path, PATH_MAX) <= 0) @@ -852,6 +862,226 @@ static void cmd_help(void) printf("\t-h: help\n"); } +/* Check for file existence */ +uint8_t file_Exists(const char *fileName) +{ + struct stat buffer; + + uint8_t ret = (stat(fileName, &buffer) == 0); + + return ret; +} + +/* Sysfs idxd files */ +const char *dsa_configs[] = { + "echo 1 > /sys/bus/dsa/devices/dsa0/wq0.1/group_id", + "echo shared > /sys/bus/dsa/devices/dsa0/wq0.1/mode", + "echo 10 > /sys/bus/dsa/devices/dsa0/wq0.1/priority", + "echo 16 > /sys/bus/dsa/devices/dsa0/wq0.1/size", + "echo 15 > /sys/bus/dsa/devices/dsa0/wq0.1/threshold", + "echo user > /sys/bus/dsa/devices/dsa0/wq0.1/type", + "echo MyApp1 > /sys/bus/dsa/devices/dsa0/wq0.1/name", + "echo 1 > /sys/bus/dsa/devices/dsa0/engine0.1/group_id", + "echo dsa0 > /sys/bus/dsa/drivers/idxd/bind", + /* bind files and devices, generated a device file in /dev */ + "echo wq0.1 > /sys/bus/dsa/drivers/user/bind", +}; + +/* DSA device file */ +const char *dsaDeviceFile = "/dev/dsa/wq0.1"; +/* file for io*/ +const char *dsaPasidEnable = "/sys/bus/dsa/devices/dsa0/pasid_enabled"; + +/* + * DSA depends on kernel cmdline "intel_iommu=on,sm_on" + * return pasid_enabled (0: disable 1:enable) + */ +int Check_DSA_Kernel_Setting(void) +{ + char command[256] = ""; + char buf[256] = ""; + char *ptr; + int rv = -1; + + snprintf(command, sizeof(command) - 1, "cat %s", dsaPasidEnable); + + FILE *cmd = popen(command, "r"); + + if (cmd) { + while (fgets(buf, sizeof(buf) - 1, cmd) != NULL); + + pclose(cmd); + rv = strtol(buf, &ptr, 16); + } + + return rv; +} + +/* + * Config DSA's sysfs files as shared DSA's WQ. + * Generated a device file /dev/dsa/wq0.1 + * Return: 0 OK; 1 Failed; 3 Skip(SVA disabled). + */ +int Dsa_Init_Sysfs(void) +{ + uint len = ARRAY_SIZE(dsa_configs); + const char **p = dsa_configs; + + if (file_Exists(dsaDeviceFile) == 1) + return 0; + + /* check the idxd driver */ + if (file_Exists(dsaPasidEnable) != 1) { + printf("Please make sure idxd driver was loaded\n"); + return 3; + } + + /* Check SVA feature */ + if (Check_DSA_Kernel_Setting() != 1) { + printf("Please enable SVA.(Add intel_iommu=on,sm_on in kernel cmdline)\n"); + return 3; + } + + /* Check the idxd device file on /dev/dsa/ */ + for (int i = 0; i < len; i++) { + if (system(p[i])) + return 1; + } + + /* After config, /dev/dsa/wq0.1 should be generated */ + return (file_Exists(dsaDeviceFile) != 1); +} + +/* + * Open DSA device file, triger API: iommu_sva_alloc_pasid + */ +void *allocate_dsa_pasid(void) +{ + int fd; + void *wq; + + fd = open(dsaDeviceFile, O_RDWR); + if (fd < 0) { + perror("open"); + return MAP_FAILED; + } + + wq = mmap(NULL, 0x1000, PROT_WRITE, + MAP_SHARED | MAP_POPULATE, fd, 0); + if (wq == MAP_FAILED) + perror("mmap"); + + return wq; +} + +int set_force_svm(void) +{ + int ret = 0; + + ret = syscall(SYS_arch_prctl, ARCH_FORCE_TAGGED_SVA); + + return ret; +} + +int handle_pasid(struct testcases *test) +{ + uint tmp = test->cmd; + uint runed = 0x0; + int ret = 0; + void *wq = NULL; + + ret = Dsa_Init_Sysfs(); + if (ret != 0) + return ret; + + for (int i = 0; i < 3; i++) { + int err = 0; + + if (tmp & 0x1) { + /* run set lam mode*/ + if ((runed & 0x1) == 0) { + err = set_lam(LAM_U57_BITS); + runed = runed | 0x1; + } else + err = 1; + } else if (tmp & 0x4) { + /* run force svm */ + if ((runed & 0x4) == 0) { + err = set_force_svm(); + runed = runed | 0x4; + } else + err = 1; + } else if (tmp & 0x2) { + /* run allocate pasid */ + if ((runed & 0x2) == 0) { + runed = runed | 0x2; + wq = allocate_dsa_pasid(); + if (wq == MAP_FAILED) + err = 1; + } else + err = 1; + } + + ret = ret + err; + if (ret > 0) + break; + + tmp = tmp >> 4; + } + + if (wq != MAP_FAILED && wq != NULL) + if (munmap(wq, 0x1000)) + printf("munmap failed %d\n", errno); + + if (runed != 0x7) + ret = 1; + + return (ret != 0); +} + +/* + * Pasid test depends on idxd and SVA, kernel should enable iommu and sm. + * command line(intel_iommu=on,sm_on) + */ +static struct testcases pasid_cases[] = { + { + .expected = 1, + .cmd = PAS_CMD(LAM_CMD_BIT, PAS_CMD_BIT, SVA_CMD_BIT), + .test_func = handle_pasid, + .msg = "PASID: [Negative] Execute LAM, PASID, SVA in sequence\n", + }, + { + .expected = 0, + .cmd = PAS_CMD(LAM_CMD_BIT, SVA_CMD_BIT, PAS_CMD_BIT), + .test_func = handle_pasid, + .msg = "PASID: Execute LAM, SVA, PASID in sequence\n", + }, + { + .expected = 1, + .cmd = PAS_CMD(PAS_CMD_BIT, LAM_CMD_BIT, SVA_CMD_BIT), + .test_func = handle_pasid, + .msg = "PASID: [Negative] Execute PASID, LAM, SVA in sequence\n", + }, + { + .expected = 0, + .cmd = PAS_CMD(PAS_CMD_BIT, SVA_CMD_BIT, LAM_CMD_BIT), + .test_func = handle_pasid, + .msg = "PASID: Execute PASID, SVA, LAM in sequence\n", + }, + { + .expected = 0, + .cmd = PAS_CMD(SVA_CMD_BIT, LAM_CMD_BIT, PAS_CMD_BIT), + .test_func = handle_pasid, + .msg = "PASID: Execute SVA, LAM, PASID in sequence\n", + }, + { + .expected = 0, + .cmd = PAS_CMD(SVA_CMD_BIT, PAS_CMD_BIT, LAM_CMD_BIT), + .test_func = handle_pasid, + .msg = "PASID: Execute SVA, PASID, LAM in sequence\n", + }, +}; + int main(int argc, char **argv) { int c = 0; @@ -910,6 +1140,9 @@ int main(int argc, char **argv) if (tests & FUNC_INHERITE) run_test(inheritance_cases, ARRAY_SIZE(inheritance_cases)); + if (tests & FUNC_PASID) + run_test(pasid_cases, ARRAY_SIZE(pasid_cases)); + ksft_set_plan(tests_cnt); return ksft_exit_pass();