From patchwork Tue Mar 11 11:40:41 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Sidong Yang X-Patchwork-Id: 14011598 Received: from mail-pj1-f52.google.com (mail-pj1-f52.google.com [209.85.216.52]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 60E4D255E2C for ; Tue, 11 Mar 2025 11:42:02 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.216.52 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741693324; cv=none; b=fUxu4jOG0ImCsdLEjfXY+raZuO4MZMzCIytrt2v7XUx4QXI13UAGL3/hOShXg2R9tIcOtOiG+upXNj7IKaZ5+yxRFUWYWeCh7kWZWHu8Mcyweu+DjJHXMjELd4+vV2T4vKYqTJaqxL0EtB5fyDlqVR3aNGQFx6SDYEImsXrGmSQ= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741693324; c=relaxed/simple; bh=RtWG1kcYXYJUxfQVm04qkDa/lg7kxL9FGZhNdQfBrt0=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=pGRwsJEX+Oqh+3/pVsQOdokeh8N+LZpkIEIVczA6e+p/4iLr8PlvIAzf2ayg6xDOLSkIrlVvoeOqm+5QTqoi9JWvTrJvZsIW/yHWjG/2aCnx7n9+3mNZPxF7ZnZ7FiwP+qfInyIysotSAvfHZF0ZUm5GaZZB0E6g2Ds8Sv/aoeM= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=furiosa.ai; spf=none smtp.mailfrom=furiosa.ai; dkim=pass (2048-bit key) header.d=furiosa-ai.20230601.gappssmtp.com header.i=@furiosa-ai.20230601.gappssmtp.com header.b=eAIQqUCe; arc=none smtp.client-ip=209.85.216.52 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=furiosa.ai Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=furiosa.ai Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=furiosa-ai.20230601.gappssmtp.com header.i=@furiosa-ai.20230601.gappssmtp.com header.b="eAIQqUCe" Received: by mail-pj1-f52.google.com with SMTP id 98e67ed59e1d1-2ff80290debso7591050a91.3 for ; Tue, 11 Mar 2025 04:42:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=furiosa-ai.20230601.gappssmtp.com; s=20230601; t=1741693322; x=1742298122; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=X0Fp17O3JAMZDE/PWYetr8PB3aop95hwwptwptAErt0=; b=eAIQqUCerY3ew7X4PeZlrbVdKsmZIPpDKjTbz1tMgChXrHjA5i7zDVZ+xLkD1DD9nE 1pmMP4MGRlvHHNYcQZGnUjMpwsprLLjOBtjQRpkILgBRP2krSXKvNz0+9214gfkbljfQ ep8j326sGnIiA2CDVpSI+cL7EiQbK/vkvtdzY7oljOX9tZ0SJZayd7arwszz0ozHqSyN hNiUE3lcIDfXYemXqK7JlJCCWU9IuvddeVQgp9YwagJPRsk8RwP2TqMWF2AEyk+crs0u CRZiXal+i9PoeGPPHSleNjx/FqM01qqQhPOHB4YoxHNiHSEFXwyLFa91glRKd4Dd2VHk RdJw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741693322; x=1742298122; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=X0Fp17O3JAMZDE/PWYetr8PB3aop95hwwptwptAErt0=; b=vq2ZcrSbUbT/kW07aFLXZqd8D7Z4PMYaD0MwfxWWBBwgjsiYgGaedd1JTg3BHsWfbk EtR5v4YDvJZiea0pSc8zx3aeO+Pd6b1OQ2z2qswMskEcPkpfGyTxMkzNLf8tthh4rh3m TPC4rJL81vke7tY2e0n47WYFZHqMais4w0cLHxpJyoRVgLi1uC1eAXdfezWgOOtie3JD V8l+NYcXhwMXFjkJrlwZG+D6YgPvp9U0CjnZJLqi9DrxvIR0cmNTlFRsI0E9X/VRKrYZ GW+Z2bbNtr9+B/HVcCvI08kRQcRxnX7Jp5AUkr0/cbwkJqyX4wAMW4dMrvHjmTHwIr6O oZlA== X-Forwarded-Encrypted: i=1; AJvYcCXlmFcSYBz66mdvmyXh/0HTx2PyZ7Sa5wtyjQBtYaUu1iuqgpSe2Tl40n3E8kTRSD/aNoKNwCjkaUvAdg==@vger.kernel.org X-Gm-Message-State: AOJu0Yw1wxd//+B4Q+waCJSsr/XskLii8zYGVbvTv1kZ7f8f6+K5tI0m BXpFMebKoLYbDuCfUef/W7HD6qjlkx/V0BsHUuPkqNYHpZtBkckYi5Z9nq4TMMA= X-Gm-Gg: ASbGncu2tqQlODTq+6RcjRoO5qAeTUtbvpirWS1fzy06eOf+2+qkUxu7P68tyULPVaU fe6u9XNuq0bbrocj7dOYpKweweciU/Uqz/NgzUDBrLr/A+DOlwVLzjAxRp1A7ih42319bPTn2eZ 2u019hEFFXup6DNrHwwpnbHEaB3KgZ5X30gFh+KUEaXfrXSIqSqcZjTmvrccZwLL5m0wlvu3RYI CZEu1nRsyPy/Sz7SoWWJXIYl54+9qR9YYwsvFbsoKNi0R45lTn8OLt5bYdyBjCAUTO5F5dRnwGL ek+f2uvAOcS0e7bjYb1Kx4IuU5wZjxtAstTACXuEbdTOt+aJnJJp3XuB+GVg6ZtTHGMuAby7qYv Oiw8q X-Google-Smtp-Source: AGHT+IFwzzGRe2jkxfHS08jzq7ZtsPhqL17dqZLhLnPKsxh8KSmAtnOqy8MNjjK7N8xAtgGZm+Y1lQ== X-Received: by 2002:a17:90b:3fce:b0:2f2:a664:df20 with SMTP id 98e67ed59e1d1-2ff7ce47c16mr27695933a91.7.1741693321657; Tue, 11 Mar 2025 04:42:01 -0700 (PDT) Received: from sidong.sidong.yang.office.furiosa.vpn ([221.148.76.1]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-2ff4e7ff8cfsm11647817a91.37.2025.03.11.04.41.59 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 11 Mar 2025 04:42:01 -0700 (PDT) From: Sidong Yang To: Jens Axboe , Pavel Begunkov , Josef Bacik , David Sterba Cc: Sidong Yang , io-uring@vger.kernel.org, linux-kernel@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [RFC PATCH 1/2] io_uring: cmd: introduce io_uring_cmd_import_fixed_vec Date: Tue, 11 Mar 2025 11:40:41 +0000 Message-ID: <20250311114053.216359-2-sidong.yang@furiosa.ai> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250311114053.216359-1-sidong.yang@furiosa.ai> References: <20250311114053.216359-1-sidong.yang@furiosa.ai> Precedence: bulk X-Mailing-List: linux-btrfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 io_uring_cmd_import_fixed_vec() could be used for using multiple fixed buffer in uring_cmd callback. Signed-off-by: Sidong Yang --- include/linux/io_uring/cmd.h | 14 ++++++++++++++ io_uring/uring_cmd.c | 29 +++++++++++++++++++++++++++++ 2 files changed, 43 insertions(+) diff --git a/include/linux/io_uring/cmd.h b/include/linux/io_uring/cmd.h index 598cacda4aa3..75cf25c1e730 100644 --- a/include/linux/io_uring/cmd.h +++ b/include/linux/io_uring/cmd.h @@ -44,6 +44,13 @@ int io_uring_cmd_import_fixed(u64 ubuf, unsigned long len, int rw, struct io_uring_cmd *ioucmd, unsigned int issue_flags); +int io_uring_cmd_import_fixed_vec(const struct iovec __user *uiovec, + unsigned long nr_segs, int rw, + struct iov_iter *iter, + struct io_uring_cmd *ioucmd, + struct iou_vec *iou_vec, bool compat, + unsigned int issue_flags); + /* * Completes the request, i.e. posts an io_uring CQE and deallocates @ioucmd * and the corresponding io_uring request. @@ -76,6 +83,13 @@ io_uring_cmd_import_fixed(u64 ubuf, unsigned long len, int rw, { return -EOPNOTSUPP; } +int io_uring_cmd_import_fixed_vec(int rw, struct iov_iter *iter, + struct io_uring_cmd *ioucmd, + struct iou_vec *vec, unsigned nr_iovs, + unsigned iovec_off, unsigned int issue_flags) +{ + return -EOPNOTSUPP; +} static inline void io_uring_cmd_done(struct io_uring_cmd *cmd, ssize_t ret, u64 ret2, unsigned issue_flags) { diff --git a/io_uring/uring_cmd.c b/io_uring/uring_cmd.c index de39b602aa82..58e2932f29e7 100644 --- a/io_uring/uring_cmd.c +++ b/io_uring/uring_cmd.c @@ -255,6 +255,35 @@ int io_uring_cmd_import_fixed(u64 ubuf, unsigned long len, int rw, } EXPORT_SYMBOL_GPL(io_uring_cmd_import_fixed); +int io_uring_cmd_import_fixed_vec(const struct iovec __user *uiovec, + unsigned long nr_segs, int rw, + struct iov_iter *iter, + struct io_uring_cmd *ioucmd, + struct iou_vec *iou_vec, bool compat, + unsigned int issue_flags) +{ + struct io_kiocb *req = cmd_to_io_kiocb(ioucmd); + struct iovec *iov; + int ret; + + iov = iovec_from_user(uiovec, nr_segs, 0, NULL, compat); + if (IS_ERR(iov)) + return PTR_ERR(iov); + + ret = io_vec_realloc(iou_vec, nr_segs); + if (ret) { + kfree(iov); + return ret; + } + memcpy(iou_vec->iovec, iov, sizeof(*iov) * nr_segs); + kfree(iov); + + ret = io_import_reg_vec(rw, iter, req, iou_vec, iou_vec->nr, 0, + issue_flags); + return ret; +} +EXPORT_SYMBOL_GPL(io_uring_cmd_import_fixed_vec); + void io_uring_cmd_issue_blocking(struct io_uring_cmd *ioucmd) { struct io_kiocb *req = cmd_to_io_kiocb(ioucmd); From patchwork Tue Mar 11 11:40:42 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Sidong Yang X-Patchwork-Id: 14011599 Received: from mail-pj1-f50.google.com (mail-pj1-f50.google.com [209.85.216.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 024C82566F4 for ; Tue, 11 Mar 2025 11:42:04 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.216.50 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741693326; cv=none; b=IyYufKUYybrx2jZXKNDzDH03bRJdm8MjR8IFi4QI+Ve60vcwT4//oBL5OBg9caiK3tb7f6nrfVI9x2P2C1r/Ha7WcW1/liRYyzslLlLGIl0aBcLB1SYWvyeQ2PylSRjU7fYMidGkvSmC9HLn7uGx42LDm1irtgT00PEtuTOQd7I= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741693326; c=relaxed/simple; bh=NSmyg+PbHJ354WJeRB+D9sthgSs9N/UsZf0bxZC7nPk=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=KeyiAiOSh3BPgaZuxyoR1oqMHcljCvNPZYVYol2Jtr8ApZfVXnasMBHHXWIBR/sdfO16u5dZqcABep3szC2IWrTJy2+mkonbG1+yo6Cp2pdRvDOOQPQ+cnNY5191QSstkGqD22GpM+y0sslpt3FDZajcIPt+e9RNzX2X2BZ+kEA= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=furiosa.ai; spf=none smtp.mailfrom=furiosa.ai; dkim=pass (2048-bit key) header.d=furiosa-ai.20230601.gappssmtp.com header.i=@furiosa-ai.20230601.gappssmtp.com header.b=1BENZkCk; arc=none smtp.client-ip=209.85.216.50 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=furiosa.ai Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=furiosa.ai Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=furiosa-ai.20230601.gappssmtp.com header.i=@furiosa-ai.20230601.gappssmtp.com header.b="1BENZkCk" Received: by mail-pj1-f50.google.com with SMTP id 98e67ed59e1d1-2fe9759e5c1so7932596a91.0 for ; Tue, 11 Mar 2025 04:42:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=furiosa-ai.20230601.gappssmtp.com; s=20230601; t=1741693324; x=1742298124; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=QXXOHgCX8LOzk7FN9r6WSAUJT1m0r7Sn6/UXaW/zWeI=; b=1BENZkCkDVbgiraoYnWGuQAb9hdve3ZegQ8bGiPs7fOWgJuNYkLP52vA4GFrdUjWgO IEB+RZCFyqp4FgQtTkjFBLD2qUx/i5dVGXxbCm1HiPbw4t9wcxA+a2LaRwkR+RU/gpia LyjEuldzEK0jKQObhF9/DomlautVDFQvRDuth4CLyWTuw7lJL+FQPUlwiBmVNH4kT9Zf t6DPvCNutzIewSxIMRSN3yEQy7zS2NfKQyvOv5nMpYWLXMYQmTfoC6dPfECIFiBkTIIM RmbNC+gB1s2IvXYhTTehz8aEq7CB5AEpx90lergSC3odukD/n0jf1kJRcntAPfTWvdCB PV3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741693324; x=1742298124; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=QXXOHgCX8LOzk7FN9r6WSAUJT1m0r7Sn6/UXaW/zWeI=; b=a8poYCnviltMQnromIhO9LROq8X+sr4/Ptqd/cyGyyOB587pbkldSIN5IO4QHO7y48 6pUX8KqAozuVMhtA7BhUXYX5m4HY/riGo0mDGc1tsMoqlHN/hXswTe7Oy3sY7KxrSwl0 dREfZLwy+ykw9Anmv+MOof6STLMY3GxTuLiTcSzawrddu3gtgfGCWVyl8Agk2KZBUyJe EEYKHC0yOn6lOWpICSHX2nQv+52RtBgKhwzGD7sabvIe6rKTSPK6mv15LGCSo5s72/yU r7rI0zvgJgf3CuRzwl6BN+ZnG3nPlv+ei/JPn5tfgCGO3h85C16hWs4NHg6L1si7y7ME Lk7A== X-Forwarded-Encrypted: i=1; AJvYcCUBzQXPvIl5A3CeTg+EBb5AR+p0XKuafnA77E4yahwvsnbqp5qigmaTeKbNUAxApVXDTdqgentIh0zhVg==@vger.kernel.org X-Gm-Message-State: AOJu0YyH+3yYAfXgsgjejXjwSQ5QEcL0+aoRb1N6pkqbrYA2qP98QTmv y0Y/FsIIlMwgxrYerXdgK8Q6Ahsyir3ARF/1jhU1YZJG4dZHiI/XuOis9EFeCQ0= X-Gm-Gg: ASbGncuda9kUQQkAGK0JNO49oxmtlVdA6LLZB+vwLa5nKFZ7b5nlvZMgno8UNNj717R LyhmoyPWKK1Z7bGMM3NSPE1VwOSmSlGtfD5HkxLou9vC7B3r4P7XIUpmr1qMdoaeDyJkkF37oNN DDH0U546UwxDaa+tCbMCaLmzr1QL0pOICk0Y/pIpc5kee2iZe9LIwGKdCfiJa3/vmZ947KRlJWs 6awF3DOU/U0R3prCe5US8vJEfjDhk69VryCLdsC4vF51mULPtOtoIEglJJUojF/e+osMvFQvg6G pGlR7VnoIMVwuZaPmBoG2hKL3TDFl9Y86qgZ1sC9EqnjInbZZ9iIoO72BLkkRHYDs29JSFEHwng +8DeC X-Google-Smtp-Source: AGHT+IEBsIY0E5YZ6GSFCMY3gvyAGt1pgQYu5PEmxHTi1l7WoLNLU5LMW4UKaTogQ8vfn0kb9QZuCQ== X-Received: by 2002:a17:90b:3b86:b0:2ff:784b:ffe with SMTP id 98e67ed59e1d1-300ff0d4986mr4643217a91.11.1741693324275; Tue, 11 Mar 2025 04:42:04 -0700 (PDT) Received: from sidong.sidong.yang.office.furiosa.vpn ([221.148.76.1]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-2ff4e7ff8cfsm11647817a91.37.2025.03.11.04.42.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 11 Mar 2025 04:42:03 -0700 (PDT) From: Sidong Yang To: Jens Axboe , Pavel Begunkov , Josef Bacik , David Sterba Cc: Sidong Yang , io-uring@vger.kernel.org, linux-kernel@vger.kernel.org, linux-btrfs@vger.kernel.org Subject: [RFC PATCH 2/2] btrfs: ioctl: use registered buffer for IORING_URING_CMD_FIXED Date: Tue, 11 Mar 2025 11:40:42 +0000 Message-ID: <20250311114053.216359-3-sidong.yang@furiosa.ai> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250311114053.216359-1-sidong.yang@furiosa.ai> References: <20250311114053.216359-1-sidong.yang@furiosa.ai> Precedence: bulk X-Mailing-List: linux-btrfs@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 This patch supports IORING_URING_CMD_FIXED flags in io-uring cmd. It means that user provided buf_index in sqe that is registered before submitting requests. In this patch, btrfs_uring_encoded_read() makes iov_iter bvec type by checking the io-uring cmd flag. And there is additional iou_vec field in btrfs_uring_priv for remaining bvecs lifecycle. Signed-off-by: Sidong Yang --- fs/btrfs/ioctl.c | 26 +++++++++++++++++++++----- 1 file changed, 21 insertions(+), 5 deletions(-) diff --git a/fs/btrfs/ioctl.c b/fs/btrfs/ioctl.c index 6c18bad53cd3..586671eea622 100644 --- a/fs/btrfs/ioctl.c +++ b/fs/btrfs/ioctl.c @@ -4643,6 +4643,7 @@ struct btrfs_uring_priv { struct page **pages; unsigned long nr_pages; struct kiocb iocb; + struct iou_vec iou_vec; struct iovec *iov; struct iov_iter iter; struct extent_state *cached_state; @@ -4711,6 +4712,8 @@ static void btrfs_uring_read_finished(struct io_uring_cmd *cmd, unsigned int iss kfree(priv->pages); kfree(priv->iov); + if (priv->iou_vec.iovec) + kfree(priv->iou_vec.iovec); kfree(priv); } @@ -4730,7 +4733,8 @@ static int btrfs_uring_read_extent(struct kiocb *iocb, struct iov_iter *iter, struct extent_state *cached_state, u64 disk_bytenr, u64 disk_io_size, size_t count, bool compressed, - struct iovec *iov, struct io_uring_cmd *cmd) + struct iovec *iov, struct io_uring_cmd *cmd, + struct iou_vec *iou_vec) { struct btrfs_inode *inode = BTRFS_I(file_inode(iocb->ki_filp)); struct extent_io_tree *io_tree = &inode->io_tree; @@ -4767,6 +4771,7 @@ static int btrfs_uring_read_extent(struct kiocb *iocb, struct iov_iter *iter, priv->start = start; priv->lockend = lockend; priv->err = 0; + priv->iou_vec = *iou_vec; ret = btrfs_encoded_read_regular_fill_pages(inode, disk_bytenr, disk_io_size, pages, priv); @@ -4818,6 +4823,7 @@ static int btrfs_uring_encoded_read(struct io_uring_cmd *cmd, unsigned int issue u64 start, lockend; void __user *sqe_addr; struct btrfs_uring_encoded_data *data = io_uring_cmd_get_async_data(cmd)->op_data; + struct iou_vec iou_vec = {}; if (!capable(CAP_SYS_ADMIN)) { ret = -EPERM; @@ -4875,9 +4881,19 @@ static int btrfs_uring_encoded_read(struct io_uring_cmd *cmd, unsigned int issue } data->iov = data->iovstack; - ret = import_iovec(ITER_DEST, data->args.iov, data->args.iovcnt, - ARRAY_SIZE(data->iovstack), &data->iov, - &data->iter); + + if (cmd && (cmd->flags & IORING_URING_CMD_FIXED)) { + ret = io_uring_cmd_import_fixed_vec( + data->args.iov, data->args.iovcnt, ITER_DEST, + &data->iter, cmd, &iou_vec, false, issue_flags); + data->iov = NULL; + } else { + ret = import_iovec(ITER_DEST, data->args.iov, + data->args.iovcnt, + ARRAY_SIZE(data->iovstack), + &data->iov, &data->iter); + } + if (ret < 0) goto out_acct; @@ -4929,7 +4945,7 @@ static int btrfs_uring_encoded_read(struct io_uring_cmd *cmd, unsigned int issue ret = btrfs_uring_read_extent(&kiocb, &data->iter, start, lockend, cached_state, disk_bytenr, disk_io_size, count, data->args.compression, - data->iov, cmd); + data->iov, cmd, &iou_vec); goto out_acct; }