From patchwork Thu Apr 13 04:13:36 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Kefeng Wang X-Patchwork-Id: 13209743 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0E4BCC77B73 for ; Thu, 13 Apr 2023 03:55:17 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 080826B0072; Wed, 12 Apr 2023 23:55:17 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 030836B0074; Wed, 12 Apr 2023 23:55:16 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D9EB0900002; Wed, 12 Apr 2023 23:55:16 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id C6E7C6B0072 for ; Wed, 12 Apr 2023 23:55:16 -0400 (EDT) Received: from smtpin10.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 8D303C0256 for ; Thu, 13 Apr 2023 03:55:16 +0000 (UTC) X-FDA: 80675002632.10.6DE0183 Received: from szxga01-in.huawei.com (szxga01-in.huawei.com [45.249.212.187]) by imf20.hostedemail.com (Postfix) with ESMTP id 038ED1C000C for ; Thu, 13 Apr 2023 03:55:12 +0000 (UTC) Authentication-Results: imf20.hostedemail.com; dkim=none; dmarc=pass (policy=quarantine) header.from=huawei.com; spf=pass (imf20.hostedemail.com: domain of wangkefeng.wang@huawei.com designates 45.249.212.187 as permitted sender) smtp.mailfrom=wangkefeng.wang@huawei.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681358114; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references; bh=/YbZlIMs8Ep239y+ayzQvJcbfuNZVII59yqkCUevw5o=; b=d3WrjjQuJeYFFSGx+yAF+66d0zAHKZDtk8hwC6CH8ftcquTeEXsKc5hxOxC+2ihIqGl6uI FpMPWW0HtdFDKXktN5zJs80M3/uuDh/EfWySBS2F+nfox/hvd9ouiy6Hs9aVcZcSdzW8L7 i4HgNrmNsNQdlkcbv0hLH2mPugvv+yI= ARC-Authentication-Results: i=1; imf20.hostedemail.com; dkim=none; dmarc=pass (policy=quarantine) header.from=huawei.com; spf=pass (imf20.hostedemail.com: domain of wangkefeng.wang@huawei.com designates 45.249.212.187 as permitted sender) smtp.mailfrom=wangkefeng.wang@huawei.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1681358114; a=rsa-sha256; cv=none; b=Mqb+GwgBySFGHFh8glh4l7nzec5AgwJTjmGTLqlh9wWwHZV5AP0qyoYC+zjRMkZfAfQ338 7gQ3qo5gEZNscaN0XjdjtnIqrWsrg39JACGgjh8AVlYZg/kiVfZk0dLIMkMXl9awWDtlbY 1Z+Nyo8dlypfmpPZVn8YfknichB80W8= Received: from dggpemm500001.china.huawei.com (unknown [172.30.72.57]) by szxga01-in.huawei.com (SkyGuard) with ESMTP id 4Pxm070TYNzrZm9; Thu, 13 Apr 2023 11:53:43 +0800 (CST) Received: from localhost.localdomain.localdomain (10.175.113.25) by dggpemm500001.china.huawei.com (7.185.36.107) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23; Thu, 13 Apr 2023 11:55:06 +0800 From: Kefeng Wang To: Naoya Horiguchi , Alexander Viro , Christian Brauner , , , Andrew Morton CC: Miaohe Lin , , , Kefeng Wang Subject: [PATCH] mm: hwpoison: coredump: support recovery from dump_user_range() Date: Thu, 13 Apr 2023 12:13:36 +0800 Message-ID: <20230413041336.26874-1-wangkefeng.wang@huawei.com> X-Mailer: git-send-email 2.35.3 MIME-Version: 1.0 X-Originating-IP: [10.175.113.25] X-ClientProxiedBy: dggems705-chm.china.huawei.com (10.3.19.182) To dggpemm500001.china.huawei.com (7.185.36.107) X-CFilter-Loop: Reflected X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 038ED1C000C X-Stat-Signature: ncqs598a4gaetmtqzqxbprau9zr85uip X-HE-Tag: 1681358112-720739 X-HE-Meta: U2FsdGVkX1+AoCMA71uZykiul1p71BQiRR0+YpPQAPMZPCNsLB3bZ6CnFzpPK2loh1Jp4rGPHYWvJSSWizCWH+rcmRlJ9JjjkiCe3SSZBUXfuAIdbVbq/XD3Z7NQJiSAsf8FpbXnpEggDDSCyWH7hpP+mYFtBFrrT8iYO4waSpwc16Al3hZA3y7494qmvLK7XH+uSdQQiKMerYdep+xdnqmB7bSpBm18r3t3b5vLQAsdlXqKzf8BQe97vn+DUBNbzqVxb/tHYPnlU7hCwZBveN9TzJFIj15S44k/n266nLT4S9whkSXCLhNIfvumdvYHMjewnUpPpy1imlaTGXSGY7VX5lGGWOJs+zQNr1Y70K27atxKLmy4ZaqpFfQ8tQIx+sfv10hAoddyBWaohHdEnWpuAGfHqgoWpmSOclN8dByh4sAZWu7QwS2/VwZwzouKGl1jRjIylD748ykE+wMX6NJulNj2vwvI4iQPaBb/Kyq2R63BlKB4Dt/ueX5vk785MjBEpT0mt2Dps2dwHOzqvS4qYi8N+56+46jSG72y8e2FSj/+h8Xml+6d327vSrw4LCQTwpHUa9sFczyNrAgudAr5cm7DqzRsNHpPeVTwzEXrsK+DecD26HMCf0djrVYjz+SVHbLXBzW+QhVLcgDnuAlUYJmW0rNdviaXkBXUAojc6HO1mXzbd7MW16JGdQiW0nw1ZYVouA2mAhAHxLqf7Tqhnb4fj4pIxPdWnfnV0nSwB++HSeWZyAjV7jszU1fwPk+/mUMmsDUxqPVTXtsYZUJxrzOoAvO2z0ayDf1gq7VOOu1weHs03V6Yc/AMNlRpJbtA6X7aix90e0gOoAMUsld78HWsc6I0flNlSUKRFKRCDkx4qBiFDWPfcZHg+/nFhlNU/dsTW8J7XmZKlDrHGxoz44nOPUFI9pxzPul0Lo2PxjZpDFCWVq/BnjwxH+xiar50z7MolBED2tZlXVs iaUzRx9P IlRpaBS/vea+pE4NFJ0x3X+1tZdjcYew3q7tiGB/e4axid4SWwU1MGB9iOwfSb1dYtpFdtGUAi/s2oPLdX6bzs0GYWnzKKyHeD/7i2TyqSHYoc0V2CHIsBGHz5Sdr2l/RUm+VwDzbqDPKYIKnZm166yECvd6ku9p2gIcxc6VMpvzXNM+qmACCsAC40/kr3WQw8aVFRRuA35VSF9u4YOtCsfXu3w== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: The dump_user_range() is used to copy the user page to a coredump file, but if a hardware memory error occurred during copy, which called from __kernel_write_iter() in dump_user_range(), it crashs, CPU: 112 PID: 7014 Comm: mca-recover Not tainted 6.3.0-rc2 #425 pc : __memcpy+0x110/0x260 lr : _copy_from_iter+0x3bc/0x4c8 ... Call trace: __memcpy+0x110/0x260 copy_page_from_iter+0xcc/0x130 pipe_write+0x164/0x6d8 __kernel_write_iter+0x9c/0x210 dump_user_range+0xc8/0x1d8 elf_core_dump+0x308/0x368 do_coredump+0x2e8/0xa40 get_signal+0x59c/0x788 do_signal+0x118/0x1f8 do_notify_resume+0xf0/0x280 el0_da+0x130/0x138 el0t_64_sync_handler+0x68/0xc0 el0t_64_sync+0x188/0x190 Generally, the '->write_iter' of file ops will use copy_page_from_iter() and copy_page_from_iter_atomic(), change memcpy() to copy_mc_to_kernel() in both of them to handle #MC during source read, which stop coredump processing and kill the task instead of kernel panic, but the source address may not always an user address, so introduce a new copy_mc flag in struct iov_iter{} to indicate that the iter could do a safe memory copy, also introduce the helpers to set/clear/check the flag, for now, it's only used in coredump's dump_user_range(), but it could expand to any other scenarios to fix the similar issue. Signed-off-by: Kefeng Wang --- fs/coredump.c | 2 ++ include/linux/uio.h | 26 ++++++++++++++++++++++++++ lib/iov_iter.c | 17 +++++++++++++++-- 3 files changed, 43 insertions(+), 2 deletions(-) diff --git a/fs/coredump.c b/fs/coredump.c index 5df1e6e1eb2b..d1c82ec86797 100644 --- a/fs/coredump.c +++ b/fs/coredump.c @@ -882,7 +882,9 @@ static int dump_emit_page(struct coredump_params *cprm, struct page *page) pos = file->f_pos; bvec_set_page(&bvec, page, PAGE_SIZE, 0); iov_iter_bvec(&iter, ITER_SOURCE, &bvec, 1, PAGE_SIZE); + iov_iter_set_copy_mc(&iter); n = __kernel_write_iter(cprm->file, &iter, &pos); + iov_iter_clear_copy_mc(&iter); if (n != PAGE_SIZE) return 0; file->f_pos = pos; diff --git a/include/linux/uio.h b/include/linux/uio.h index c459e1d5772b..4a549ce2f6d9 100644 --- a/include/linux/uio.h +++ b/include/linux/uio.h @@ -43,6 +43,7 @@ struct iov_iter { bool nofault; bool data_source; bool user_backed; + bool copy_mc; size_t iov_offset; /* * Hack alert: overlay ubuf_iovec with iovec + count, so @@ -142,6 +143,30 @@ static inline bool user_backed_iter(const struct iov_iter *i) return i->user_backed; } +#ifdef CONFIG_ARCH_HAS_COPY_MC +static inline void iov_iter_set_copy_mc(struct iov_iter *i) +{ + i->copy_mc = true; +} + +static inline void iov_iter_clear_copy_mc(struct iov_iter *i) +{ + i->copy_mc = false; +} + +static inline bool iov_iter_is_copy_mc(const struct iov_iter *i) +{ + return i->copy_mc; +} +#else +static inline void iov_iter_set_copy_mc(struct iov_iter *i) { } +static inline void iov_iter_clear_copy_mc(struct iov_iter *i) {} +static inline bool iov_iter_is_copy_mc(const struct iov_iter *i) +{ + return false; +} +#endif + /* * Total number of bytes covered by an iovec. * @@ -359,6 +384,7 @@ static inline void iov_iter_ubuf(struct iov_iter *i, unsigned int direction, .iter_type = ITER_UBUF, .user_backed = true, .data_source = direction, + .copy_mc = false, .ubuf = buf, .count = count, .nr_segs = 1 diff --git a/lib/iov_iter.c b/lib/iov_iter.c index 6d0203a3c00a..84bdb09e64a7 100644 --- a/lib/iov_iter.c +++ b/lib/iov_iter.c @@ -291,6 +291,7 @@ void iov_iter_init(struct iov_iter *i, unsigned int direction, .nofault = false, .user_backed = true, .data_source = direction, + .copy_mc = false, .__iov = iov, .nr_segs = nr_segs, .iov_offset = 0, @@ -371,6 +372,14 @@ size_t _copy_mc_to_iter(const void *addr, size_t bytes, struct iov_iter *i) EXPORT_SYMBOL_GPL(_copy_mc_to_iter); #endif /* CONFIG_ARCH_HAS_COPY_MC */ +static void *memcpy_from_iter(struct iov_iter *i, void *to, const void *from, + size_t size) +{ + if (iov_iter_is_copy_mc(i)) + return (void *)copy_mc_to_kernel(to, from, size); + return memcpy(to, from, size); +} + size_t _copy_from_iter(void *addr, size_t bytes, struct iov_iter *i) { if (WARN_ON_ONCE(!i->data_source)) @@ -380,7 +389,7 @@ size_t _copy_from_iter(void *addr, size_t bytes, struct iov_iter *i) might_fault(); iterate_and_advance(i, bytes, base, len, off, copyin(addr + off, base, len), - memcpy(addr + off, base, len) + memcpy_from_iter(i, addr + off, base, len) ) return bytes; @@ -571,7 +580,7 @@ size_t copy_page_from_iter_atomic(struct page *page, unsigned offset, size_t byt } iterate_and_advance(i, bytes, base, len, off, copyin(p + off, base, len), - memcpy(p + off, base, len) + memcpy_from_iter(i, p + off, base, len) ) kunmap_atomic(kaddr); return bytes; @@ -705,6 +714,7 @@ void iov_iter_kvec(struct iov_iter *i, unsigned int direction, *i = (struct iov_iter){ .iter_type = ITER_KVEC, .data_source = direction, + .copy_mc = false, .kvec = kvec, .nr_segs = nr_segs, .iov_offset = 0, @@ -721,6 +731,7 @@ void iov_iter_bvec(struct iov_iter *i, unsigned int direction, *i = (struct iov_iter){ .iter_type = ITER_BVEC, .data_source = direction, + .copy_mc = false, .bvec = bvec, .nr_segs = nr_segs, .iov_offset = 0, @@ -749,6 +760,7 @@ void iov_iter_xarray(struct iov_iter *i, unsigned int direction, *i = (struct iov_iter) { .iter_type = ITER_XARRAY, .data_source = direction, + .copy_mc = false, .xarray = xarray, .xarray_start = start, .count = count, @@ -772,6 +784,7 @@ void iov_iter_discard(struct iov_iter *i, unsigned int direction, size_t count) *i = (struct iov_iter){ .iter_type = ITER_DISCARD, .data_source = false, + .copy_mc = false, .count = count, .iov_offset = 0 };