From patchwork Thu Jul 20 06:55:57 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Gu Jinxiang X-Patchwork-Id: 9853959 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 895D760388 for ; Thu, 20 Jul 2017 06:57:50 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 79B512876B for ; Thu, 20 Jul 2017 06:57:50 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 6EB482876E; Thu, 20 Jul 2017 06:57:50 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=2.0 tests=BAYES_00,RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id F239B2876B for ; Thu, 20 Jul 2017 06:57:49 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S934109AbdGTG5q (ORCPT ); Thu, 20 Jul 2017 02:57:46 -0400 Received: from cn.fujitsu.com ([59.151.112.132]:25018 "EHLO heian.cn.fujitsu.com" rhost-flags-OK-FAIL-OK-FAIL) by vger.kernel.org with ESMTP id S1752098AbdGTG4w (ORCPT ); Thu, 20 Jul 2017 02:56:52 -0400 X-IronPort-AV: E=Sophos;i="5.22,518,1449504000"; d="scan'208";a="21556352" Received: from unknown (HELO cn.fujitsu.com) ([10.167.33.5]) by heian.cn.fujitsu.com with ESMTP; 20 Jul 2017 14:56:47 +0800 Received: from G08CNEXCHPEKD02.g08.fujitsu.local (unknown [10.167.33.83]) by cn.fujitsu.com (Postfix) with ESMTP id 17D9E46B5DF4; Thu, 20 Jul 2017 14:56:43 +0800 (CST) Received: from localhost.localdomain (10.167.226.132) by G08CNEXCHPEKD02.g08.fujitsu.local (10.167.33.89) with Microsoft SMTP Server (TLS) id 14.3.319.2; Thu, 20 Jul 2017 14:56:42 +0800 From: Gu Jinxiang To: CC: Qu Wenruo Subject: [PATCH v6 04/15] btrfs-progs: scrub: Introduce structures to support offline scrub for RAID56 Date: Thu, 20 Jul 2017 14:55:57 +0800 Message-ID: <20170720065608.27563-5-gujx@cn.fujitsu.com> X-Mailer: git-send-email 2.9.4 In-Reply-To: <20170720065608.27563-1-gujx@cn.fujitsu.com> References: <20170720065608.27563-1-gujx@cn.fujitsu.com> MIME-Version: 1.0 X-Originating-IP: [10.167.226.132] X-yoursite-MailScanner-ID: 17D9E46B5DF4.AA35E X-yoursite-MailScanner: Found to be clean X-yoursite-MailScanner-From: gujx@cn.fujitsu.com Sender: linux-btrfs-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP From: Qu Wenruo Introuduce new local structures, scrub_full_stripe and scrub_stripe, for incoming offline RAID56 scrub support. For pure stripe/mirror based profiles, like raid0/1/10/dup/single, we will follow the original bytenr and mirror number based iteration, so they don't need any extra structures for these profiles. Signed-off-by: Qu Wenruo Signed-off-by: Gu Jinxiang --- Makefile | 2 +- scrub.c | 119 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 120 insertions(+), 1 deletion(-) create mode 100644 scrub.c diff --git a/Makefile b/Makefile index 6f734a6..8275539 100644 --- a/Makefile +++ b/Makefile @@ -96,7 +96,7 @@ objects = ctree.o disk-io.o kernel-lib/radix-tree.o extent-tree.o print-tree.o \ qgroup.o free-space-cache.o kernel-lib/list_sort.o props.o \ kernel-shared/ulist.o qgroup-verify.o backref.o string-table.o task-utils.o \ inode.o file.o find-root.o free-space-tree.o help.o send-dump.o \ - fsfeatures.o kernel-lib/tables.o kernel-lib/raid56.o csum.o + fsfeatures.o kernel-lib/tables.o kernel-lib/raid56.o csum.o scrub.o cmds_objects = cmds-subvolume.o cmds-filesystem.o cmds-device.o cmds-scrub.o \ cmds-inspect.o cmds-balance.o cmds-send.o cmds-receive.o \ cmds-quota.o cmds-qgroup.o cmds-replace.o cmds-check.o \ diff --git a/scrub.c b/scrub.c new file mode 100644 index 0000000..41c4010 --- /dev/null +++ b/scrub.c @@ -0,0 +1,119 @@ +/* + * This program is free software; you can redistribute it and/or + * modify it under the terms of the GNU General Public + * License v2 as published by the Free Software Foundation. + * + * This program is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * General Public License for more details. + */ + +/* + * Main part to implement offline(unmounted) btrfs scrub + */ + +#include +#include "ctree.h" +#include "volumes.h" +#include "disk-io.h" +#include "utils.h" + +/* + * For parity based profile (RAID56) + * Mirror/stripe based on won't need this. They are iterated by bytenr and + * mirror number. + */ +struct scrub_stripe { + /* For P/Q logical start will be BTRFS_RAID5/6_P/Q_STRIPE */ + u64 logical; + + u64 physical; + + /* Device is missing */ + unsigned int dev_missing:1; + + /* Any tree/data csum mismatches */ + unsigned int csum_mismatch:1; + + /* Some data doesn't have csum (nodatasum) */ + unsigned int csum_missing:1; + + /* Device fd, to write correct data back to disc */ + int fd; + + char *data; +}; + +/* + * RAID56 full stripe (data stripes + P/Q) + */ +struct scrub_full_stripe { + u64 logical_start; + u64 logical_len; + u64 bg_type; + u32 nr_stripes; + u32 stripe_len; + + /* Read error stripes */ + u32 err_read_stripes; + + /* Missing devices */ + u32 err_missing_devs; + + /* Csum error data stripes */ + u32 err_csum_dstripes; + + /* Missing csum data stripes */ + u32 missing_csum_dstripes; + + /* currupted stripe index */ + int corrupted_index[2]; + + int nr_corrupted_stripes; + + /* Already recovered once? */ + unsigned int recovered:1; + + struct scrub_stripe stripes[]; +}; + +static void free_full_stripe(struct scrub_full_stripe *fstripe) +{ + int i; + + for (i = 0; i < fstripe->nr_stripes; i++) + free(fstripe->stripes[i].data); + free(fstripe); +} + +static struct scrub_full_stripe *alloc_full_stripe(int nr_stripes, + u32 stripe_len) +{ + struct scrub_full_stripe *ret; + int size = sizeof(*ret) + sizeof(unsigned long *) + + nr_stripes * sizeof(struct scrub_stripe); + int i; + + ret = malloc(size); + if (!ret) + return NULL; + + memset(ret, 0, size); + ret->nr_stripes = nr_stripes; + ret->stripe_len = stripe_len; + ret->corrupted_index[0] = -1; + ret->corrupted_index[1] = -1; + + /* Alloc data memory for each stripe */ + for (i = 0; i < nr_stripes; i++) { + struct scrub_stripe *stripe = &ret->stripes[i]; + + stripe->data = malloc(stripe_len); + if (!stripe->data) { + free_full_stripe(ret); + return NULL; + } + } + return ret; +}