From patchwork Mon Aug 26 21:20:57 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Darrick J. Wong" X-Patchwork-Id: 11115579 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id D0F6A14DE for ; Mon, 26 Aug 2019 21:21:02 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id AD9C421883 for ; Mon, 26 Aug 2019 21:21:02 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="cMOLnlUs" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727485AbfHZVVC (ORCPT ); Mon, 26 Aug 2019 17:21:02 -0400 Received: from userp2120.oracle.com ([156.151.31.85]:42104 "EHLO userp2120.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726760AbfHZVVC (ORCPT ); Mon, 26 Aug 2019 17:21:02 -0400 Received: from pps.filterd (userp2120.oracle.com [127.0.0.1]) by userp2120.oracle.com (8.16.0.27/8.16.0.27) with SMTP id x7QLDvML189154; Mon, 26 Aug 2019 21:21:00 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : from : to : cc : date : message-id : mime-version : content-type : content-transfer-encoding; s=corp-2019-08-05; bh=5hF80WkrpbqWSgrqqL+0f78DBdMRowAmyea1RqWmnd0=; b=cMOLnlUsl9od4txzTD2ZTlCHLkKMZbCbLMmFpT5UzDNcqgKC8Z6GRLc7nYVKahQhkPot 03tUAhEspzT1UG3EPlBM5O61GK9nJhxYC1b7ZrpG56A0IYY/+rLF4wXkjQgiSfHyy2o9 g3EuOThaV4iznN1WxdzQR6G/oaBYaPRI9RIK2rrspe/AWY+2vV0ATJrASGswA+tlXNFU QSqhnBfDua7km/v8m03lsI/PaSDKIoT8tsPD/JnHdkZa/4EcQIvzueu2s00QtASz5zq4 GG32fDnsZeP+W5S3G97TBbv7g2l9YG7bDvELO6LBWIaVY2PQZsZZf5c3q3rtmxaFDtNS iQ== Received: from userp3030.oracle.com (userp3030.oracle.com [156.151.31.80]) by userp2120.oracle.com with ESMTP id 2ujwvqc4f8-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 26 Aug 2019 21:21:00 +0000 Received: from pps.filterd (userp3030.oracle.com [127.0.0.1]) by userp3030.oracle.com (8.16.0.27/8.16.0.27) with SMTP id x7QLIQwN024925; Mon, 26 Aug 2019 21:20:59 GMT Received: from userv0121.oracle.com (userv0121.oracle.com [156.151.31.72]) by userp3030.oracle.com with ESMTP id 2umj1tjwa2-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 26 Aug 2019 21:20:59 +0000 Received: from abhmp0017.oracle.com (abhmp0017.oracle.com [141.146.116.23]) by userv0121.oracle.com (8.14.4/8.13.8) with ESMTP id x7QLKw2b023546; Mon, 26 Aug 2019 21:20:58 GMT Received: from localhost (/10.159.144.227) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Mon, 26 Aug 2019 14:20:58 -0700 Subject: [PATCH 0/2] xfsprogs: scrub filesystem summary counters From: "Darrick J. Wong" To: sandeen@sandeen.net, darrick.wong@oracle.com Cc: linux-xfs@vger.kernel.org Date: Mon, 26 Aug 2019 14:20:57 -0700 Message-ID: <156685445746.2839983.1426723444334605572.stgit@magnolia> User-Agent: StGit/0.17.1-dirty MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9361 signatures=668684 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1908260198 X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9361 signatures=668684 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1908260198 Sender: linux-xfs-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-xfs@vger.kernel.org Hi all, This patch series introduces a totally new filesystem summary counter online scrub feature. Whereas previous iterations froze the filesystem to count inodes and free blocks, this one drastically reduces overhead by loosening its precision somewhat. Instead of freezing the fs, we race the expected summary counter calculation with normal fs operations and use thresholding to check that the counters are in the ballpark, where ballpark means "off by less than 6% or so". If you're going to start using this mess, you probably ought to just pull from my git trees, which are linked below. This is an extraordinary way to destroy everything. Enjoy! Comments and questions are, as always, welcome. --D kernel git tree: https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=scrub-summary-counters xfsprogs git tree: https://git.kernel.org/cgit/linux/kernel/git/djwong/xfsprogs-dev.git/log/?h=scrub-summary-counters