From patchwork Mon Jun 10 10:43:19 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: John Garry X-Patchwork-Id: 13691866 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7C0067D40D; Mon, 10 Jun 2024 10:44:44 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=205.220.177.32 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1718016286; cv=fail; b=Uz0preQDM3xq1ham0kcxBPVrUIj3/GfvsxlLdK2Kztc1xGINgGWipST4ISIF/4o+omNOcxocdM8jvZ9tnP/T3ImXaU47yY1KXvTMX8tHCOWepRuH5gMKqrbPUJRRd3Czm3+ZMXf/5561GdjC6vmc/BAZGnenwqTbQ6ByWbXbfVY= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1718016286; c=relaxed/simple; bh=MdlkzjsYYYVVarowseJ4XMT1HSaq6/kgtFq4jemo1c0=; h=From:To:Cc:Subject:Date:Message-Id:Content-Type:MIME-Version; b=JP/h21DNotrQb1W2tqk5NhZhLl50MUrhrE0F4yXmYDOp8VO3fmWOsOn+rkYKGapTvcjGC//dJSwMNHtNcSR7qRnPZdt9VAjfatQ42eyBV/Rqp026zoslKklUxuuD6QaN6GEM9SyxWu5tbe3cLaAnClzJiQMEDbxLvDz0yX+DHmE= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=oracle.com; spf=pass smtp.mailfrom=oracle.com; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b=K+CKzg43; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b=Kc0q8vTQ; arc=fail smtp.client-ip=205.220.177.32 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=oracle.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=oracle.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="K+CKzg43"; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b="Kc0q8vTQ" Received: from pps.filterd (m0246632.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 45A4BPlT004388; Mon, 10 Jun 2024 10:43:52 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h= from:to:cc:subject:date:message-id:content-type :content-transfer-encoding:mime-version; s=corp-2023-11-20; bh=h aMsZt7phP0+HV3yXxVNdQ7a0RsV577Lj/5dXSip4Us=; b=K+CKzg43a3Mhnc52u 0WD6UqmRdIQjSA96bH8hrH8Guglmg+Q9WENIQS7bj+xFDMSoU6RwxyrfGirEI+X/ EzNA/erFijnM1CzuVpsgUr3qCj5kQolYnUkyHRlsoTNuSmtrZBCMdX9V3JBQ8fMW Dal1RMsJtfJwiLy8upz/4tKBW4WXdIl/Y29xwGxxq0+5T9iRh+A17I0VfPemWHHl Tdfoch5Vt3VVqWoIjOeqznv20ntBhcXYGO3dEeD53+ESeGmlH1VlpTQpzXG+ihTV kWIJ9grZFzQSf8EGjrzXnli+5j5pRABiDyKL1a9dVhpR/MGhRidiT6JaQQ62OZ4n FytOw== Received: from iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta02.appoci.oracle.com [147.154.18.20]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 3ymh1929du-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 10 Jun 2024 10:43:52 +0000 (GMT) Received: from pps.filterd (iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (8.17.1.19/8.17.1.19) with ESMTP id 45AA6Tpg036558; Mon, 10 Jun 2024 10:43:51 GMT Received: from nam12-dm6-obe.outbound.protection.outlook.com (mail-dm6nam12lp2168.outbound.protection.outlook.com [104.47.59.168]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 3yncdukce8-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 10 Jun 2024 10:43:51 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cTQkvdG6PF9wVLdPs5dF5xlKCpNSb+ZdwBTHvsGtSTb3u7B4lozUL50zgmMNuvvbE1TKk/k6fG5pYrmVWFxfhI8T4CFo1Aw0AKANLhnCYM7mOASd0TSIJK9+10sl8AEh6EZxXnW7eWP61uyMZ2O9fOhyfkR04SPeBcBA4kM/Y4t44wttZDP4Qo1+3I4bOCIlxUO2PGUzoZCB7sWTjai/exS18Iu945nfBB3sHeSXG3BbqfHERgSF7Vb/N/85RsaGR+rOiU6I6G4ZLal3QUFb3MJ4UtEZX9SZ14ePmiCAhHOnc6OfXDWsb1pqZe2Yy+ow5x8gXt7wAecoIFnBOyIhtA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=haMsZt7phP0+HV3yXxVNdQ7a0RsV577Lj/5dXSip4Us=; b=JPwQSvTF5/EuJ5OF0txSS0WGDyirtpXfY7V7AHrYU3UsK8E61r6Wp+G+nN3vfKQaswCpXPL8WJBsXtQuS9LLzlqhFhpTdOsBja34X6H0HM7glfGfGLDV5YWnMSxd7k0D6F6jCPaYf8qgOaFffgBTDVN9B8796UM30SvyDPidFtU3681NrjA3sRoRo+uMnIynhG4YNxG8a3+MShrVVwEoVdc1B2BmBuVmpyothl72CpxZp4Hs7e65eVsppHVBdo7CERYIhY6YjNN8XP859clyc3kOlTtTT/0+o3fQmB2RrgGJ5PGIfqcVxuu4zxZihd+4d0BVM+5Gl06OMoyHcMUlaA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=haMsZt7phP0+HV3yXxVNdQ7a0RsV577Lj/5dXSip4Us=; b=Kc0q8vTQXT5yGDJh8GXmkq7PZNljrNw0Wonhnl4Ofy4kRwjgoiBOy2u/QtiSj23+QdGRo33bDhmYxNouMxJyDVzosgFlX5jxaggQVA2NlKL+5fnws6VHWJdwF1V3L/wZ4gDYrgjf/L5R+GbKI1UAc6brTkanX4IbmTa7lt4g0XI= Received: from DM6PR10MB4313.namprd10.prod.outlook.com (2603:10b6:5:212::20) by SJ0PR10MB5613.namprd10.prod.outlook.com (2603:10b6:a03:3d0::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7633.31; Mon, 10 Jun 2024 10:43:49 +0000 Received: from DM6PR10MB4313.namprd10.prod.outlook.com ([fe80::4f45:f4ab:121:e088]) by DM6PR10MB4313.namprd10.prod.outlook.com ([fe80::4f45:f4ab:121:e088%6]) with mapi id 15.20.7633.036; Mon, 10 Jun 2024 10:43:49 +0000 From: John Garry To: axboe@kernel.dk, kbusch@kernel.org, hch@lst.de, sagi@grimberg.me, jejb@linux.ibm.com, martin.petersen@oracle.com, viro@zeniv.linux.org.uk, brauner@kernel.org, dchinner@redhat.com, jack@suse.cz Cc: djwong@kernel.org, linux-block@vger.kernel.org, linux-kernel@vger.kernel.org, linux-nvme@lists.infradead.org, linux-fsdevel@vger.kernel.org, tytso@mit.edu, jbongio@google.com, linux-scsi@vger.kernel.org, ojaswin@linux.ibm.com, linux-aio@kvack.org, linux-btrfs@vger.kernel.org, io-uring@vger.kernel.org, nilay@linux.ibm.com, ritesh.list@gmail.com, willy@infradead.org, agk@redhat.com, snitzer@kernel.org, mpatocka@redhat.com, dm-devel@lists.linux.dev, hare@suse.de, John Garry Subject: [PATCH v8 00/10] block atomic writes Date: Mon, 10 Jun 2024 10:43:19 +0000 Message-Id: <20240610104329.3555488-1-john.g.garry@oracle.com> X-Mailer: git-send-email 2.31.1 X-ClientProxiedBy: MN2PR13CA0008.namprd13.prod.outlook.com (2603:10b6:208:160::21) To DM6PR10MB4313.namprd10.prod.outlook.com (2603:10b6:5:212::20) Precedence: bulk X-Mailing-List: linux-block@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM6PR10MB4313:EE_|SJ0PR10MB5613:EE_ X-MS-Office365-Filtering-Correlation-Id: 3b610952-dc7e-45bd-3a1c-08dc893a362f X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230031|7416005|376005|1800799015|366007|921011; X-Microsoft-Antispam-Message-Info: =?utf-8?q?ec/3UlVB5Wk37FaTm6EKkDLrcQdoulf?= =?utf-8?q?SsaY8BfXU/RAkts8whxQc7+MxF8XyFgmnRzytv5K6WQF5irdb63RuqncNPHaKtgBf?= =?utf-8?q?5cyBza+K9r5BJdIPyYH0wwUwPImculh75ksbrmzdMCpR7lfPQUo2Tl/GBGlB0g/C1?= =?utf-8?q?8H17k6vpxhgksWRBMe6ggipteF1YU13cm+oVuRXUfPW3unAXr3tbgSjmAW0gu+3mq?= =?utf-8?q?eHYb3dyHX61WgXqqIYEDitYhJFSl0w8M3p5GsQ0R73/8R2QaVSjkcWCgw6TOJCe5s?= =?utf-8?q?/VRHE74Jp0WKYfl8OSQ+zbLbG12iqEVtsY/GTLXtNmCC/I7ql4tXzogy3kXgpj+lA?= =?utf-8?q?tgEOndy9WAriijnKCvGzXeC1ZHHbb568PrFusc2EhH+AjVGbL+0btyX+E0JFJ9sW+?= =?utf-8?q?nu81W2MidPkesJ6GXVXB4nwjKw4YeLdDSBMH81+q3MH+fQ3H+po/eByr0adTbWXUv?= =?utf-8?q?ExJuOLolN/SkQo5EfNQJ1w7PvDrB2px0pQ3hAx3n7KJOBd0/hKCxtE8NOysp4L06S?= =?utf-8?q?Oyj1gXt25q1ULGx9kcyPYtQlZArDI9bveXmoJT265Sg6ezSQ1vmvIq5OCeezPAiOI?= =?utf-8?q?rFQcB2apmY01QVxMcJzse9X71EZkLAEQg2VxIfFX3HiPP3pBC0bGjYx384w1Wv8tY?= =?utf-8?q?OXcDGmkIY3au5HzpUHQ/ZCF/XpziJU18PNiuhQDO7LQhPk7RvoS1QJo2U5Jl+0RSH?= =?utf-8?q?bt3KlvZF5ho9it8oe3evqR+HWVR7G3B1S5j4P7x5Wsw9VaZbYcGd0AwA7dnZ2xPHT?= =?utf-8?q?Ecipe/RnXyB1oUvw0MG+QmnAFHCWPIpvlFkbleydfJODiw1imV2pGKLhVSBct52AN?= =?utf-8?q?+vvF3uufoCzNHL2Dtx7kyzHJRNu7tb9/DQ4EJqTEeMnWN/307WXLni8nfxblKcern?= =?utf-8?q?V48fWc19GkvcxBMpaoQSJ3VAU+SPqg8iYRC5Erm6rjgvBfILS/UrWkci9tznHjbJN?= =?utf-8?q?jpNWGJYUFQ8lhyKZk81kF94yfQ07KsTKJzPiVw2B6r2Lxi1b65jpvFowkWsRvGpPU?= =?utf-8?q?RPGZ4685XG6IGqD+kl6r+l23viACCs6H5bJGSi0ZxQfg0cgJa54HvNF7+MFHlGO8m?= =?utf-8?q?VZZT4tPdmX5pkHpWpdH6qwoTUW/BMyYrF/uo0GVFsyrZH1O2hl2B8TdxF/3Gge2+w?= =?utf-8?q?IoZPKO1PzXiSrd84n79cVc5+tf1/wyyKHKCDDdCi8pjzGe8KRWwylkI7xaZYiLYrM?= =?utf-8?q?hN7Qx2jiBt0+7TGHQMN+jr7QhVvW+s/l4+yRKkkOYiZfcl8c4fcRtZ9Vk6OCFizPk?= =?utf-8?q?0vRsS34TUu/J5?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM6PR10MB4313.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(7416005)(376005)(1800799015)(366007)(921011);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?q?nbsci8TrUXOMube3aVmVqtdvx7XX?= =?utf-8?q?2bhcpePYui11W1gicLg2fknIGtVSjp4RbCeFjkukrS6dqZd1XETKC0VeAc+89H4+/?= =?utf-8?q?S+Ut8iDn3LQoKHcZJ8bAlOHD0t8Y0wXnz5GOSV0ZP2/hIZwmHr9qOT3qUC1LERKzd?= =?utf-8?q?NgKwEm9u9kv6vRoIZxcq1WOr2/6uoeyWLYcQuF1WpS0WLEvk8M/2ikgwo6XkBZUoN?= =?utf-8?q?wlUY9riG40TRvpNYUSIUm6D8t1FSSKsmwmT7GtjqvAdzddAOJV4WZI/XEmx1eygCz?= =?utf-8?q?Jg1KagpJxllHudYQ12SfAEb8XnewmUaQFQqulJ3Qhu9UKWRsm+MZHJ7+QEnBWaoOn?= =?utf-8?q?6m/EY4Qv7Fpz7TlYx31glearZSZZpLP/ru4PAd3fpOMGfDYAn1WxLIlbVk5E0Rovk?= =?utf-8?q?O1JgDy8PxCmamAEtko9bWQcLOegXor7z8t5z1KS5bHdRS4kkFUx1jvK2cGb1r9lab?= =?utf-8?q?WjSQi1dcrMj8yugDb7l1ghdHr6QsxEt2DfUzJVuB+gkTQfXz+WVDy9+8BPPTuoFd5?= =?utf-8?q?DxyFshSKU+QK7wk0D9zpXxC2RgMIYA6lfqQFhWzDeabFn0mWZwZGeHvAfVI7G/79p?= =?utf-8?q?9mTOoldWxbWBqf7ylraIqUqQvw8mr1JplqyGR//ZdQK8vWKzSfSif+arSXGCIF/f+?= =?utf-8?q?rsFv7oF/EvnDHeDcwtWK5pN1HzyeljbSA0I91E8PSTeC1PUidAO2NcrC1U6rrZdkW?= =?utf-8?q?KQuIOwG9xQKawBoWnXqtBrws8BGePPk/LSTmwn4y7g6n300S1z+nvNwX2UmhUh1Kv?= =?utf-8?q?+u6DYX0qxHn1UvWdnymnXIDBKwbfGi9JjhHZUQ0FD5WFMCFCR+mygEqdVD533R7QD?= =?utf-8?q?wRLCtm/luADNNUfeyLk544gXLAm92Q/BoVpnS4LL0IjfhcU+hUZUZs1IdbJSizI42?= =?utf-8?q?sOADwnntGxfx3pa2hB20Vf8/iTyX1cB3W8YB4C8QU6XSrM4M3or41coTSZtxr7kpH?= =?utf-8?q?8jvmRhQdAqRVx+mMRytc2P+i9Sd2sYJb5hatmcsDnIqBAN4aS4/2NJvaZdrYtNsN9?= =?utf-8?q?fZLQvYIU1kyuyQsrTrsb7uG/cbwo9Nl07XmX6gzSZLPTBUSCSmZ+FFzCMF+5KGAvI?= =?utf-8?q?Nghtb20kR5c+GVTl4oNpCVd12aKI8dNzewjlj1l+AB3QmdgPDmoGNKaRzTg9OB9kX?= =?utf-8?q?y/MGI+/vIhXQ5b1rSEGmGJgHKkkAmZ3L5UzMrbeR1rxt+cMUKF5wE81Vd3vo9WUfU?= =?utf-8?q?IjZjR9wNKcPpY4imMihwdNISg6gg9o497c3IK4FibTQ2n0T+pztO6qk6nsSCgIwCM?= =?utf-8?q?CIMUnMAu9SRtxE1HGXyz3ITjgamPwkQpzN9r6kqRPOhkzAxpgFC0lL6efDXWBebOh?= =?utf-8?q?g2TFRlphBGOBZNp/ShdB72TLU8yU4svvvWfivwnB8SqCqN4UJA959jr1V7PvrQfk7?= =?utf-8?q?E0wAzpFrrSFh7ekaP7WZWKeSiNPdwA+ppjR7qqkF2EjJHonCuFN1+XtdyZ7fMv8wE?= =?utf-8?q?IrGXROkZhvp+c9EUt3Xuvr0klV2QO98M542L+7q0L59p+9VMAKSumwaKzyPZpfagX?= =?utf-8?q?qHYg21ZIWUlLM9jnI69Qfqoc65M5RHzHqg=3D=3D?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: GNh/g8YQJB7nOT2OftcCyvSQh3DXaiJQ25WzgAAoH0y28wzV4deWcB165DjFFt2/X4HHcaTFJv1I9cageOqPmI41TgpRFhvzD882o2GFrnWgfGdleJFM7rO5DyfTHT0aVtulbMRDPN/snj5bkj7sbPaJi20CMm9SqDJ0+8AzFktAcf5atFn1Ane90RzzkTJ2wO42BislWixQzPmgNAkpn/S9X9sryX4MxCxMMptkYeo1AQ6S4tE7X8OV0VcjRIYKvQNnFRcaxrmiMWpp3B2YbdtyEEgZLc7kKlvb7BavInlC+NLmk1xOkTwOK9yS2YXpqwmHvFcqpxKfgSOOkMR9NeujwySNyQqwBp2/XijlhyWbVoM3KpDsoGvGEQY9Qia0IcRkWLxfVp1xxQ6OkoLRcKFva+SWkgt6IRlPDDS0KozpUpsN2/tuosz8RJ4NjzhcCGxudVgImkAEsa+vBno9rwjytpKMfLaCU/FuT2INfkY0/UQvhsUhcHAIs3PMBjD3xP1cppfckPD0ZMZ24cXovLtkgL5GTi5Q59LgyhLNr4LP7X8F5/EfKYjpn+a32ToOh9/lQgByZ3RNLZBW1cL96wHiQNF2zGFXIZFddjzqUuE= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3b610952-dc7e-45bd-3a1c-08dc893a362f X-MS-Exchange-CrossTenant-AuthSource: DM6PR10MB4313.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Jun 2024 10:43:49.1048 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: CXxmyMusOFmeEokIHE45N7ovW18ONgdBhNCnglkf2IcPzjKkYRS6inpgSeSt3HQNI6rnXbyVkS33Q2IWJp12LA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR10MB5613 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1039,Hydra:6.0.680,FMLib:17.12.28.16 definitions=2024-06-10_02,2024-06-10_01,2024-05-17_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 phishscore=0 adultscore=0 mlxscore=0 bulkscore=0 malwarescore=0 mlxlogscore=999 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2405010000 definitions=main-2406100081 X-Proofpoint-GUID: HAGR-xYpV1LLUq9784itxfs-bHaYAIh3 X-Proofpoint-ORIG-GUID: HAGR-xYpV1LLUq9784itxfs-bHaYAIh3 This series introduces a proposal to implementing atomic writes in the kernel for torn-write protection. This series takes the approach of adding a new "atomic" flag to each of pwritev2() and iocb->ki_flags - RWF_ATOMIC and IOCB_ATOMIC, respectively. When set, these indicate that we want the write issued "atomically". Only direct IO is supported and for block devices here. For this, atomic write HW is required, like SCSI ATOMIC WRITE (16). XFS FS support has previously been posted at: https://lore.kernel.org/linux-xfs/20240607143919.2622319-1-john.g.garry@oracle.com/T/#t Updated man pages have been posted at: https://lore.kernel.org/lkml/20240124112731.28579-1-john.g.garry@oracle.com/T/#m520dca97a9748de352b5a723d3155a4bb1e46456 The goal here is to provide an interface that allows applications use application-specific block sizes larger than logical block size reported by the storage device or larger than filesystem block size as reported by stat(). With this new interface, application blocks will never be torn or fractured when written. For a power fail, for each individual application block, all or none of the data to be written. A racing atomic write and read will mean that the read sees all the old data or all the new data, but never a mix of old and new. Three new fields are added to struct statx - atomic_write_unit_min, atomic_write_unit_max, and atomic_write_segments_max. For each atomic individual write, the total length of a write must be a between atomic_write_unit_min and atomic_write_unit_max, inclusive, and a power-of-2. The write must also be at a natural offset in the file wrt the write length. For pwritev2, iovcnt is limited by atomic_write_segments_max. There has been some discussion on untorn buffered writes support at: https://lore.kernel.org/linux-fsdevel/20240601093325.GC247052@mit.edu/T/#t That conversation continues. SCSI sd.c and scsi_debug and NVMe kernel support is added. This series is based on Jens' block-6.10 + [0] [0] https://lore.kernel.org/linux-scsi/20240531122356.GA24343@lst.de/T/#m34e797fa96df5ad7d1781fca38e14b6132d0aabe Patches can be found at: https://github.com/johnpgarry/linux/commits/atomic-writes-v6.10-v8 Changes since v7: - Generalize block chunk_sectors support (Hannes) - Relocate and reorder args for generic_atomic_write_valid (Christoph) - Drop rq_straddles_atomic_write_boundary() Changes since v6: - Rebase - Fix bdev_can_atomic_write() sector calculation - Update block sysfs comment on atomic write boundary (Randy) - Add Luis' RB tag for patch #1 (thanks) Alan Adamson (1): nvme: Atomic write support John Garry (6): block: Pass blk_queue_get_max_sectors() a request pointer block: Generalize chunk_sectors support as boundary support block: Add core atomic write support block: Add fops atomic write support scsi: sd: Atomic write support scsi: scsi_debug: Atomic write support Prasad Singamsetty (3): fs: Initial atomic write support fs: Add initial atomic write support info to statx block: Add atomic write support for statx Documentation/ABI/stable/sysfs-block | 53 +++ block/bdev.c | 36 +- block/blk-core.c | 19 + block/blk-merge.c | 67 ++- block/blk-mq.c | 2 +- block/blk-settings.c | 75 ++++ block/blk-sysfs.c | 33 ++ block/blk.h | 9 +- block/fops.c | 20 +- drivers/md/dm.c | 2 +- drivers/nvme/host/core.c | 49 +++ drivers/scsi/scsi_debug.c | 588 +++++++++++++++++++++------ drivers/scsi/scsi_trace.c | 22 + drivers/scsi/sd.c | 93 ++++- drivers/scsi/sd.h | 8 + fs/aio.c | 8 +- fs/btrfs/ioctl.c | 2 +- fs/read_write.c | 18 +- fs/stat.c | 50 ++- include/linux/blk_types.h | 8 +- include/linux/blkdev.h | 74 +++- include/linux/fs.h | 20 +- include/linux/stat.h | 3 + include/scsi/scsi_proto.h | 1 + include/trace/events/scsi.h | 1 + include/uapi/linux/fs.h | 5 +- include/uapi/linux/stat.h | 12 +- io_uring/rw.c | 9 +- 28 files changed, 1095 insertions(+), 192 deletions(-) Reviewed-by: Martin K. Petersen