| Message ID | 20130326174554.GB28030@localhost.localdomain (mailing list archive) |
|---|---|
| State | New, archived |
| Headers | show |
Hi Josef, Am 26.03.2013 18:45, schrieb Josef Bacik: >> Am 26.03.2013 16:25, schrieb Josef Bacik: >>> On Tue, Mar 26, 2013 at 09:03:11AM -0600, Stefan Priebe - Profihost AG wrote: >>>> Hi, >>>> Am 26.03.2013 15:44, schrieb Josef Bacik: >>>>>>>> Am 26.03.2013 13:53, schrieb Josef Bacik: >>>>>>>> no - it's just mounted with mount -o noatime >>>>>>>> >>>>>>>> :~# cat /proc/mounts | grep btrfs >>>>>>>> /dev/mapper/raid54tb1 /mnt btrfs rw,noatime,space_cache 0 0 >>>>>>>> >>>>>>> >>>>>>> Ok I think I see what's going on. Can you try this patch and see if it fixes >>>>>>> it? Thanks, >>>>>> >>>>>> It still does not fix the problem. >>>>>> >>>>>> The rsync output looks like this so it does not work for file a but then >>>>>> continues on c d e, ... >>>>>> >>>>>> sync -av --progress /backup/ /mnt/ >>>>>> sending incremental file list >>>>>> .etc_openvpn/ipp.txt >>>>>> 229 100% 3.99kB/s 0:00:00 (xfer#2, to-check=1009/1196) >>>>>> .etc_openvpn/openvpn-status.log >>>>>> 360 100% 6.28kB/s 0:00:00 (xfer#3, to-check=1007/1196) >>>>>> rsync: rename "/mnt/.etc_openvpn/.ipp.txt.t9lucX" -> >>>>>> ".etc_openvpn/ipp.txt": No space left on device (28) >>>>>> .log/ >>>>>> .log/UcliEvt.log >>>>>> 104188 100% 147.67kB/s 0:00:00 (xfer#4, to-check=1131/2700) >>>>>> .log/auth.log >>>>>> 15211522 100% 2.97MB/s 0:00:04 (xfer#5, to-check=1105/2700) >>>>>> .log/auth.log.1 >>>>>> 19431424 61% 7.35MB/s 0:00:01 >>>>>> >>>>>> the dmesg output looks like this: >>>>>> [ 551.321576] returning enospc, space_info 3, size 0 reserved 0, flush >>>>>> 2, flush_state 7 dumping space info >>>>>> [ 551.323694] space_info 4 has 6439526400 free, is full >>>>>> [ 551.323696] space_info total=25748307968, used=19308666880, pinned=0, >>>>>> reserved=49152, may_use=6438453248, readonly=65536 >>>>>> >>>>> >>>>> Ok so then this is probably it, let me know if it helps. Thanks, >>>> >>>> OK it now has copied a lot of files (170) without an error all were very >>>> small. >>>> >>> >>> Welp progress is good. Throw this into the mix and go again, it's just adding >>> some more debugging so I can make sure I'm going down the right rabbit hole. >>> Thanks, >> >> Output is now: >> [ 9587.445642] returning enospc, space_info 3, size 0 reserved 0, flush >> 2, flush_state 7 dumping space info >> [ 9587.527392] dumping block rsv 2, size 0 reserved 0 >> [ 9587.567871] dumping block rsv 5, size 196608 reserved 196608 >> [ 9587.607661] dumping block rsv 1, size 6438256640 reserved 6438256640 >> [ 9587.646958] space_info 4 has 6439428096 free, is full >> [ 9587.646963] space_info total=25748307968, used=19308769280, pinned=0, >> reserved=45056, may_use=6438453248, readonly=65536 >> [ 9587.649410] returning enospc, space_info 3, size 0 reserved 0, flush >> 2, flush_state 7 dumping space info >> [ 9587.727000] dumping block rsv 2, size 0 reserved 0 >> [ 9587.765284] dumping block rsv 5, size 98304 reserved 98304 >> [ 9587.802849] dumping block rsv 1, size 6438256640 reserved 6438256640 >> [ 9587.839935] space_info 4 has 6439428096 free, is full >> [ 9587.839936] space_info total=25748307968, used=19308769280, pinned=0, >> reserved=45056, may_use=6438354944, readonly=65536 >> > > Well then that looks like I was going down the wrong rabbit hole. This should > fix you up, for real this time ;). Thanks, Yes - this works now. Which of the patches can i drop? Do i just need the last one? Is it safe to add another 18TB raid via converting it to btrfs raid0? Will the fix be part of 3.9-rc5? Thanks and greets, Stefan -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
On Tue, Mar 26, 2013 at 01:05:36PM -0600, Stefan Priebe wrote: > Hi Josef, > > Am 26.03.2013 18:45, schrieb Josef Bacik: > >> Am 26.03.2013 16:25, schrieb Josef Bacik: > >>> On Tue, Mar 26, 2013 at 09:03:11AM -0600, Stefan Priebe - Profihost AG wrote: > >>>> Hi, > >>>> Am 26.03.2013 15:44, schrieb Josef Bacik: > >>>>>>>> Am 26.03.2013 13:53, schrieb Josef Bacik: > >>>>>>>> no - it's just mounted with mount -o noatime > >>>>>>>> > >>>>>>>> :~# cat /proc/mounts | grep btrfs > >>>>>>>> /dev/mapper/raid54tb1 /mnt btrfs rw,noatime,space_cache 0 0 > >>>>>>>> > >>>>>>> > >>>>>>> Ok I think I see what's going on. Can you try this patch and see if it fixes > >>>>>>> it? Thanks, > >>>>>> > >>>>>> It still does not fix the problem. > >>>>>> > >>>>>> The rsync output looks like this so it does not work for file a but then > >>>>>> continues on c d e, ... > >>>>>> > >>>>>> sync -av --progress /backup/ /mnt/ > >>>>>> sending incremental file list > >>>>>> .etc_openvpn/ipp.txt > >>>>>> 229 100% 3.99kB/s 0:00:00 (xfer#2, to-check=1009/1196) > >>>>>> .etc_openvpn/openvpn-status.log > >>>>>> 360 100% 6.28kB/s 0:00:00 (xfer#3, to-check=1007/1196) > >>>>>> rsync: rename "/mnt/.etc_openvpn/.ipp.txt.t9lucX" -> > >>>>>> ".etc_openvpn/ipp.txt": No space left on device (28) > >>>>>> .log/ > >>>>>> .log/UcliEvt.log > >>>>>> 104188 100% 147.67kB/s 0:00:00 (xfer#4, to-check=1131/2700) > >>>>>> .log/auth.log > >>>>>> 15211522 100% 2.97MB/s 0:00:04 (xfer#5, to-check=1105/2700) > >>>>>> .log/auth.log.1 > >>>>>> 19431424 61% 7.35MB/s 0:00:01 > >>>>>> > >>>>>> the dmesg output looks like this: > >>>>>> [ 551.321576] returning enospc, space_info 3, size 0 reserved 0, flush > >>>>>> 2, flush_state 7 dumping space info > >>>>>> [ 551.323694] space_info 4 has 6439526400 free, is full > >>>>>> [ 551.323696] space_info total=25748307968, used=19308666880, pinned=0, > >>>>>> reserved=49152, may_use=6438453248, readonly=65536 > >>>>>> > >>>>> > >>>>> Ok so then this is probably it, let me know if it helps. Thanks, > >>>> > >>>> OK it now has copied a lot of files (170) without an error all were very > >>>> small. > >>>> > >>> > >>> Welp progress is good. Throw this into the mix and go again, it's just adding > >>> some more debugging so I can make sure I'm going down the right rabbit hole. > >>> Thanks, > >> > >> Output is now: > >> [ 9587.445642] returning enospc, space_info 3, size 0 reserved 0, flush > >> 2, flush_state 7 dumping space info > >> [ 9587.527392] dumping block rsv 2, size 0 reserved 0 > >> [ 9587.567871] dumping block rsv 5, size 196608 reserved 196608 > >> [ 9587.607661] dumping block rsv 1, size 6438256640 reserved 6438256640 > >> [ 9587.646958] space_info 4 has 6439428096 free, is full > >> [ 9587.646963] space_info total=25748307968, used=19308769280, pinned=0, > >> reserved=45056, may_use=6438453248, readonly=65536 > >> [ 9587.649410] returning enospc, space_info 3, size 0 reserved 0, flush > >> 2, flush_state 7 dumping space info > >> [ 9587.727000] dumping block rsv 2, size 0 reserved 0 > >> [ 9587.765284] dumping block rsv 5, size 98304 reserved 98304 > >> [ 9587.802849] dumping block rsv 1, size 6438256640 reserved 6438256640 > >> [ 9587.839935] space_info 4 has 6439428096 free, is full > >> [ 9587.839936] space_info total=25748307968, used=19308769280, pinned=0, > >> reserved=45056, may_use=6438354944, readonly=65536 > >> > > > > Well then that looks like I was going down the wrong rabbit hole. This should > > fix you up, for real this time ;). Thanks, > > Yes - this works now. Which of the patches can i drop? Do i just need > the last one? > Is it safe to add another 18TB raid via converting it to btrfs raid0? > Will the fix be part of 3.9-rc5? > So I'll put together all of the patches that actually need to go up for this and post them, but basically its the mutex patch, the last patch I sent you and the one that adjusts the reservations for rename and delete. Thanks, Josef -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Hi, but when i transfer big files i see now this one: [20368.784736] INFO: task rsync:14911 blocked for more than 120 seconds. [20368.821978] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [20368.895140] rsync D ffffffff8160f580 0 14911 1 0x00000000 [20368.895148] ffff8801ca63fc78 0000000000000086 ffff8800c28f8198 ffff88022394f800 [20368.895158] ffff8801ca63ffd8 ffff8801ca63ffd8 ffff8801ca63ffd8 0000000000012c40 [20368.895163] ffffffff81a11440 ffff8801c9d36340 ffff8801ca63fc88 ffff8801cefce130 [20368.895169] Call Trace: [20368.895180] [<ffffffff8151a774>] schedule+0x24/0x70 [20368.895207] [<ffffffffa0158c75>] wait_current_trans.isra.32+0x95/0x100 [btrfs] [20368.895214] [<ffffffff8106d4f0>] ? add_wait_queue+0x60/0x60 [20368.895236] [<ffffffffa015a45d>] start_transaction.part.33+0x13d/0x4d0 [btrfs] [20368.895252] [<ffffffff811420f3>] ? inode_permission+0x13/0x50 [20368.895271] [<ffffffffa015a814>] start_transaction+0x24/0x30 [btrfs] [20368.895287] [<ffffffffa015aae3>] btrfs_start_transaction+0x13/0x20 [btrfs] [20368.895302] [<ffffffffa015b2f0>] __unlink_start_trans+0x70/0x460 [btrfs] [20368.895307] [<ffffffff8150ee3e>] ? check_acl+0x5a/0x122 [20368.895312] [<ffffffff81055ff0>] ? ns_capable+0x30/0x60 [20368.895317] [<ffffffff811413bd>] ? generic_permission+0xbd/0x110 [20368.895336] [<ffffffffa0163f92>] btrfs_unlink+0x32/0xc0 [btrfs] [20368.895341] [<ffffffff8114186d>] vfs_unlink.part.61+0x6d/0xd0 [20368.895345] [<ffffffff81143ad7>] vfs_unlink+0x37/0x50 [20368.895349] [<ffffffff81143c8b>] do_unlinkat+0x19b/0x240 [20368.895354] [<ffffffff81146171>] sys_unlink+0x11/0x20 [20368.895359] [<ffffffff8151c2e9>] system_call_fastpath+0x16/0x1b Speed is just 100kb/s instead of 100MB/s. Stefan Am 26.03.2013 20:16, schrieb Josef Bacik: > On Tue, Mar 26, 2013 at 01:05:36PM -0600, Stefan Priebe wrote: >> Hi Josef, >> >> Am 26.03.2013 18:45, schrieb Josef Bacik: >>>> Am 26.03.2013 16:25, schrieb Josef Bacik: >>>>> On Tue, Mar 26, 2013 at 09:03:11AM -0600, Stefan Priebe - Profihost AG wrote: >>>>>> Hi, >>>>>> Am 26.03.2013 15:44, schrieb Josef Bacik: >>>>>>>>>> Am 26.03.2013 13:53, schrieb Josef Bacik: >>>>>>>>>> no - it's just mounted with mount -o noatime >>>>>>>>>> >>>>>>>>>> :~# cat /proc/mounts | grep btrfs >>>>>>>>>> /dev/mapper/raid54tb1 /mnt btrfs rw,noatime,space_cache 0 0 >>>>>>>>>> >>>>>>>>> >>>>>>>>> Ok I think I see what's going on. Can you try this patch and see if it fixes >>>>>>>>> it? Thanks, >>>>>>>> >>>>>>>> It still does not fix the problem. >>>>>>>> >>>>>>>> The rsync output looks like this so it does not work for file a but then >>>>>>>> continues on c d e, ... >>>>>>>> >>>>>>>> sync -av --progress /backup/ /mnt/ >>>>>>>> sending incremental file list >>>>>>>> .etc_openvpn/ipp.txt >>>>>>>> 229 100% 3.99kB/s 0:00:00 (xfer#2, to-check=1009/1196) >>>>>>>> .etc_openvpn/openvpn-status.log >>>>>>>> 360 100% 6.28kB/s 0:00:00 (xfer#3, to-check=1007/1196) >>>>>>>> rsync: rename "/mnt/.etc_openvpn/.ipp.txt.t9lucX" -> >>>>>>>> ".etc_openvpn/ipp.txt": No space left on device (28) >>>>>>>> .log/ >>>>>>>> .log/UcliEvt.log >>>>>>>> 104188 100% 147.67kB/s 0:00:00 (xfer#4, to-check=1131/2700) >>>>>>>> .log/auth.log >>>>>>>> 15211522 100% 2.97MB/s 0:00:04 (xfer#5, to-check=1105/2700) >>>>>>>> .log/auth.log.1 >>>>>>>> 19431424 61% 7.35MB/s 0:00:01 >>>>>>>> >>>>>>>> the dmesg output looks like this: >>>>>>>> [ 551.321576] returning enospc, space_info 3, size 0 reserved 0, flush >>>>>>>> 2, flush_state 7 dumping space info >>>>>>>> [ 551.323694] space_info 4 has 6439526400 free, is full >>>>>>>> [ 551.323696] space_info total=25748307968, used=19308666880, pinned=0, >>>>>>>> reserved=49152, may_use=6438453248, readonly=65536 >>>>>>>> >>>>>>> >>>>>>> Ok so then this is probably it, let me know if it helps. Thanks, >>>>>> >>>>>> OK it now has copied a lot of files (170) without an error all were very >>>>>> small. >>>>>> >>>>> >>>>> Welp progress is good. Throw this into the mix and go again, it's just adding >>>>> some more debugging so I can make sure I'm going down the right rabbit hole. >>>>> Thanks, >>>> >>>> Output is now: >>>> [ 9587.445642] returning enospc, space_info 3, size 0 reserved 0, flush >>>> 2, flush_state 7 dumping space info >>>> [ 9587.527392] dumping block rsv 2, size 0 reserved 0 >>>> [ 9587.567871] dumping block rsv 5, size 196608 reserved 196608 >>>> [ 9587.607661] dumping block rsv 1, size 6438256640 reserved 6438256640 >>>> [ 9587.646958] space_info 4 has 6439428096 free, is full >>>> [ 9587.646963] space_info total=25748307968, used=19308769280, pinned=0, >>>> reserved=45056, may_use=6438453248, readonly=65536 >>>> [ 9587.649410] returning enospc, space_info 3, size 0 reserved 0, flush >>>> 2, flush_state 7 dumping space info >>>> [ 9587.727000] dumping block rsv 2, size 0 reserved 0 >>>> [ 9587.765284] dumping block rsv 5, size 98304 reserved 98304 >>>> [ 9587.802849] dumping block rsv 1, size 6438256640 reserved 6438256640 >>>> [ 9587.839935] space_info 4 has 6439428096 free, is full >>>> [ 9587.839936] space_info total=25748307968, used=19308769280, pinned=0, >>>> reserved=45056, may_use=6438354944, readonly=65536 >>>> >>> >>> Well then that looks like I was going down the wrong rabbit hole. This should >>> fix you up, for real this time ;). Thanks, >> >> Yes - this works now. Which of the patches can i drop? Do i just need >> the last one? >> Is it safe to add another 18TB raid via converting it to btrfs raid0? >> Will the fix be part of 3.9-rc5? >> > > So I'll put together all of the patches that actually need to go up for this and > post them, but basically its the mutex patch, the last patch I sent you and the > one that adjusts the reservations for rename and delete. Thanks, > > Josef > -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
diff --git a/fs/btrfs/extent-tree.c b/fs/btrfs/extent-tree.c index 1cf810a..ac415cf7 100644 --- a/fs/btrfs/extent-tree.c +++ b/fs/btrfs/extent-tree.c @@ -4471,7 +4471,12 @@ static void update_global_block_rsv(struct btrfs_fs_info *fs_info) spin_lock(&sinfo->lock); spin_lock(&block_rsv->lock); - block_rsv->size = num_bytes; + /* + * Limit the global block rsv to 512mb, we have infrastructure in place + * to throttle reservations if we start getting low on global block rsv + * space. + */ + block_rsv->size = min_t(u64, num_bytes, 512 * 1024 * 1024); num_bytes = sinfo->bytes_used + sinfo->bytes_pinned + sinfo->bytes_reserved + sinfo->bytes_readonly +