diff mbox

Revert "dm mpath: remove unnecessary NVMe branching in favor of scsi_dh checks"

Message ID 20180312202808.3556-1-bart.vanassche@wdc.com (mailing list archive)
State Rejected, archived
Delegated to: Mike Snitzer
Headers show

Commit Message

Bart Van Assche March 12, 2018, 8:28 p.m. UTC
This patch fixes the following kernel crash:

INFO: trying to register non-static key.
the code is fine but needs lockdep annotation.
turning off the locking correctness validator.
CPU: 1 PID: 155 Comm: kworker/1:1H Not tainted 4.16.0-rc5-dbg+ #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.0.0-prebuilt.qemu-project.org 04/01/2014
Workqueue: kblockd blk_mq_run_work_fn
Call Trace:
 dump_stack+0x85/0xc7
 register_lock_class+0x82a/0x830
 __lock_acquire+0x141/0x1b10
 lock_acquire+0xc9/0x260
 _raw_spin_lock_irqsave+0x41/0x50
 __wake_up_common_lock+0x9e/0x100
 pg_init_done+0x100/0x240 [dm_multipath]
 multipath_clone_and_map+0x32c/0x340 [dm_multipath]
 map_request+0xc1/0x550 [dm_mod]
 dm_mq_queue_rq+0xf9/0x1a0 [dm_mod]
 blk_mq_dispatch_rq_list+0x143/0xac0
 blk_mq_sched_dispatch_requests+0x23d/0x2f0
 __blk_mq_run_hw_queue+0xdb/0x160
 process_one_work+0x441/0xa50
 worker_thread+0x76/0x6c0
 kthread+0x1b2/0x1d0
 ret_from_fork+0x24/0x30

Comments

Mike Snitzer March 12, 2018, 9:23 p.m. UTC | #1
On Mon, Mar 12 2018 at  4:28pm -0400,
Bart Van Assche <bart.vanassche@wdc.com> wrote:

> This patch fixes the following kernel crash:
> 
> INFO: trying to register non-static key.
> the code is fine but needs lockdep annotation.
> turning off the locking correctness validator.
> CPU: 1 PID: 155 Comm: kworker/1:1H Not tainted 4.16.0-rc5-dbg+ #1
> Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.0.0-prebuilt.qemu-project.org 04/01/2014
> Workqueue: kblockd blk_mq_run_work_fn
> Call Trace:
>  dump_stack+0x85/0xc7
>  register_lock_class+0x82a/0x830
>  __lock_acquire+0x141/0x1b10
>  lock_acquire+0xc9/0x260
>  _raw_spin_lock_irqsave+0x41/0x50
>  __wake_up_common_lock+0x9e/0x100
>  pg_init_done+0x100/0x240 [dm_multipath]
>  multipath_clone_and_map+0x32c/0x340 [dm_multipath]
>  map_request+0xc1/0x550 [dm_mod]
>  dm_mq_queue_rq+0xf9/0x1a0 [dm_mod]
>  blk_mq_dispatch_rq_list+0x143/0xac0
>  blk_mq_sched_dispatch_requests+0x23d/0x2f0
>  __blk_mq_run_hw_queue+0xdb/0x160
>  process_one_work+0x441/0xa50
>  worker_thread+0x76/0x6c0
>  kthread+0x1b2/0x1d0
>  ret_from_fork+0x24/0x30
> ==================================================================
> BUG: KASAN: null-ptr-deref in __wake_up_common+0x60/0x230
> Read of size 8 at addr 0000000000000000 by task kworker/1:1H/155
> 
> CPU: 1 PID: 155 Comm: kworker/1:1H Not tainted 4.16.0-rc5-dbg+ #1
> Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.0.0-prebuilt.qemu-project.org 04/01/2014
> Workqueue: kblockd blk_mq_run_work_fn
> Call Trace:
>  dump_stack+0x85/0xc7
>  kasan_report+0x139/0x350
>  __wake_up_common+0x60/0x230
>  __wake_up_common_lock+0xb9/0x100
>  pg_init_done+0x100/0x240 [dm_multipath]
>  multipath_clone_and_map+0x32c/0x340 [dm_multipath]
>  map_request+0xc1/0x550 [dm_mod]
>  dm_mq_queue_rq+0xf9/0x1a0 [dm_mod]
>  blk_mq_dispatch_rq_list+0x143/0xac0
>  blk_mq_sched_dispatch_requests+0x23d/0x2f0
>  __blk_mq_run_hw_queue+0xdb/0x160
>  process_one_work+0x441/0xa50
>  worker_thread+0x76/0x6c0
>  kthread+0x1b2/0x1d0
>  ret_from_fork+0x24/0x30
> ==================================================================
> 
> Fixes: 8d47e65948dd ("dm mpath: remove unnecessary NVMe branching in favor of scsi_dh checks")
> Signed-off-by: Bart Van Assche <bart.vanassche@wdc.com>

Sorry for your troubles but reverting isn't the proper way to handle
this (yet).

Could you provide more details on your setup?

Obviously you're using "queue_mode mq", what are your underlying paths?

Given the trace it would seem you're hitting multipath_clone_and_map()'s
blk_queue_dying(q) error path that calls activate_or_offline_path().

Would be useful to know the crash utility's output for:
dis -l pg_init_done+0x100

But I'd imagine it isn't happy here:
 wake_up(&m->pg_init_wait);

Given the commit in question, I am assuming there is something about
this setup_scsi_dh() code that is causing m->pg_init_wait to not be
initialized:

                        /*
                         * Init fields that are only used when a scsi_dh is attached
                         */
                        if (!test_and_set_bit(MPATHF_QUEUE_IO, &m->flags)) {
                                atomic_set(&m->pg_init_in_progress, 0);
                                atomic_set(&m->pg_init_count, 0);
                                m->pg_init_delay_msecs = DM_PG_INIT_DELAY_DEFAULT;
                                init_waitqueue_head(&m->pg_init_wait);
                        }

Wonder if having made that initialization conditional is the
culprit... that was needed because setup_scsi_dh() is called multiple
times now.  Whereas before this commit it was only done once as part of
the initial multipath table load (in alloc_multipath_stage2).

I'll keep looking at this.

Mike

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Bart Van Assche March 12, 2018, 9:32 p.m. UTC | #2
On Mon, 2018-03-12 at 17:23 -0400, Mike Snitzer wrote:
> Could you provide more details on your setup?
> 
> Obviously you're using "queue_mode mq", what are your underlying paths?
> 
> Given the trace it would seem you're hitting multipath_clone_and_map()'s
> blk_queue_dying(q) error path that calls activate_or_offline_path().

Hello Mike,

The reported kernel crash was triggered by running the following command:

srp-test/run_tests -c -d -r 10 -t 02-mq

The srp-test software is available at https://github.com/bvanassche/srp-test.
All patches necessary to run that script in a virtual machine (RoCE support
for the SRP initiator and target drivers) will be sent to Linus during the
kernel v4.17 merge window. These patches are already available in linux-next
today. Although I have not tried this myself, I expect that if you run the
above command against a kernel built from the linux-next code that that will
allow you to reproduce what I reported.

Thanks,

Bart.



--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Mike Snitzer March 13, 2018, 1:23 a.m. UTC | #3
On Mon, Mar 12 2018 at  5:32pm -0400,
Bart Van Assche <Bart.VanAssche@wdc.com> wrote:

> On Mon, 2018-03-12 at 17:23 -0400, Mike Snitzer wrote:
> > Could you provide more details on your setup?
> > 
> > Obviously you're using "queue_mode mq", what are your underlying paths?
> > 
> > Given the trace it would seem you're hitting multipath_clone_and_map()'s
> > blk_queue_dying(q) error path that calls activate_or_offline_path().
> 
> Hello Mike,
> 
> The reported kernel crash was triggered by running the following command:
> 
> srp-test/run_tests -c -d -r 10 -t 02-mq
> 
> The srp-test software is available at https://github.com/bvanassche/srp-test.
> All patches necessary to run that script in a virtual machine (RoCE support
> for the SRP initiator and target drivers) will be sent to Linus during the
> kernel v4.17 merge window. These patches are already available in linux-next
> today. Although I have not tried this myself, I expect that if you run the
> above command against a kernel built from the linux-next code that that will
> allow you to reproduce what I reported.

OK, that test again.  I clearly need to invest time to making it run on
my testbed.  But that will take time (though hopefully I can cut through
it tomorrrow).

Anyway, I'm hopeful I fixed the issue you reported.  Please feel free to
test the 2 topmost commits I've staged in linux-next, via dm-4.16:
https://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm.git/log/?h=dm-4.16

Mike

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Mike Snitzer March 13, 2018, 3:25 p.m. UTC | #4
On Mon, Mar 12 2018 at  5:32pm -0400,
Bart Van Assche <Bart.VanAssche@wdc.com> wrote:

> On Mon, 2018-03-12 at 17:23 -0400, Mike Snitzer wrote:
> > Could you provide more details on your setup?
> > 
> > Obviously you're using "queue_mode mq", what are your underlying paths?
> > 
> > Given the trace it would seem you're hitting multipath_clone_and_map()'s
> > blk_queue_dying(q) error path that calls activate_or_offline_path().
> 
> Hello Mike,
> 
> The reported kernel crash was triggered by running the following command:
> 
> srp-test/run_tests -c -d -r 10 -t 02-mq
> 
> The srp-test software is available at https://github.com/bvanassche/srp-test.
> All patches necessary to run that script in a virtual machine (RoCE support
> for the SRP initiator and target drivers) will be sent to Linus during the
> kernel v4.17 merge window. These patches are already available in linux-next
> today. Although I have not tried this myself, I expect that if you run the
> above command against a kernel built from the linux-next code that that will
> allow you to reproduce what I reported.

A pointer to the commit ids in question would be helpful so I can
appreciate the details better.

Why is there need for a virtual machine?
Just using extra isolation so as not to conflict with anything on the
host?

Anyway, I followed srp-test's README.md

But sadly, today's linux-next (next-20180313) is a mess (lots of macro
expansion breakage, for me anyway).

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Mike Snitzer March 13, 2018, 4:31 p.m. UTC | #5
On Tue, Mar 13 2018 at 11:25am -0400,
Mike Snitzer <snitzer@redhat.com> wrote:

> On Mon, Mar 12 2018 at  5:32pm -0400,
> Bart Van Assche <Bart.VanAssche@wdc.com> wrote:
> 
> > On Mon, 2018-03-12 at 17:23 -0400, Mike Snitzer wrote:
> > > Could you provide more details on your setup?
> > > 
> > > Obviously you're using "queue_mode mq", what are your underlying paths?
> > > 
> > > Given the trace it would seem you're hitting multipath_clone_and_map()'s
> > > blk_queue_dying(q) error path that calls activate_or_offline_path().
> > 
> > Hello Mike,
> > 
> > The reported kernel crash was triggered by running the following command:
> > 
> > srp-test/run_tests -c -d -r 10 -t 02-mq
> > 
> > The srp-test software is available at https://github.com/bvanassche/srp-test.
> > All patches necessary to run that script in a virtual machine (RoCE support
> > for the SRP initiator and target drivers) will be sent to Linus during the
> > kernel v4.17 merge window. These patches are already available in linux-next
> > today. Although I have not tried this myself, I expect that if you run the
> > above command against a kernel built from the linux-next code that that will
> > allow you to reproduce what I reported.
> 
> A pointer to the commit ids in question would be helpful so I can
> appreciate the details better.
> 
> Why is there need for a virtual machine?
> Just using extra isolation so as not to conflict with anything on the
> host?
> 
> Anyway, I followed srp-test's README.md
> 
> But sadly, today's linux-next (next-20180313) is a mess (lots of macro
> expansion breakage, for me anyway).

I fixed the linux-next build errors (I cc'd you on that).

But now I cannot get the test to run:

# srp-test/run_tests -c -d -r 10 -t 02-mq
Unloaded the ib_srpt kernel module
Unloaded the rdma_rxe kernel module
SoftRoCE network interfaces: rxe0 rxe1 rxe2 rxe3
Zero-initializing /dev/ram0 ... done
Zero-initializing /dev/ram1 ... done
Configured SRP target driver
Running test srp-test/tests/02-mq ...
Test file I/O on top of multipath concurrently with logout and login (0 min; mq)
Unloaded the ib_srp kernel module
/dev/disk/by-id/dm-uuid-mpath-3600140572616d6469736b31000000000: not found
Test srp-test/tests/02-mq failed

[  379.634518] ib_srp: QP creation failed for dev rxe1: -22
[  379.639849] srpt/10.16.43.122: Unsupported SCSI Opcode 0xa3, sending CHECK_CONDITION.
[  379.665891] sd 7:0:0:1: [sdk] Attached SCSI disk
[  379.673312] ib_srp: QP creation failed for dev rxe2: -22
[  379.688331] ib_srp: QP creation failed for dev rxe3: -22
[  379.708324] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
[  379.724538] ib_srp: target creation request is missing one or more parameters
[  379.740253] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
[  379.756531] ib_srp: target creation request is missing one or more parameters
[  379.773242] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
[  379.789532] ib_srp: target creation request is missing one or more parameters
[  379.805255] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
[  379.822532] ib_srp: target creation request is missing one or more parameters

But I realized that was with an old srp-test build.. so I tried to make
again.. seems your buildrequires has expanded:

Why does it need shellcheck?  On RHEL, having to pull in EPEL packages sucks.

And even once installed via EPEL (so ShellCheck-0.3.5-1.el7.x86_64):

# make
...
shellcheck -x -f gcc run_tests bin/getuid_callout lib/functions \
tests/*[^~]
unrecognized option `-x'

Usage: shellcheck [OPTIONS...] FILES...
  -e CODE1,CODE2..  --exclude=CODE1,CODE2..  exclude types of warnings
  -f FORMAT         --format=FORMAT          output format
  -s SHELLNAME      --shell=SHELLNAME        Specify dialect (bash,sh,ksh,zsh)
  -V                --version                Print version information

make: *** [shellcheck] Error 3

In general this srp-test suite is way too exotic with its requirements.
Barrier to entry from a dumb user like me is _way_ too high.

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Bart Van Assche March 13, 2018, 4:38 p.m. UTC | #6
On Tue, 2018-03-13 at 11:25 -0400, Mike Snitzer wrote:
> A pointer to the commit ids in question would be helpful so I can
> appreciate the details better.

Not sure whether this list is complete, but this is the most important one:

63cf1a902c9dd6b0761861ea87fce3663f59403b IB/srpt: Add RDMA/CM support

> Why is there need for a virtual machine?
> Just using extra isolation so as not to conflict with anything on the
> host?

Running these tests directly on the host is also fine. I wanted to explain
that no InfiniBand hardware is required.

Bart.

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Bart Van Assche March 13, 2018, 4:43 p.m. UTC | #7
On Mon, 2018-03-12 at 21:23 -0400, Mike Snitzer wrote:
> Anyway, I'm hopeful I fixed the issue you reported.  Please feel free to
> test the 2 topmost commits I've staged in linux-next, via dm-4.16:
> https://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm.git/log/?h=dm-4.16

So far I haven't seen the crash I reported yesterday in my tests with dm-4.16
of this morning. But I see hanging dm requests. I did not see any such issue
yesterday with the revert I posted applied on top of dm-4.16. What I see today
in the logs is the following:

INFO: task kworker/3:150:1681 blocked for more than 120 seconds

and in debugfs:
# (cd /sys/kernel/debug/block/ && grep -r op= .)
./dm-2/requeue_list:00000000df366fff {.op=READ, .cmd_flags=, .rq_flags=SORTED|STARTED|SOFTBARRIER|ELVPRIV|IO_STAT, .state=idle, .tag=-1, .internal_tag=45}
./dm-0/requeue_list:000000008302ea45 {.op=READ, .cmd_flags=, .rq_flags=SORTED|STARTED|SOFTBARRIER|ELVPRIV|IO_STAT, .state=idle, .tag=-1, .internal_tag=211}
./dm-1/requeue_list:000000007ea8ad0e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=428, .internal_tag=-1}
./dm-1/requeue_list:00000000e93ecaa8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=429, .internal_tag=-1}
./dm-1/requeue_list:00000000ac2789eb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=427, .internal_tag=-1}
./dm-1/requeue_list:0000000041b55e53 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=426, .internal_tag=-1}
./dm-1/requeue_list:00000000ccb769cd {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=425, .internal_tag=-1}
./dm-1/requeue_list:00000000c2694ac1 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=424, .internal_tag=-1}
./dm-1/requeue_list:000000008663848a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=423, .internal_tag=-1}
./dm-1/requeue_list:000000006e13a42d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=422, .internal_tag=-1}
./dm-1/requeue_list:000000008e2b8001 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=421, .internal_tag=-1}
./dm-1/requeue_list:0000000037a10a1f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=420, .internal_tag=-1}
./dm-1/requeue_list:00000000054fa8f7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=419, .internal_tag=-1}
./dm-1/requeue_list:000000001fc8dad4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=315, .internal_tag=-1}
./dm-1/requeue_list:00000000aa68728d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=458, .internal_tag=-1}
./dm-1/requeue_list:00000000d71a0846 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=457, .internal_tag=-1}
./dm-1/requeue_list:00000000ff0f33ee {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=456, .internal_tag=-1}
./dm-1/requeue_list:0000000024cc1b12 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=455, .internal_tag=-1}
./dm-1/requeue_list:0000000063b8f7aa {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=454, .internal_tag=-1}
./dm-1/requeue_list:00000000423f5ca3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=453, .internal_tag=-1}
./dm-1/requeue_list:0000000043f21d91 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=452, .internal_tag=-1}
./dm-1/requeue_list:00000000a7429040 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=451, .internal_tag=-1}
./dm-1/requeue_list:00000000f8d4bc45 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=450, .internal_tag=-1}
./dm-1/requeue_list:00000000688da6ec {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=449, .internal_tag=-1}
./dm-1/requeue_list:00000000d71785ba {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=448, .internal_tag=-1}
./dm-1/requeue_list:00000000f4fcb35e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=447, .internal_tag=-1}
./dm-1/requeue_list:00000000752d502f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=446, .internal_tag=-1}
./dm-1/requeue_list:00000000e5b4f207 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=445, .internal_tag=-1}
./dm-1/requeue_list:000000004fd06ee7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=444, .internal_tag=-1}
./dm-1/requeue_list:00000000e7d16916 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=443, .internal_tag=-1}
./dm-1/requeue_list:0000000001ec72c7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=442, .internal_tag=-1}
./dm-1/requeue_list:000000001fb68874 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=441, .internal_tag=-1}
./dm-1/requeue_list:0000000071f8d156 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=440, .internal_tag=-1}
./dm-1/requeue_list:00000000fcc23b46 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=439, .internal_tag=-1}
./dm-1/requeue_list:000000005f750b57 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=438, .internal_tag=-1}
./dm-1/requeue_list:00000000c009e1a7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=437, .internal_tag=-1}
./dm-1/requeue_list:000000006886009f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=436, .internal_tag=-1}
./dm-1/requeue_list:0000000089b99a8f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=435, .internal_tag=-1}
./dm-1/requeue_list:000000008f0d5abe {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=434, .internal_tag=-1}
./dm-1/requeue_list:00000000cd403bec {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=433, .internal_tag=-1}
./dm-1/requeue_list:00000000d7038eb7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=432, .internal_tag=-1}
./dm-1/requeue_list:00000000cee4478b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=431, .internal_tag=-1}
./dm-1/requeue_list:0000000055d39440 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=389, .internal_tag=-1}
./dm-1/requeue_list:0000000086b8094a {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=388, .internal_tag=-1}
./dm-1/requeue_list:0000000063a08f48 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=387, .internal_tag=-1}
./dm-1/requeue_list:0000000087ff12e2 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=386, .internal_tag=-1}
./dm-1/requeue_list:00000000267a0c29 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=385, .internal_tag=-1}
./dm-1/requeue_list:00000000114f920d {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=384, .internal_tag=-1}
./dm-1/requeue_list:000000001f05d8ed {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=383, .internal_tag=-1}
./dm-1/requeue_list:0000000006854fc0 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=382, .internal_tag=-1}
./dm-1/requeue_list:00000000072f88f6 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=381, .internal_tag=-1}
./dm-1/requeue_list:000000005f7c3288 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=380, .internal_tag=-1}
./dm-1/requeue_list:000000005de25cc8 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=379, .internal_tag=-1}
./dm-1/requeue_list:00000000345cb205 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=378, .internal_tag=-1}
./dm-1/requeue_list:00000000226ae98e {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=377, .internal_tag=-1}
./dm-1/requeue_list:00000000746206c0 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=376, .internal_tag=-1}
./dm-1/requeue_list:00000000bf6263a4 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=375, .internal_tag=-1}
./dm-1/requeue_list:00000000a4075272 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=374, .internal_tag=-1}
./dm-1/requeue_list:0000000023f43261 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=373, .internal_tag=-1}
./dm-1/requeue_list:00000000bceff300 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=372, .internal_tag=-1}
./dm-1/requeue_list:0000000077b0bb99 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=371, .internal_tag=-1}
./dm-1/requeue_list:00000000a16fd2e4 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=370, .internal_tag=-1}
./dm-1/requeue_list:000000009dfa3bcf {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=369, .internal_tag=-1}
./dm-1/requeue_list:00000000c6fc55a1 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=368, .internal_tag=-1}
./dm-1/requeue_list:0000000050332ec9 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=367, .internal_tag=-1}
./dm-1/requeue_list:00000000e57d9ea2 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=366, .internal_tag=-1}
./dm-1/requeue_list:0000000077062c59 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=359, .internal_tag=-1}
./dm-1/requeue_list:00000000b80d751b {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=358, .internal_tag=-1}
./dm-1/requeue_list:0000000095bb6311 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=357, .internal_tag=-1}
./dm-1/requeue_list:000000001bf757a7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=326, .internal_tag=-1}
./dm-1/requeue_list:00000000d4dc7831 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=365, .internal_tag=-1}
./dm-1/requeue_list:000000001c9f4cb2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=364, .internal_tag=-1}
./dm-1/requeue_list:0000000066dd1316 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=363, .internal_tag=-1}
./dm-1/requeue_list:0000000074670456 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=362, .internal_tag=-1}
./dm-1/requeue_list:00000000662dcd61 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=361, .internal_tag=-1}
./dm-1/requeue_list:000000006132e92e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=325, .internal_tag=-1}
./dm-1/requeue_list:0000000045b9ded8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=324, .internal_tag=-1}
./dm-1/requeue_list:00000000162c630f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=323, .internal_tag=-1}
./dm-1/requeue_list:00000000e88b8f68 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=322, .internal_tag=-1}
./dm-1/requeue_list:000000007eabf562 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=321, .internal_tag=-1}
./dm-1/requeue_list:0000000094a1bf9d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=320, .internal_tag=-1}
./dm-1/requeue_list:0000000044eef83f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=319, .internal_tag=-1}
./dm-1/requeue_list:0000000075b51306 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=318, .internal_tag=-1}
./dm-1/requeue_list:0000000089e6a338 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=317, .internal_tag=-1}
./dm-1/requeue_list:00000000cbefdbc4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=316, .internal_tag=-1}
./dm-1/requeue_list:000000009d48b39b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=360, .internal_tag=-1}
./dm-1/requeue_list:0000000063c539fa {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=356, .internal_tag=-1}
./dm-1/requeue_list:0000000089b40083 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=355, .internal_tag=-1}
./dm-1/requeue_list:00000000d303963b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=311, .internal_tag=-1}
./dm-1/requeue_list:00000000925ce4f4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=312, .internal_tag=-1}
./dm-1/requeue_list:0000000050effcee {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=354, .internal_tag=-1}
./dm-1/requeue_list:00000000b8d34b5c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=353, .internal_tag=-1}
./dm-1/requeue_list:0000000094a7a0e9 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=352, .internal_tag=-1}
./dm-1/requeue_list:00000000e9d84bef {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=351, .internal_tag=-1}
./dm-1/requeue_list:00000000984fbd83 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=350, .internal_tag=-1}
./dm-1/requeue_list:000000001d6d465b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=349, .internal_tag=-1}
./dm-1/requeue_list:000000006466ab10 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=348, .internal_tag=-1}
./dm-1/requeue_list:000000006bcaaafa {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=347, .internal_tag=-1}
./dm-1/requeue_list:00000000e62b371d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=346, .internal_tag=-1}
./dm-1/requeue_list:00000000a7e68221 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=345, .internal_tag=-1}
./dm-1/requeue_list:00000000dacf0de2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=344, .internal_tag=-1}
./dm-1/requeue_list:000000001dd25a5f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=343, .internal_tag=-1}
./dm-1/requeue_list:00000000a1cdb03e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=342, .internal_tag=-1}
./dm-1/requeue_list:000000002121bcf2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=341, .internal_tag=-1}
./dm-1/requeue_list:00000000d7d0904e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=340, .internal_tag=-1}
./dm-1/requeue_list:00000000ff9cf624 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=339, .internal_tag=-1}
./dm-1/requeue_list:00000000f24e1729 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=338, .internal_tag=-1}
./dm-1/requeue_list:000000006334f934 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=337, .internal_tag=-1}
./dm-1/requeue_list:00000000e895115e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=336, .internal_tag=-1}
./dm-1/requeue_list:00000000ad30a0d0 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=335, .internal_tag=-1}
./dm-1/requeue_list:000000005b5ed96a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=334, .internal_tag=-1}
./dm-1/requeue_list:0000000049bac932 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=333, .internal_tag=-1}
./dm-1/requeue_list:000000008db92654 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=332, .internal_tag=-1}
./dm-1/requeue_list:00000000033402aa {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=331, .internal_tag=-1}
./dm-1/requeue_list:00000000fd28fe57 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=330, .internal_tag=-1}
./dm-1/requeue_list:00000000de463af8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=329, .internal_tag=-1}
./dm-1/requeue_list:00000000c9e74050 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=328, .internal_tag=-1}
./dm-1/requeue_list:00000000b8cc1a1a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=327, .internal_tag=-1}
./dm-1/requeue_list:000000001b71f173 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=310, .internal_tag=-1}
./dm-1/requeue_list:00000000e118f903 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=309, .internal_tag=-1}
./dm-1/requeue_list:00000000b15b3ece {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=308, .internal_tag=-1}
./dm-1/requeue_list:00000000f9052f35 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=230, .internal_tag=-1}
./dm-1/requeue_list:00000000d1e65437 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=164, .internal_tag=-1}
./dm-1/requeue_list:00000000951952c5 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=163, .internal_tag=-1}
./dm-1/requeue_list:00000000b0a9dca8 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=162, .internal_tag=-1}
./dm-1/requeue_list:000000005df61a73 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=161, .internal_tag=-1}
./dm-1/requeue_list:00000000acc0a4b3 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=160, .internal_tag=-1}
./dm-1/requeue_list:00000000f9176eee {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=159, .internal_tag=-1}
./dm-1/requeue_list:00000000d13fba74 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=158, .internal_tag=-1}
./dm-1/requeue_list:0000000019bf1c4f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=157, .internal_tag=-1}
./dm-1/requeue_list:000000000f05f937 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=156, .internal_tag=-1}
./dm-1/requeue_list:000000002a6b6a1c {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=144, .internal_tag=-1}
./dm-1/requeue_list:00000000991f77d2 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=122, .internal_tag=-1}
./dm-1/requeue_list:00000000677cb640 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=121, .internal_tag=-1}
./dm-1/requeue_list:00000000e112df39 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=118, .internal_tag=-1}
./dm-1/requeue_list:00000000385e2964 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=114, .internal_tag=-1}
./dm-1/requeue_list:00000000d50c02cc {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=113, .internal_tag=-1}
./dm-1/requeue_list:00000000007c5b65 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=112, .internal_tag=-1}
./dm-1/requeue_list:00000000428a438f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=105, .internal_tag=-1}
./dm-1/requeue_list:0000000067daf7cb {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=104, .internal_tag=-1}
./dm-1/requeue_list:00000000596c1a75 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=103, .internal_tag=-1}
./dm-1/requeue_list:0000000074a99bbc {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=102, .internal_tag=-1}
./dm-1/requeue_list:00000000a8af499c {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=101, .internal_tag=-1}
./dm-1/requeue_list:00000000accecc34 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=94, .internal_tag=-1}
./dm-1/requeue_list:00000000ffb863ee {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=87, .internal_tag=-1}
./dm-1/requeue_list:00000000fb3ace04 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=82, .internal_tag=-1}
./dm-1/requeue_list:000000009e837963 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=79, .internal_tag=-1}
./dm-1/requeue_list:000000009daf5f61 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=125, .internal_tag=-1}
./dm-1/requeue_list:000000005d4965b7 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=124, .internal_tag=-1}
./dm-1/requeue_list:000000007e428b2f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=65, .internal_tag=-1}
./dm-1/requeue_list:000000000321fb70 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=64, .internal_tag=-1}
./dm-1/requeue_list:00000000e3147355 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=127, .internal_tag=-1}
./dm-1/requeue_list:00000000cf317111 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=155, .internal_tag=-1}
./dm-1/requeue_list:00000000ac505131 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=145, .internal_tag=-1}
./dm-1/requeue_list:00000000605f0cac {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=111, .internal_tag=-1}
./dm-1/requeue_list:000000009358fac4 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=100, .internal_tag=-1}
./dm-1/requeue_list:000000003d162add {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=99, .internal_tag=-1}
./dm-1/requeue_list:00000000363ba8c2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=96, .internal_tag=-1}
./dm-1/requeue_list:00000000f7579dcd {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=95, .internal_tag=-1}
./dm-1/requeue_list:00000000ae4f3a57 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=92, .internal_tag=-1}
./dm-1/requeue_list:00000000b4c011e4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=69, .internal_tag=-1}
./dm-1/requeue_list:000000003c753eaf {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=120, .internal_tag=-1}
./dm-1/requeue_list:000000008809d0a9 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=119, .internal_tag=-1}
./dm-1/requeue_list:00000000e078a5fc {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=117, .internal_tag=-1}
./dm-1/requeue_list:00000000b36ce955 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=116, .internal_tag=-1}
./dm-1/requeue_list:00000000394d30e0 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=115, .internal_tag=-1}
./dm-1/requeue_list:000000007420f4c6 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=109, .internal_tag=-1}
./dm-1/requeue_list:000000006b78eed4 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=107, .internal_tag=-1}
./dm-1/requeue_list:00000000a7c4fbd1 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=106, .internal_tag=-1}
./dm-1/requeue_list:000000007d1df8d8 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=234, .internal_tag=-1}
./dm-1/requeue_list:000000000b2f935e {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=278, .internal_tag=-1}
./dm-1/requeue_list:00000000f5ad3c6d {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=277, .internal_tag=-1}
./dm-1/requeue_list:00000000d1bb1f49 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=276, .internal_tag=-1}
./dm-1/requeue_list:000000005be1f0a7 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=275, .internal_tag=-1}
./dm-1/requeue_list:00000000851b2f0c {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=274, .internal_tag=-1}
./dm-1/requeue_list:000000008518fd64 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=273, .internal_tag=-1}
./dm-1/requeue_list:00000000587d2d61 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=272, .internal_tag=-1}
./dm-1/requeue_list:00000000c74f2031 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=271, .internal_tag=-1}
./dm-1/requeue_list:000000000a546b4a {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=270, .internal_tag=-1}
./dm-1/requeue_list:00000000806d08cd {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=269, .internal_tag=-1}
./dm-1/requeue_list:00000000f7c1c1b2 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=268, .internal_tag=-1}
./dm-1/requeue_list:000000004c9d4bd7 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=267, .internal_tag=-1}
./dm-1/requeue_list:0000000042556255 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=266, .internal_tag=-1}
./dm-1/requeue_list:00000000e4359a82 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=265, .internal_tag=-1}
./dm-1/requeue_list:0000000023d93ca9 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=264, .internal_tag=-1}
./dm-1/requeue_list:0000000068333347 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=263, .internal_tag=-1}
./dm-1/requeue_list:000000007f195da1 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=262, .internal_tag=-1}
./dm-1/requeue_list:00000000482c26ff {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=261, .internal_tag=-1}
./dm-1/requeue_list:00000000a071eb97 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=260, .internal_tag=-1}
./dm-1/requeue_list:0000000027b13252 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=259, .internal_tag=-1}
./dm-1/requeue_list:00000000287391fc {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=258, .internal_tag=-1}
./dm-1/requeue_list:00000000b9f7e842 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=257, .internal_tag=-1}
./dm-1/requeue_list:00000000a11344ff {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=256, .internal_tag=-1}
./dm-1/requeue_list:0000000064bd49bc {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=217, .internal_tag=-1}
./dm-1/requeue_list:000000001624645c {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=215, .internal_tag=-1}
./dm-1/requeue_list:000000009c613863 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=205, .internal_tag=-1}
./dm-1/requeue_list:00000000b3b521b7 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=204, .internal_tag=-1}
./dm-1/requeue_list:000000007732b6b4 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=201, .internal_tag=-1}
./dm-1/requeue_list:00000000db87d572 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=200, .internal_tag=-1}
./dm-1/requeue_list:00000000e490450b {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=199, .internal_tag=-1}
./dm-1/requeue_list:00000000e19e225b {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=255, .internal_tag=-1}
./dm-1/requeue_list:00000000b3441684 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=254, .internal_tag=-1}
./dm-1/requeue_list:0000000026359d4e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=253, .internal_tag=-1}
./dm-1/requeue_list:00000000c5861c46 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=252, .internal_tag=-1}
./dm-1/requeue_list:000000002736297d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=251, .internal_tag=-1}
./dm-1/requeue_list:00000000cd02a917 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=250, .internal_tag=-1}
./dm-1/requeue_list:000000001d1511c0 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=249, .internal_tag=-1}
./dm-1/requeue_list:00000000a7913746 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=248, .internal_tag=-1}
./dm-1/requeue_list:000000009ac21f7b {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=247, .internal_tag=-1}
./dm-1/requeue_list:00000000cf685977 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=246, .internal_tag=-1}
./dm-1/requeue_list:000000006269666e {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=245, .internal_tag=-1}
./dm-1/requeue_list:00000000c3647eb3 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=244, .internal_tag=-1}
./dm-1/requeue_list:0000000035996353 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=243, .internal_tag=-1}
./dm-1/requeue_list:00000000a7448d6f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=242, .internal_tag=-1}
./dm-1/requeue_list:000000001ee5997b {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=241, .internal_tag=-1}
./dm-1/requeue_list:0000000018361aaa {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=240, .internal_tag=-1}
./dm-1/requeue_list:00000000a417e041 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=239, .internal_tag=-1}
./dm-1/requeue_list:0000000038e6e739 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=235, .internal_tag=-1}
./dm-1/requeue_list:00000000f8504861 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=140, .internal_tag=-1}
./dm-1/requeue_list:0000000062e77d99 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=139, .internal_tag=-1}
./dm-1/requeue_list:0000000010014b38 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=129, .internal_tag=-1}
./dm-1/requeue_list:00000000d9ee9c7f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=166, .internal_tag=-1}
./dm-1/requeue_list:00000000d2923654 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=223, .internal_tag=-1}
./dm-1/requeue_list:000000005dc003e3 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=222, .internal_tag=-1}
./dm-1/requeue_list:000000008c09bfd0 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=221, .internal_tag=-1}
./dm-1/requeue_list:00000000023de805 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=220, .internal_tag=-1}
./dm-1/requeue_list:000000005641e0ab {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=219, .internal_tag=-1}
./dm-1/requeue_list:00000000e3d5f7c1 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=218, .internal_tag=-1}
./dm-1/requeue_list:0000000056ce8a19 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=214, .internal_tag=-1}
./dm-1/requeue_list:00000000b791c6de {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=213, .internal_tag=-1}
./dm-1/requeue_list:0000000093122509 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=212, .internal_tag=-1}
./dm-1/requeue_list:000000009f27f8ed {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=211, .internal_tag=-1}
./dm-1/requeue_list:000000007193a5ef {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=210, .internal_tag=-1}
./dm-1/requeue_list:0000000001ddcf09 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=207, .internal_tag=-1}
./dm-1/requeue_list:00000000864dc961 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=206, .internal_tag=-1}
./dm-1/requeue_list:000000007978be75 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=203, .internal_tag=-1}
./dm-1/requeue_list:00000000428713c4 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=202, .internal_tag=-1}
./dm-1/requeue_list:000000008c90b400 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=198, .internal_tag=-1}
./dm-1/requeue_list:00000000e5a59e27 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=190, .internal_tag=-1}
./dm-1/requeue_list:000000004ad4bbc6 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=189, .internal_tag=-1}
./dm-1/requeue_list:000000000d5239fa {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=188, .internal_tag=-1}
./dm-1/requeue_list:00000000daf4bd29 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=186, .internal_tag=-1}
./dm-1/requeue_list:00000000363a4a0a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=176, .internal_tag=-1}
./dm-1/requeue_list:0000000099afb393 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=142, .internal_tag=-1}
./dm-1/requeue_list:00000000fd7708c4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=73, .internal_tag=-1}
./dm-1/requeue_list:00000000e61a5be2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=143, .internal_tag=-1}
./dm-1/requeue_list:00000000c4c0f1d9 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=98, .internal_tag=-1}
./dm-1/requeue_list:00000000b53f9ba2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=146, .internal_tag=-1}
./dm-1/requeue_list:00000000a5ae4844 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=72, .internal_tag=-1}
./dm-1/requeue_list:00000000d47b3ea3 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=71, .internal_tag=-1}
./dm-1/requeue_list:0000000009cbde41 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=70, .internal_tag=-1}
./dm-1/requeue_list:00000000bb323f4e {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=175, .internal_tag=-1}
./dm-1/requeue_list:00000000668ca216 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=154, .internal_tag=-1}
./dm-1/requeue_list:00000000c396e191 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=153, .internal_tag=-1}
./dm-1/requeue_list:000000006438cc3e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=152, .internal_tag=-1}
./dm-1/requeue_list:000000007f09d95d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=151, .internal_tag=-1}
./dm-1/requeue_list:0000000086cff3e9 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=150, .internal_tag=-1}
./dm-1/requeue_list:00000000169522f9 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=149, .internal_tag=-1}
./dm-1/requeue_list:000000008264a2a5 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=148, .internal_tag=-1}
./dm-1/requeue_list:000000005f0696d4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=147, .internal_tag=-1}
./dm-1/requeue_list:00000000b7aaa3ab {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=141, .internal_tag=-1}
./dm-1/requeue_list:0000000091941a03 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=138, .internal_tag=-1}
./dm-1/requeue_list:000000005e7b1d10 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=137, .internal_tag=-1}
./dm-1/requeue_list:00000000d59f5cfa {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=136, .internal_tag=-1}
./dm-1/requeue_list:0000000049155154 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=135, .internal_tag=-1}
./dm-1/requeue_list:000000005b8bb508 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=134, .internal_tag=-1}
./dm-1/requeue_list:00000000ae289928 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=133, .internal_tag=-1}
./dm-1/requeue_list:0000000008973922 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=132, .internal_tag=-1}
./dm-1/requeue_list:000000006607fb79 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=131, .internal_tag=-1}
./dm-1/requeue_list:00000000a09d17f8 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=130, .internal_tag=-1}
./dm-1/requeue_list:000000008497185e {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=128, .internal_tag=-1}
./dm-1/requeue_list:000000005375c09a {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=90, .internal_tag=-1}
./dm-1/requeue_list:0000000017bf8269 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=89, .internal_tag=-1}
./dm-1/requeue_list:0000000079d89116 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=88, .internal_tag=-1}
./dm-1/requeue_list:00000000095fae1a {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=85, .internal_tag=-1}
./dm-1/requeue_list:00000000ec713378 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=81, .internal_tag=-1}
./dm-1/requeue_list:0000000005585744 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=80, .internal_tag=-1}
./dm-1/requeue_list:0000000083bb8597 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=78, .internal_tag=-1}
./dm-1/requeue_list:000000003b1c7802 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=77, .internal_tag=-1}
./dm-1/requeue_list:00000000f5373b7f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=76, .internal_tag=-1}
./dm-1/requeue_list:00000000513ca3f9 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=75, .internal_tag=-1}
./dm-1/requeue_list:00000000bf5ebe1d {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=74, .internal_tag=-1}
./dm-1/requeue_list:000000009a396d33 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=110, .internal_tag=-1}
./dm-1/requeue_list:00000000b584af4f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=108, .internal_tag=-1}
./dm-1/requeue_list:0000000086b063ef {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=97, .internal_tag=-1}
./dm-1/requeue_list:0000000041725dda {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=93, .internal_tag=-1}
./dm-1/requeue_list:00000000389b6005 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=91, .internal_tag=-1}
./dm-1/requeue_list:00000000765e0984 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1154, .internal_tag=-1}
./dm-1/requeue_list:0000000020e086a0 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1151, .internal_tag=-1}
./dm-1/requeue_list:0000000097d113bb {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1132, .internal_tag=-1}
./dm-1/requeue_list:0000000040e74b91 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1130, .internal_tag=-1}
./dm-1/requeue_list:000000000202c980 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1113, .internal_tag=-1}
./dm-1/requeue_list:00000000ad2c1033 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1103, .internal_tag=-1}
./dm-1/requeue_list:00000000a80a19bc {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1102, .internal_tag=-1}
./dm-1/requeue_list:0000000057248ec9 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1101, .internal_tag=-1}
./dm-1/requeue_list:000000000050e9b5 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1049, .internal_tag=-1}
./dm-1/requeue_list:00000000edfcc058 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1048, .internal_tag=-1}
./dm-1/requeue_list:00000000d6d5ac7d {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1044, .internal_tag=-1}
./dm-1/requeue_list:0000000054ef917a {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1042, .internal_tag=-1}
./dm-1/requeue_list:0000000047630c6e {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1041, .internal_tag=-1}
./dm-1/requeue_list:00000000f006b0fe {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1037, .internal_tag=-1}
./dm-1/requeue_list:00000000b8b91c99 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1073, .internal_tag=-1}
./dm-1/requeue_list:000000002ac98202 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1072, .internal_tag=-1}
./dm-1/requeue_list:00000000ab4ba359 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1071, .internal_tag=-1}
./dm-1/requeue_list:00000000af593797 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1054, .internal_tag=-1}
./dm-1/requeue_list:00000000b1068a59 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1053, .internal_tag=-1}
./dm-1/requeue_list:000000006a97f42d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=197, .internal_tag=-1}
./dm-1/requeue_list:00000000dd451a36 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=86, .internal_tag=-1}
./dm-1/requeue_list:000000007ce0920a {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=84, .internal_tag=-1}
./dm-1/requeue_list:0000000083945ce2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=208, .internal_tag=-1}
./dm-1/requeue_list:00000000b885ea82 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=209, .internal_tag=-1}
./dm-1/requeue_list:0000000013c9d1a6 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=216, .internal_tag=-1}
./dm-1/requeue_list:00000000db3df23a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=224, .internal_tag=-1}
./dm-1/requeue_list:000000008bacf5f6 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=225, .internal_tag=-1}
./dm-1/requeue_list:00000000f468967e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=226, .internal_tag=-1}
./dm-1/requeue_list:000000007cf987dc {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=227, .internal_tag=-1}
./dm-1/requeue_list:0000000082d34d6b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=228, .internal_tag=-1}
./dm-1/requeue_list:000000001ad0f4ca {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=294, .internal_tag=-1}
./dm-1/requeue_list:0000000079e37b86 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=178, .internal_tag=-1}
./dm-1/requeue_list:00000000f45c1261 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=177, .internal_tag=-1}
./dm-1/requeue_list:0000000094d4a4fa {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=174, .internal_tag=-1}
./dm-1/requeue_list:00000000a5af45ec {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=173, .internal_tag=-1}
./dm-1/requeue_list:00000000c48ac893 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=172, .internal_tag=-1}
./dm-1/requeue_list:000000001678d9ab {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=171, .internal_tag=-1}
./dm-1/requeue_list:0000000099417535 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=170, .internal_tag=-1}
./dm-1/requeue_list:000000006fa9da34 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=169, .internal_tag=-1}
./dm-1/requeue_list:00000000b849d912 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=168, .internal_tag=-1}
./dm-1/requeue_list:00000000779f1cb4 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=167, .internal_tag=-1}
./dm-1/requeue_list:000000003c549d54 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=165, .internal_tag=-1}
./dm-1/requeue_list:00000000572c4c78 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=123, .internal_tag=-1}
./dm-1/requeue_list:00000000b818626f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=296, .internal_tag=-1}
./dm-1/requeue_list:00000000774bd8a9 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=295, .internal_tag=-1}
./dm-1/requeue_list:000000004ddb1111 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=179, .internal_tag=-1}
./dm-1/requeue_list:00000000555582d6 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=180, .internal_tag=-1}
./dm-1/requeue_list:0000000058f49730 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=181, .internal_tag=-1}
./dm-1/requeue_list:00000000528c74cf {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=182, .internal_tag=-1}
./dm-1/requeue_list:00000000fbb41b27 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=301, .internal_tag=-1}
./dm-1/requeue_list:000000004abf6c43 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=300, .internal_tag=-1}
./dm-1/requeue_list:00000000a71c06d1 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=299, .internal_tag=-1}
./dm-1/requeue_list:00000000792775c2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=298, .internal_tag=-1}
./dm-1/requeue_list:00000000c3affeeb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=297, .internal_tag=-1}
./dm-1/requeue_list:0000000027e6df19 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=191, .internal_tag=-1}
./dm-1/requeue_list:00000000411bebdc {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=187, .internal_tag=-1}
./dm-1/requeue_list:000000003e98585a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=185, .internal_tag=-1}
./dm-1/requeue_list:00000000a79847da {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=184, .internal_tag=-1}
./dm-1/requeue_list:000000004347033b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=183, .internal_tag=-1}
./dm-1/requeue_list:00000000cbce775d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=302, .internal_tag=-1}
./dm-1/requeue_list:000000008f8b94ad {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=306, .internal_tag=-1}
./dm-1/requeue_list:00000000003fdea5 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=305, .internal_tag=-1}
./dm-1/requeue_list:000000006f36ffea {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=304, .internal_tag=-1}
./dm-1/requeue_list:000000001f93fdef {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=303, .internal_tag=-1}
./dm-1/requeue_list:000000005c628050 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=307, .internal_tag=-1}
./dm-1/requeue_list:00000000c04aae2f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=83, .internal_tag=-1}
./dm-1/requeue_list:00000000a973f43c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=283, .internal_tag=-1}
./dm-1/requeue_list:00000000c7085f69 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=284, .internal_tag=-1}
./dm-1/requeue_list:000000003c51c086 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=285, .internal_tag=-1}
./dm-1/requeue_list:000000009324dbbb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=286, .internal_tag=-1}
./dm-1/requeue_list:000000004166d3e8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=287, .internal_tag=-1}
./dm-1/requeue_list:000000009fdfea72 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=229, .internal_tag=-1}
./dm-1/requeue_list:000000009e3e07c1 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=236, .internal_tag=-1}
./dm-1/requeue_list:00000000df653c05 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=233, .internal_tag=-1}
./dm-1/requeue_list:0000000057cb71a0 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=232, .internal_tag=-1}
./dm-1/requeue_list:000000003dfa7778 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=231, .internal_tag=-1}
./dm-1/requeue_list:000000000376788a {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=67, .internal_tag=-1}
./dm-1/requeue_list:00000000760a8e8d {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=66, .internal_tag=-1}
./dm-1/requeue_list:0000000045284dd4 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=126, .internal_tag=-1}
./dm-1/requeue_list:00000000754bfff1 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=293, .internal_tag=-1}
./dm-1/requeue_list:000000004490f26d {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=292, .internal_tag=-1}
./dm-1/requeue_list:0000000055e4da62 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=291, .internal_tag=-1}
./dm-1/requeue_list:0000000058d167c3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=290, .internal_tag=-1}
./dm-1/requeue_list:000000003537888a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=289, .internal_tag=-1}
./dm-1/requeue_list:000000001e889110 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=288, .internal_tag=-1}
./dm-1/requeue_list:000000001237a66e {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=68, .internal_tag=-1}
./dm-1/requeue_list:000000007b9cacb5 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=196, .internal_tag=-1}
./dm-1/requeue_list:00000000d041643d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=279, .internal_tag=-1}
./dm-1/requeue_list:000000002a9ec25a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=237, .internal_tag=-1}
./dm-1/requeue_list:000000002d63f4da {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=280, .internal_tag=-1}
./dm-1/requeue_list:0000000013b5dc05 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=282, .internal_tag=-1}
./dm-1/requeue_list:00000000e5f1a5f0 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=281, .internal_tag=-1}
./dm-1/requeue_list:000000002774ded0 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=193, .internal_tag=-1}
./dm-1/requeue_list:00000000db98f435 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=194, .internal_tag=-1}
./dm-1/requeue_list:00000000ebd8d1b2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=192, .internal_tag=-1}
./dm-1/requeue_list:00000000ba52b672 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=195, .internal_tag=-1}
./dm-1/requeue_list:000000000e0e0221 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=238, .internal_tag=-1}
./dm-1/requeue_list:000000007c97db14 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=390, .internal_tag=-1}
./dm-1/requeue_list:0000000026c15870 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=391, .internal_tag=-1}
./dm-1/requeue_list:0000000015b01dd9 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=398, .internal_tag=-1}
./dm-1/requeue_list:000000009f3ea9f7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=397, .internal_tag=-1}
./dm-1/requeue_list:00000000be6c7484 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=396, .internal_tag=-1}
./dm-1/requeue_list:00000000901e4efc {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=395, .internal_tag=-1}
./dm-1/requeue_list:00000000107809fa {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=394, .internal_tag=-1}
./dm-1/requeue_list:00000000935343d9 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=393, .internal_tag=-1}
./dm-1/requeue_list:00000000acdec264 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=392, .internal_tag=-1}
./dm-1/requeue_list:000000001567491b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=399, .internal_tag=-1}
./dm-1/requeue_list:00000000dd55f961 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=400, .internal_tag=-1}
./dm-1/requeue_list:000000009fac5d84 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=401, .internal_tag=-1}
./dm-1/requeue_list:00000000e2e5ab27 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=402, .internal_tag=-1}
./dm-1/requeue_list:00000000bc43b41d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=404, .internal_tag=-1}
./dm-1/requeue_list:00000000d6ba1a53 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=403, .internal_tag=-1}
./dm-1/requeue_list:000000009e0c496c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=405, .internal_tag=-1}
./dm-1/requeue_list:000000000d4b10eb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=406, .internal_tag=-1}
./dm-1/requeue_list:00000000c37d58cb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=407, .internal_tag=-1}
./dm-1/requeue_list:000000003b0ff8a3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=408, .internal_tag=-1}
./dm-1/requeue_list:000000009ca3833c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=409, .internal_tag=-1}
./dm-1/requeue_list:00000000dba79c06 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=410, .internal_tag=-1}
./dm-1/requeue_list:00000000adca7564 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=411, .internal_tag=-1}
./dm-1/requeue_list:00000000d677e3cb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=412, .internal_tag=-1}
./dm-1/requeue_list:000000002a0765ca {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=413, .internal_tag=-1}
./dm-1/requeue_list:0000000098db96c0 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=414, .internal_tag=-1}
./dm-1/requeue_list:000000007771e73a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=415, .internal_tag=-1}
./dm-1/requeue_list:00000000d7ed49c3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=416, .internal_tag=-1}
./dm-1/requeue_list:0000000036414f1c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=417, .internal_tag=-1}
./dm-1/requeue_list:00000000615e7694 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=418, .internal_tag=-1}
./dm-1/requeue_list:00000000471a03ad {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=430, .internal_tag=-1}
./dm-1/requeue_list:00000000124f79fc {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1465, .internal_tag=-1}
./dm-1/requeue_list:000000000f27a8cc {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1456, .internal_tag=-1}
./dm-1/requeue_list:00000000423bcc11 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1455, .internal_tag=-1}
./dm-1/requeue_list:000000007890ac91 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1587, .internal_tag=-1}
./dm-1/requeue_list:000000001e65f647 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1581, .internal_tag=-1}
./dm-1/requeue_list:00000000e6c3036f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1580, .internal_tag=-1}
./dm-1/requeue_list:00000000a3dd15c5 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1579, .internal_tag=-1}
./dm-1/requeue_list:00000000924f8bd1 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1578, .internal_tag=-1}
./dm-1/requeue_list:0000000038a775fe {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1577, .internal_tag=-1}
./dm-1/requeue_list:00000000d80a7f1d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1576, .internal_tag=-1}
./dm-1/requeue_list:000000007089df4e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1575, .internal_tag=-1}
./dm-1/requeue_list:0000000096065909 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1574, .internal_tag=-1}
./dm-1/requeue_list:000000002f2a4d35 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1573, .internal_tag=-1}
./dm-1/requeue_list:0000000080736b2b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1572, .internal_tag=-1}
./dm-1/requeue_list:00000000cf56ed22 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1571, .internal_tag=-1}
./dm-1/requeue_list:0000000073ccf806 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1570, .internal_tag=-1}
./dm-1/requeue_list:00000000986cbcda {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1513, .internal_tag=-1}
./dm-1/requeue_list:000000004ec86e86 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1509, .internal_tag=-1}
./dm-1/requeue_list:00000000ab733d0b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1512, .internal_tag=-1}
./dm-1/requeue_list:00000000dcdb6e2e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1524, .internal_tag=-1}
./dm-1/requeue_list:00000000662da458 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1519, .internal_tag=-1}
./dm-1/requeue_list:0000000050217bac {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1518, .internal_tag=-1}
./dm-1/requeue_list:000000006a820c2b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1514, .internal_tag=-1}
./dm-1/requeue_list:0000000068e95376 {.op=WRITE, .cmd_flags=SYNC|META|PRIO, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1423, .internal_tag=-1}
./dm-1/requeue_list:00000000749ef62b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1430, .internal_tag=-1}
./dm-1/requeue_list:0000000005f171c8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1429, .internal_tag=-1}
./dm-1/requeue_list:000000004579117f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1428, .internal_tag=-1}
./dm-1/requeue_list:00000000b8083b44 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1427, .internal_tag=-1}
./dm-1/requeue_list:000000003e3dabc6 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1476, .internal_tag=-1}
./dm-1/requeue_list:00000000b2799165 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1475, .internal_tag=-1}
./dm-1/requeue_list:00000000ad0ca8e4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1474, .internal_tag=-1}
./dm-1/requeue_list:00000000f3996b16 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1422, .internal_tag=-1}
./dm-1/requeue_list:000000006101f271 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1417, .internal_tag=-1}
./dm-1/requeue_list:00000000f65fdd7e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1415, .internal_tag=-1}
./dm-1/requeue_list:0000000071d7adab {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1413, .internal_tag=-1}
./dm-1/requeue_list:000000004d22cd48 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1410, .internal_tag=-1}
./dm-1/requeue_list:000000009eded369 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1409, .internal_tag=-1}
./dm-1/requeue_list:000000002abaaa34 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1471, .internal_tag=-1}
./dm-1/requeue_list:00000000598d61e8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1470, .internal_tag=-1}
./dm-1/requeue_list:0000000002f2123f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1355, .internal_tag=-1}
./dm-1/requeue_list:00000000b4909813 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1354, .internal_tag=-1}
./dm-1/requeue_list:00000000c56b4b04 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1353, .internal_tag=-1}
./dm-1/requeue_list:00000000545eab7b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1352, .internal_tag=-1}
./dm-1/requeue_list:00000000c0706848 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1351, .internal_tag=-1}
./dm-1/requeue_list:000000003e9063cf {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1407, .internal_tag=-1}
./dm-1/requeue_list:000000004f739921 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1406, .internal_tag=-1}
./dm-1/requeue_list:00000000ab4e5ae5 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1405, .internal_tag=-1}
./dm-1/requeue_list:00000000e4e943bf {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1404, .internal_tag=-1}
./dm-1/requeue_list:0000000090e06892 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1403, .internal_tag=-1}
./dm-1/requeue_list:000000001c25bdf2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1402, .internal_tag=-1}
./dm-1/requeue_list:00000000718f8212 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1361, .internal_tag=-1}
./dm-1/requeue_list:0000000070718b6c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1358, .internal_tag=-1}
./dm-1/requeue_list:000000009e78c6af {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1357, .internal_tag=-1}
./dm-1/requeue_list:000000009d3d08b3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1356, .internal_tag=-1}
./dm-1/requeue_list:0000000091d4a25f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1421, .internal_tag=-1}
./dm-1/requeue_list:00000000c1342b44 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1424, .internal_tag=-1}
./dm-1/requeue_list:00000000ca75b188 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1434, .internal_tag=-1}
./dm-1/requeue_list:00000000fb5d5668 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1433, .internal_tag=-1}
./dm-1/requeue_list:000000005491682c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1432, .internal_tag=-1}
./dm-1/requeue_list:000000001199a4ee {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1431, .internal_tag=-1}
./dm-1/requeue_list:00000000b2d600f0 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1426, .internal_tag=-1}
./dm-1/requeue_list:00000000e7f70c9f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1425, .internal_tag=-1}
./dm-1/requeue_list:0000000076a654e8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1435, .internal_tag=-1}
./dm-1/requeue_list:00000000c4fe6f57 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1436, .internal_tag=-1}
./dm-1/requeue_list:00000000da089a2d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1437, .internal_tag=-1}
./dm-1/requeue_list:0000000027771b9e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1438, .internal_tag=-1}
./dm-1/requeue_list:00000000f77ab302 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1441, .internal_tag=-1}
./dm-1/requeue_list:000000006a5ab338 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1440, .internal_tag=-1}
./dm-1/requeue_list:00000000b6e36a6d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1439, .internal_tag=-1}
./dm-1/requeue_list:00000000de4e01db {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1442, .internal_tag=-1}
./dm-1/requeue_list:00000000dea8ac4b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1443, .internal_tag=-1}
./dm-1/requeue_list:00000000d9502e35 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1444, .internal_tag=-1}
./dm-1/requeue_list:000000009a06d60b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1445, .internal_tag=-1}
./dm-1/requeue_list:00000000899b5061 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1446, .internal_tag=-1}
./dm-1/requeue_list:00000000acaa10ed {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1447, .internal_tag=-1}
./dm-1/requeue_list:00000000ab3e410f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1448, .internal_tag=-1}
./dm-1/requeue_list:00000000405007b4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1449, .internal_tag=-1}
./dm-1/requeue_list:000000008f7b82db {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1450, .internal_tag=-1}
./dm-1/requeue_list:00000000b2eced88 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1451, .internal_tag=-1}
./dm-1/requeue_list:00000000c85fca8b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1452, .internal_tag=-1}
./dm-1/requeue_list:0000000027d73517 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1453, .internal_tag=-1}
./dm-1/requeue_list:00000000bcb38c12 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1454, .internal_tag=-1}
./dm-1/requeue_list:00000000655f7d05 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1464, .internal_tag=-1}
./dm-1/requeue_list:000000002626c564 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1463, .internal_tag=-1}
./dm-1/requeue_list:000000004430d063 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1462, .internal_tag=-1}
./dm-1/requeue_list:00000000cd16cf4b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1461, .internal_tag=-1}
./dm-1/requeue_list:00000000bc90b769 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1460, .internal_tag=-1}
./dm-1/requeue_list:00000000a18cfb0a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1459, .internal_tag=-1}
./dm-1/requeue_list:000000007c80da85 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1458, .internal_tag=-1}
./dm-1/requeue_list:000000007e94e264 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1457, .internal_tag=-1}
./dm-1/requeue_list:0000000024f23df7 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1171, .internal_tag=-1}
./dm-1/requeue_list:00000000a1b9e111 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1172, .internal_tag=-1}
./dm-1/requeue_list:000000000479d39e {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1173, .internal_tag=-1}
./dm-1/requeue_list:0000000060ae7828 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1175, .internal_tag=-1}
./dm-1/requeue_list:00000000db04464f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1174, .internal_tag=-1}
./dm-1/requeue_list:000000001fe4ffa8 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1176, .internal_tag=-1}
./dm-1/requeue_list:00000000827aeafa {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1177, .internal_tag=-1}
./dm-1/requeue_list:00000000eed2e373 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1178, .internal_tag=-1}
./dm-1/requeue_list:00000000e19c274f {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1179, .internal_tag=-1}
./dm-1/requeue_list:00000000a5bfd83c {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1180, .internal_tag=-1}
./dm-1/requeue_list:0000000027aa8f86 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1181, .internal_tag=-1}
./dm-1/requeue_list:00000000199f7932 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1182, .internal_tag=-1}
./dm-1/requeue_list:0000000098e4045e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1052, .internal_tag=-1}
./dm-1/requeue_list:000000006e6f5c75 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1055, .internal_tag=-1}
./dm-1/requeue_list:000000006e64fda2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1056, .internal_tag=-1}
./dm-1/requeue_list:000000004872ccd8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1057, .internal_tag=-1}
./dm-1/requeue_list:00000000e78d0c9d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1058, .internal_tag=-1}
./dm-1/requeue_list:00000000ed2c12ec {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1062, .internal_tag=-1}
./dm-1/requeue_list:00000000dabb62b5 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1061, .internal_tag=-1}
./dm-1/requeue_list:0000000048c8b956 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1060, .internal_tag=-1}
./dm-1/requeue_list:000000009a61ccbb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1051, .internal_tag=-1}
./dm-1/requeue_list:00000000c7ce743c {.op=WRITE, .cmd_flags=SYNC|META|PRIO, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=716, .internal_tag=-1}
./dm-1/requeue_list:00000000fc9b48a0 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=705, .internal_tag=-1}
./dm-1/requeue_list:000000009ac4ed01 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=704, .internal_tag=-1}
./dm-1/requeue_list:00000000647cef59 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=759, .internal_tag=-1}
./dm-1/requeue_list:0000000083cb0792 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=739, .internal_tag=-1}
./dm-1/requeue_list:0000000035f54d10 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1169, .internal_tag=-1}
./dm-1/requeue_list:000000008d46b2ed {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=736, .internal_tag=-1}
./dm-1/requeue_list:000000006fe078b8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1093, .internal_tag=-1}
./dm-1/requeue_list:00000000a02919b6 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1092, .internal_tag=-1}
./dm-1/requeue_list:00000000444ad022 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1091, .internal_tag=-1}
./dm-1/requeue_list:000000001122a253 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1149, .internal_tag=-1}
./dm-1/requeue_list:000000006973eb70 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1148, .internal_tag=-1}
./dm-1/requeue_list:000000006d57a376 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1133, .internal_tag=-1}
./dm-1/requeue_list:000000002e348e2e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1127, .internal_tag=-1}
./dm-1/requeue_list:00000000679e4e86 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1094, .internal_tag=-1}
./dm-1/requeue_list:00000000d232c516 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1090, .internal_tag=-1}
./dm-1/requeue_list:00000000fd863343 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1089, .internal_tag=-1}
./dm-1/requeue_list:00000000aaaf6a2a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1150, .internal_tag=-1}
./dm-1/requeue_list:00000000866146fd {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1109, .internal_tag=-1}
./dm-1/requeue_list:0000000025725fe7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1106, .internal_tag=-1}
./dm-1/requeue_list:0000000072b86fcc {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1110, .internal_tag=-1}
./dm-1/requeue_list:0000000009f37d86 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1195, .internal_tag=-1}
./dm-1/requeue_list:00000000b8f02db2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1252, .internal_tag=-1}
./dm-1/requeue_list:00000000a3437079 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1145, .internal_tag=-1}
./dm-1/requeue_list:00000000fa494168 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1183, .internal_tag=-1}
./dm-1/requeue_list:000000002294a2a1 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1144, .internal_tag=-1}
./dm-1/requeue_list:000000006e0a079d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1143, .internal_tag=-1}
./dm-1/requeue_list:00000000aa8f1cfb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1168, .internal_tag=-1}
./dm-1/requeue_list:000000004ab09b84 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1108, .internal_tag=-1}
./dm-1/requeue_list:000000002a892bbf {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1107, .internal_tag=-1}
./dm-1/requeue_list:00000000256a9a98 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1140, .internal_tag=-1}
./dm-1/requeue_list:000000002c6c99ac {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1258, .internal_tag=-1}
./dm-1/requeue_list:000000005dd288e4 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1257, .internal_tag=-1}
./dm-1/requeue_list:000000000300e969 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1256, .internal_tag=-1}
./dm-1/requeue_list:00000000e047ea5c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1255, .internal_tag=-1}
./dm-1/requeue_list:000000004849f3a9 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1254, .internal_tag=-1}
./dm-1/requeue_list:00000000c4e76d75 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1251, .internal_tag=-1}
./dm-1/requeue_list:000000004ec78e55 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1249, .internal_tag=-1}
./dm-1/requeue_list:00000000cf35ef48 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1248, .internal_tag=-1}
./dm-1/requeue_list:0000000074ec64ca {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1247, .internal_tag=-1}
./dm-1/requeue_list:000000003363f130 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1246, .internal_tag=-1}
./dm-1/requeue_list:00000000c852637d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1245, .internal_tag=-1}
./dm-1/requeue_list:0000000051dc7ca7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1244, .internal_tag=-1}
./dm-1/requeue_list:00000000aa4eeb7a {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1243, .internal_tag=-1}
./dm-1/requeue_list:000000000d857b27 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1163, .internal_tag=-1}
./dm-1/requeue_list:0000000046fc9f38 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1242, .internal_tag=-1}
./dm-1/requeue_list:00000000292744f7 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1241, .internal_tag=-1}
./dm-1/requeue_list:00000000420b80d3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1240, .internal_tag=-1}
./dm-1/requeue_list:000000005f215bc5 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1239, .internal_tag=-1}
./dm-1/requeue_list:00000000abd30b1c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1238, .internal_tag=-1}
./dm-1/requeue_list:00000000786e96d2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1237, .internal_tag=-1}
./dm-1/requeue_list:00000000d21aafeb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1236, .internal_tag=-1}
./dm-1/requeue_list:0000000090b4130e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1235, .internal_tag=-1}
./dm-1/requeue_list:000000006d6876fe {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1234, .internal_tag=-1}
./dm-1/requeue_list:00000000819e4e5f {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1233, .internal_tag=-1}
./dm-1/requeue_list:0000000047846e21 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1232, .internal_tag=-1}
./dm-1/requeue_list:000000005cb5c653 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1231, .internal_tag=-1}
./dm-1/requeue_list:00000000f4abc237 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1230, .internal_tag=-1}
./dm-1/requeue_list:00000000821cfb59 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1229, .internal_tag=-1}
./dm-1/requeue_list:000000005be9a42d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1228, .internal_tag=-1}
./dm-1/requeue_list:000000005acd4b2c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1227, .internal_tag=-1}
./dm-1/requeue_list:0000000035d7549c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1226, .internal_tag=-1}
./dm-1/requeue_list:0000000041fe2b76 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1225, .internal_tag=-1}
./dm-1/requeue_list:00000000ccc00fbc {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1224, .internal_tag=-1}
./dm-1/requeue_list:000000006ac71233 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1223, .internal_tag=-1}
./dm-1/requeue_list:000000002cae68a6 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1222, .internal_tag=-1}
./dm-1/requeue_list:0000000081ee1aeb {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1221, .internal_tag=-1}
./dm-1/requeue_list:00000000b7c182fd {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1220, .internal_tag=-1}
./dm-1/requeue_list:00000000ce8ddcb3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1219, .internal_tag=-1}
./dm-1/requeue_list:00000000466aaf05 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1218, .internal_tag=-1}
./dm-1/requeue_list:000000009800449e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1217, .internal_tag=-1}
./dm-1/requeue_list:0000000025aba3f3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1216, .internal_tag=-1}
./dm-1/requeue_list:0000000026221bb2 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1215, .internal_tag=-1}
./dm-1/requeue_list:0000000089a5397e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1214, .internal_tag=-1}
./dm-1/requeue_list:0000000054d15823 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1213, .internal_tag=-1}
./dm-1/requeue_list:0000000024aba9ad {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1212, .internal_tag=-1}
./dm-1/requeue_list:000000007d5acca3 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1211, .internal_tag=-1}
./dm-1/requeue_list:00000000ef07085c {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1210, .internal_tag=-1}
./dm-1/requeue_list:00000000e39df962 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1209, .internal_tag=-1}
./dm-1/requeue_list:00000000f52c77ba {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=719, .internal_tag=-1}
./dm-1/requeue_list:000000002900f524 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1208, .internal_tag=-1}
./dm-1/requeue_list:000000002bcbbcae {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1207, .internal_tag=-1}
./dm-1/requeue_list:00000000febf8423 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1206, .internal_tag=-1}
./dm-1/requeue_list:00000000a3ed26aa {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1205, .internal_tag=-1}
./dm-1/requeue_list:00000000e99e3f4e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1112, .internal_tag=-1}
./dm-1/requeue_list:00000000476f100d {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1036, .internal_tag=-1}
./dm-1/requeue_list:00000000bc4ef51b {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1184, .internal_tag=-1}
./dm-1/requeue_list:000000001f228006 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1097, .internal_tag=-1}
./dm-1/requeue_list:00000000dafd00db {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1028, .internal_tag=-1}
./dm-1/requeue_list:0000000048295d49 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1027, .internal_tag=-1}
./dm-1/requeue_list:000000002f080188 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1026, .internal_tag=-1}
./dm-1/requeue_list:00000000f7a1de79 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1025, .internal_tag=-1}
./dm-1/requeue_list:00000000ccc7a776 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1087, .internal_tag=-1}
./dm-1/requeue_list:00000000e8185c98 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1085, .internal_tag=-1}
./dm-1/requeue_list:000000008fdff25b {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1081, .internal_tag=-1}
./dm-1/requeue_list:000000009e138956 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1059, .internal_tag=-1}
./dm-1/requeue_list:000000005672ab69 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=706, .internal_tag=-1}
./dm-1/requeue_list:000000006455fb62 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=708, .internal_tag=-1}
./dm-1/requeue_list:0000000081411694 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=707, .internal_tag=-1}
./dm-1/requeue_list:00000000886362db {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=710, .internal_tag=-1}
./dm-1/requeue_list:00000000184ea898 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=709, .internal_tag=-1}
./dm-1/requeue_list:000000002a2ae5d3 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1185, .internal_tag=-1}
./dm-1/requeue_list:00000000dd73afa9 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1186, .internal_tag=-1}
./dm-1/requeue_list:0000000031d04fbe {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=718, .internal_tag=-1}
./dm-1/requeue_list:000000004eb92031 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=717, .internal_tag=-1}
./dm-1/requeue_list:00000000187c1dd7 {.op=WRITE, .cmd_flags=SYNC|IDLE, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=1170, .internal_tag=-1}

Bart.



--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Bart Van Assche March 13, 2018, 4:46 p.m. UTC | #8
On Tue, 2018-03-13 at 12:31 -0400, Mike Snitzer wrote:
> But now I cannot get the test to run:
> 
> # srp-test/run_tests -c -d -r 10 -t 02-mq
> Unloaded the ib_srpt kernel module
> Unloaded the rdma_rxe kernel module
> SoftRoCE network interfaces: rxe0 rxe1 rxe2 rxe3
> Zero-initializing /dev/ram0 ... done
> Zero-initializing /dev/ram1 ... done
> Configured SRP target driver
> Running test srp-test/tests/02-mq ...
> Test file I/O on top of multipath concurrently with logout and login (0 min; mq)
> Unloaded the ib_srp kernel module
> /dev/disk/by-id/dm-uuid-mpath-3600140572616d6469736b31000000000: not found
> Test srp-test/tests/02-mq failed
> 
> [  379.634518] ib_srp: QP creation failed for dev rxe1: -22
> [  379.639849] srpt/10.16.43.122: Unsupported SCSI Opcode 0xa3, sending CHECK_CONDITION.
> [  379.665891] sd 7:0:0:1: [sdk] Attached SCSI disk
> [  379.673312] ib_srp: QP creation failed for dev rxe2: -22
> [  379.688331] ib_srp: QP creation failed for dev rxe3: -22
> [  379.708324] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
> [  379.724538] ib_srp: target creation request is missing one or more parameters
> [  379.740253] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
> [  379.756531] ib_srp: target creation request is missing one or more parameters
> [  379.773242] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
> [  379.789532] ib_srp: target creation request is missing one or more parameters
> [  379.805255] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
> [  379.822532] ib_srp: target creation request is missing one or more parameters

That's weird. I will see whether I can reproduce this with linux-next, since I have
not yet tried to run srp-test against linux-next myself.

> But I realized that was with an old srp-test build.. so I tried to make
> again.. seems your buildrequires has expanded:
> 
> Why does it need shellcheck?  On RHEL, having to pull in EPEL packages sucks.

Shellcheck is only required for someone who wants to edit the srp-test scripts and
who wants to verify these scripts with shellcheck. Shellcheck is not needed to run
the srp-test scripts.

Bart.




--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Mike Snitzer March 13, 2018, 4:58 p.m. UTC | #9
On Tue, Mar 13 2018 at 12:46pm -0400,
Bart Van Assche <Bart.VanAssche@wdc.com> wrote:

> On Tue, 2018-03-13 at 12:31 -0400, Mike Snitzer wrote:
> > But now I cannot get the test to run:
> > 
> > # srp-test/run_tests -c -d -r 10 -t 02-mq
> > Unloaded the ib_srpt kernel module
> > Unloaded the rdma_rxe kernel module
> > SoftRoCE network interfaces: rxe0 rxe1 rxe2 rxe3
> > Zero-initializing /dev/ram0 ... done
> > Zero-initializing /dev/ram1 ... done
> > Configured SRP target driver
> > Running test srp-test/tests/02-mq ...
> > Test file I/O on top of multipath concurrently with logout and login (0 min; mq)
> > Unloaded the ib_srp kernel module
> > /dev/disk/by-id/dm-uuid-mpath-3600140572616d6469736b31000000000: not found
> > Test srp-test/tests/02-mq failed
> > 
> > [  379.634518] ib_srp: QP creation failed for dev rxe1: -22
> > [  379.639849] srpt/10.16.43.122: Unsupported SCSI Opcode 0xa3, sending CHECK_CONDITION.
> > [  379.665891] sd 7:0:0:1: [sdk] Attached SCSI disk
> > [  379.673312] ib_srp: QP creation failed for dev rxe2: -22
> > [  379.688331] ib_srp: QP creation failed for dev rxe3: -22
> > [  379.708324] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
> > [  379.724538] ib_srp: target creation request is missing one or more parameters
> > [  379.740253] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
> > [  379.756531] ib_srp: target creation request is missing one or more parameters
> > [  379.773242] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
> > [  379.789532] ib_srp: target creation request is missing one or more parameters
> > [  379.805255] ib_srp: bad dest parameter '[2620:52:0:102f:219:99ff:feb7:2648'
> > [  379.822532] ib_srp: target creation request is missing one or more parameters
> 
> That's weird. I will see whether I can reproduce this with linux-next, since I have
> not yet tried to run srp-test against linux-next myself.

OK, I appreciate it (you'll need to revert thos commits I shared in the
other linux-next thread).

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Mike Snitzer March 13, 2018, 5:02 p.m. UTC | #10
On Tue, Mar 13 2018 at 12:43pm -0400,
Bart Van Assche <Bart.VanAssche@wdc.com> wrote:

> On Mon, 2018-03-12 at 21:23 -0400, Mike Snitzer wrote:
> > Anyway, I'm hopeful I fixed the issue you reported.  Please feel free to
> > test the 2 topmost commits I've staged in linux-next, via dm-4.16:
> > https://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm.git/log/?h=dm-4.16
> 
> So far I haven't seen the crash I reported yesterday in my tests with dm-4.16
> of this morning. But I see hanging dm requests. I did not see any such issue
> yesterday with the revert I posted applied on top of dm-4.16. What I see today
> in the logs is the following:
> 
> INFO: task kworker/3:150:1681 blocked for more than 120 seconds
> 
> and in debugfs:
> # (cd /sys/kernel/debug/block/ && grep -r op= .)
> ./dm-2/requeue_list:00000000df366fff {.op=READ, .cmd_flags=, .rq_flags=SORTED|STARTED|SOFTBARRIER|ELVPRIV|IO_STAT, .state=idle, .tag=-1, .internal_tag=45}
> ./dm-0/requeue_list:000000008302ea45 {.op=READ, .cmd_flags=, .rq_flags=SORTED|STARTED|SOFTBARRIER|ELVPRIV|IO_STAT, .state=idle, .tag=-1, .internal_tag=211}
> ./dm-1/requeue_list:000000007ea8ad0e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=428, .internal_tag=-1}
> ./dm-1/requeue_list:00000000e93ecaa8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=429, .internal_tag=-1}

Strange.. but I'll review closer.  Clearly requests aren't getting
pulled off the request_list

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Mike Snitzer March 13, 2018, 5:07 p.m. UTC | #11
On Tue, Mar 13 2018 at  1:02pm -0400,
Mike Snitzer <snitzer@redhat.com> wrote:

> On Tue, Mar 13 2018 at 12:43pm -0400,
> Bart Van Assche <Bart.VanAssche@wdc.com> wrote:
> 
> > On Mon, 2018-03-12 at 21:23 -0400, Mike Snitzer wrote:
> > > Anyway, I'm hopeful I fixed the issue you reported.  Please feel free to
> > > test the 2 topmost commits I've staged in linux-next, via dm-4.16:
> > > https://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm.git/log/?h=dm-4.16
> > 
> > So far I haven't seen the crash I reported yesterday in my tests with dm-4.16
> > of this morning. But I see hanging dm requests. I did not see any such issue
> > yesterday with the revert I posted applied on top of dm-4.16. What I see today
> > in the logs is the following:
> > 
> > INFO: task kworker/3:150:1681 blocked for more than 120 seconds
> > 
> > and in debugfs:
> > # (cd /sys/kernel/debug/block/ && grep -r op= .)
> > ./dm-2/requeue_list:00000000df366fff {.op=READ, .cmd_flags=, .rq_flags=SORTED|STARTED|SOFTBARRIER|ELVPRIV|IO_STAT, .state=idle, .tag=-1, .internal_tag=45}
> > ./dm-0/requeue_list:000000008302ea45 {.op=READ, .cmd_flags=, .rq_flags=SORTED|STARTED|SOFTBARRIER|ELVPRIV|IO_STAT, .state=idle, .tag=-1, .internal_tag=211}
> > ./dm-1/requeue_list:000000007ea8ad0e {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=428, .internal_tag=-1}
> > ./dm-1/requeue_list:00000000e93ecaa8 {.op=READ, .cmd_flags=, .rq_flags=SOFTBARRIER|IO_STAT, .state=idle, .tag=429, .internal_tag=-1}
> 
> Strange.. but I'll review closer.  Clearly requests aren't getting
> pulled off the request_list

Just a thought: Maybe dm-4.16 (rc4 based) is missing a blk-mq fix?

Might be worth cherry-picking the 2 topmost commits from dm-4.16 into
the linus-based (rc5) tree you reported the original issue against?

(looking at jens' rc5 block pull request, it seems unlikely but...)

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Bart Van Assche March 13, 2018, 5:10 p.m. UTC | #12
On Tue, 2018-03-13 at 13:07 -0400, Mike Snitzer wrote:
> Just a thought: Maybe dm-4.16 (rc4 based) is missing a blk-mq fix?
> 
> Might be worth cherry-picking the 2 topmost commits from dm-4.16 into
> the linus-based (rc5) tree you reported the original issue against?
> 
> (looking at jens' rc5 block pull request, it seems unlikely but...)

Hello Mike,

Even if that would be the case, that can't have been the cause of what I
reported. Before I run any dm tests I merge the block layer, SCSI and RDMA
changes that are scheduled for the next kernel version into the dm tree.

Bart.


--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Mike Snitzer March 13, 2018, 9:41 p.m. UTC | #13
On Tue, Mar 13 2018 at  1:10pm -0400,
Bart Van Assche <Bart.VanAssche@wdc.com> wrote:

> On Tue, 2018-03-13 at 13:07 -0400, Mike Snitzer wrote:
> > Just a thought: Maybe dm-4.16 (rc4 based) is missing a blk-mq fix?
> > 
> > Might be worth cherry-picking the 2 topmost commits from dm-4.16 into
> > the linus-based (rc5) tree you reported the original issue against?
> > 
> > (looking at jens' rc5 block pull request, it seems unlikely but...)
> 
> Hello Mike,
> 
> Even if that would be the case, that can't have been the cause of what I
> reported. Before I run any dm tests I merge the block layer, SCSI and RDMA
> changes that are scheduled for the next kernel version into the dm tree.

Well I've rebased dm-4.16 ontop of v4.15-rc5.  If you udate to latest
dm-4.16 and look at the following diff it is pretty clear that these
changes will not compromise dm-mpath's "mq" mode (which you're using):

git diff 8d47e65948ddea4398892946d9e50778a316b397^..e8f74a0f00113d74ac18d6de13096f9e2f95618a -- drivers/md/dm-mpath.c

I see no reason why you'd hit hangs with requests lingering on the requeue_list

--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Bart Van Assche March 14, 2018, 4:34 p.m. UTC | #14
On Tue, 2018-03-13 at 17:41 -0400, Mike Snitzer wrote:
> On Tue, Mar 13 2018 at  1:10pm -0400,
> Bart Van Assche <Bart.VanAssche@wdc.com> wrote:
> > Even if that would be the case, that can't have been the cause of what I
> > reported. Before I run any dm tests I merge the block layer, SCSI and RDMA
> > changes that are scheduled for the next kernel version into the dm tree.
> 
> Well I've rebased dm-4.16 ontop of v4.15-rc5.  If you udate to latest
> dm-4.16 and look at the following diff it is pretty clear that these
> changes will not compromise dm-mpath's "mq" mode (which you're using):
> 
> git diff 8d47e65948ddea4398892946d9e50778a316b397^..e8f74a0f00113d74ac18d6de13096f9e2f95618a -- drivers/md/dm-mpath.c
> 
> I see no reason why you'd hit hangs with requests lingering on the requeue_list

Hello Mike,

I agree with you that the hanging requests shouldn't be related to the most recent
dm changes. I will try to find some time to root-cause this myself.

Bart.




--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
Bart Van Assche March 30, 2018, 5:04 p.m. UTC | #15
On Tue, 2018-03-13 at 12:31 -0400, Mike Snitzer wrote:
> But now I cannot get the test to run:
> 
> # srp-test/run_tests -c -d -r 10 -t 02-mq
> [ ... ]
> /dev/disk/by-id/dm-uuid-mpath-3600140572616d6469736b31000000000: not found
> Test srp-test/tests/02-mq failed

Hello Mike,

The bug that caused this failure has been fixed and is in linux-next. The
srp-test software runs fine on my setup against linux-next. See also
https://git.kernel.org/pub/scm/linux/kernel/git/rdma/rdma.git/commit/?h=for-next&id=b470c154c600e427592df5237596ce0f33ce7d9f

Bart.





--
dm-devel mailing list
dm-devel@redhat.com
https://www.redhat.com/mailman/listinfo/dm-devel
diff mbox

Patch

==================================================================
BUG: KASAN: null-ptr-deref in __wake_up_common+0x60/0x230
Read of size 8 at addr 0000000000000000 by task kworker/1:1H/155

CPU: 1 PID: 155 Comm: kworker/1:1H Not tainted 4.16.0-rc5-dbg+ #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.0.0-prebuilt.qemu-project.org 04/01/2014
Workqueue: kblockd blk_mq_run_work_fn
Call Trace:
 dump_stack+0x85/0xc7
 kasan_report+0x139/0x350
 __wake_up_common+0x60/0x230
 __wake_up_common_lock+0xb9/0x100
 pg_init_done+0x100/0x240 [dm_multipath]
 multipath_clone_and_map+0x32c/0x340 [dm_multipath]
 map_request+0xc1/0x550 [dm_mod]
 dm_mq_queue_rq+0xf9/0x1a0 [dm_mod]
 blk_mq_dispatch_rq_list+0x143/0xac0
 blk_mq_sched_dispatch_requests+0x23d/0x2f0
 __blk_mq_run_hw_queue+0xdb/0x160
 process_one_work+0x441/0xa50
 worker_thread+0x76/0x6c0
 kthread+0x1b2/0x1d0
 ret_from_fork+0x24/0x30
==================================================================

Fixes: 8d47e65948dd ("dm mpath: remove unnecessary NVMe branching in favor of scsi_dh checks")
Signed-off-by: Bart Van Assche <bart.vanassche@wdc.com>
---
 drivers/md/dm-mpath.c | 66 +++++++++++++++++++++++++++++----------------------
 1 file changed, 37 insertions(+), 29 deletions(-)

diff --git a/drivers/md/dm-mpath.c b/drivers/md/dm-mpath.c
index 3fde9e9faddd..7d3e572072f5 100644
--- a/drivers/md/dm-mpath.c
+++ b/drivers/md/dm-mpath.c
@@ -22,7 +22,6 @@ 
 #include <linux/time.h>
 #include <linux/workqueue.h>
 #include <linux/delay.h>
-#include <scsi/scsi_device.h>
 #include <scsi/scsi_dh.h>
 #include <linux/atomic.h>
 #include <linux/blk-mq.h>
@@ -212,13 +211,25 @@  static int alloc_multipath_stage2(struct dm_target *ti, struct multipath *m)
 		else
 			m->queue_mode = DM_TYPE_REQUEST_BASED;
 
-	} else if (m->queue_mode == DM_TYPE_BIO_BASED) {
+	} else if (m->queue_mode == DM_TYPE_BIO_BASED ||
+		   m->queue_mode == DM_TYPE_NVME_BIO_BASED) {
 		INIT_WORK(&m->process_queued_bios, process_queued_bios);
-		/*
-		 * bio-based doesn't support any direct scsi_dh management;
-		 * it just discovers if a scsi_dh is attached.
-		 */
-		set_bit(MPATHF_RETAIN_ATTACHED_HW_HANDLER, &m->flags);
+
+		if (m->queue_mode == DM_TYPE_BIO_BASED) {
+			/*
+			 * bio-based doesn't support any direct scsi_dh management;
+			 * it just discovers if a scsi_dh is attached.
+			 */
+			set_bit(MPATHF_RETAIN_ATTACHED_HW_HANDLER, &m->flags);
+		}
+	}
+
+	if (m->queue_mode != DM_TYPE_NVME_BIO_BASED) {
+		set_bit(MPATHF_QUEUE_IO, &m->flags);
+		atomic_set(&m->pg_init_in_progress, 0);
+		atomic_set(&m->pg_init_count, 0);
+		m->pg_init_delay_msecs = DM_PG_INIT_DELAY_DEFAULT;
+		init_waitqueue_head(&m->pg_init_wait);
 	}
 
 	dm_table_set_type(ti->table, m->queue_mode);
@@ -326,12 +337,14 @@  static void __switch_pg(struct multipath *m, struct priority_group *pg)
 {
 	m->current_pg = pg;
 
+	if (m->queue_mode == DM_TYPE_NVME_BIO_BASED)
+		return;
+
 	/* Must we initialise the PG first, and queue I/O till it's ready? */
 	if (m->hw_handler_name) {
 		set_bit(MPATHF_PG_INIT_REQUIRED, &m->flags);
 		set_bit(MPATHF_QUEUE_IO, &m->flags);
 	} else {
-		/* FIXME: not needed if no scsi_dh is attached */
 		clear_bit(MPATHF_PG_INIT_REQUIRED, &m->flags);
 		clear_bit(MPATHF_QUEUE_IO, &m->flags);
 	}
@@ -372,7 +385,8 @@  static struct pgpath *choose_pgpath(struct multipath *m, size_t nr_bytes)
 	unsigned bypassed = 1;
 
 	if (!atomic_read(&m->nr_valid_paths)) {
-		clear_bit(MPATHF_QUEUE_IO, &m->flags);
+		if (m->queue_mode != DM_TYPE_NVME_BIO_BASED)
+			clear_bit(MPATHF_QUEUE_IO, &m->flags);
 		goto failed;
 	}
 
@@ -585,7 +599,7 @@  static struct pgpath *__map_bio(struct multipath *m, struct bio *bio)
 	return pgpath;
 }
 
-static struct pgpath *__map_bio_fast(struct multipath *m, struct bio *bio)
+static struct pgpath *__map_bio_nvme(struct multipath *m, struct bio *bio)
 {
 	struct pgpath *pgpath;
 	unsigned long flags;
@@ -620,8 +634,8 @@  static int __multipath_map_bio(struct multipath *m, struct bio *bio,
 {
 	struct pgpath *pgpath;
 
-	if (!m->hw_handler_name)
-		pgpath = __map_bio_fast(m, bio);
+	if (m->queue_mode == DM_TYPE_NVME_BIO_BASED)
+		pgpath = __map_bio_nvme(m, bio);
 	else
 		pgpath = __map_bio(m, bio);
 
@@ -661,7 +675,8 @@  static void process_queued_io_list(struct multipath *m)
 {
 	if (m->queue_mode == DM_TYPE_MQ_REQUEST_BASED)
 		dm_mq_kick_requeue_list(dm_table_get_md(m->ti->table));
-	else if (m->queue_mode == DM_TYPE_BIO_BASED)
+	else if (m->queue_mode == DM_TYPE_BIO_BASED ||
+		 m->queue_mode == DM_TYPE_NVME_BIO_BASED)
 		queue_work(kmultipathd, &m->process_queued_bios);
 }
 
@@ -823,16 +838,6 @@  static int setup_scsi_dh(struct block_device *bdev, struct multipath *m, char **
 			 */
 			kfree(m->hw_handler_name);
 			m->hw_handler_name = attached_handler_name;
-
-			/*
-			 * Init fields that are only used when a scsi_dh is attached
-			 */
-			if (!test_and_set_bit(MPATHF_QUEUE_IO, &m->flags)) {
-				atomic_set(&m->pg_init_in_progress, 0);
-				atomic_set(&m->pg_init_count, 0);
-				m->pg_init_delay_msecs = DM_PG_INIT_DELAY_DEFAULT;
-				init_waitqueue_head(&m->pg_init_wait);
-			}
 		}
 	}
 
@@ -868,7 +873,6 @@  static struct pgpath *parse_path(struct dm_arg_set *as, struct path_selector *ps
 	int r;
 	struct pgpath *p;
 	struct multipath *m = ti->private;
-	struct scsi_device *sdev;
 
 	/* we need at least a path arg */
 	if (as->argc < 1) {
@@ -887,9 +891,7 @@  static struct pgpath *parse_path(struct dm_arg_set *as, struct path_selector *ps
 		goto bad;
 	}
 
-	sdev = scsi_device_from_queue(bdev_get_queue(p->path.dev->bdev));
-	if (sdev) {
-		put_device(&sdev->sdev_gendev);
+	if (m->queue_mode != DM_TYPE_NVME_BIO_BASED) {
 		INIT_DELAYED_WORK(&p->activate_path, activate_path_work);
 		r = setup_scsi_dh(p->path.dev->bdev, m, &ti->error);
 		if (r) {
@@ -999,7 +1001,8 @@  static int parse_hw_handler(struct dm_arg_set *as, struct multipath *m)
 	if (!hw_argc)
 		return 0;
 
-	if (m->queue_mode == DM_TYPE_BIO_BASED) {
+	if (m->queue_mode == DM_TYPE_BIO_BASED ||
+	    m->queue_mode == DM_TYPE_NVME_BIO_BASED) {
 		dm_consume_args(as, hw_argc);
 		DMERR("bio-based multipath doesn't allow hardware handler args");
 		return 0;
@@ -1088,6 +1091,8 @@  static int parse_features(struct dm_arg_set *as, struct multipath *m)
 
 			if (!strcasecmp(queue_mode_name, "bio"))
 				m->queue_mode = DM_TYPE_BIO_BASED;
+			else if (!strcasecmp(queue_mode_name, "nvme"))
+				m->queue_mode = DM_TYPE_NVME_BIO_BASED;
 			else if (!strcasecmp(queue_mode_name, "rq"))
 				m->queue_mode = DM_TYPE_REQUEST_BASED;
 			else if (!strcasecmp(queue_mode_name, "mq"))
@@ -1188,7 +1193,7 @@  static int multipath_ctr(struct dm_target *ti, unsigned argc, char **argv)
 	ti->num_discard_bios = 1;
 	ti->num_write_same_bios = 1;
 	ti->num_write_zeroes_bios = 1;
-	if (m->queue_mode == DM_TYPE_BIO_BASED)
+	if (m->queue_mode == DM_TYPE_BIO_BASED || m->queue_mode == DM_TYPE_NVME_BIO_BASED)
 		ti->per_io_data_size = multipath_per_bio_data_size();
 	else
 		ti->per_io_data_size = sizeof(struct dm_mpath_io);
@@ -1725,6 +1730,9 @@  static void multipath_status(struct dm_target *ti, status_type_t type,
 			case DM_TYPE_BIO_BASED:
 				DMEMIT("queue_mode bio ");
 				break;
+			case DM_TYPE_NVME_BIO_BASED:
+				DMEMIT("queue_mode nvme ");
+				break;
 			case DM_TYPE_MQ_REQUEST_BASED:
 				DMEMIT("queue_mode mq ");
 				break;