| Message ID | 20210122224453.4161729-1-vinicius.gomes@intel.com (mailing list archive) |
|---|---|
| Headers | show |
| Series | ethtool: Add support for frame preemption | expand |
On Fri, Jan 22, 2021 at 02:44:45PM -0800, Vinicius Costa Gomes wrote: > This is still an RFC because two main reasons, I want to confirm that > this approach (per-queue settings via qdiscs, device settings via > ethtool) looks good, even though there aren't much more options left ;-) I don't want to bother you too much, but a consequence of putting the per-priority settings into tc-taprio is that those will spill over into other qdiscs too that have nothing to do with TSN, for whomever will need frame preemption without time-aware scheduling (and there are reasons to want that). So could we see in the next version the frame preemption bits added to tc-mqprio as well? I just want to make sure that we run this by the tc maintainers and that the idea gets their informed consent before we end up in a position where frame preemption with time-aware scheduling is done in one way, but frame preemption without time-aware scheduling is done another way. You should not need to change anything related to TC_SETUP_PREEMPT in the igc driver, so it should be just code addition.
Vladimir Oltean <vladimir.oltean@nxp.com> writes: > On Fri, Jan 22, 2021 at 02:44:45PM -0800, Vinicius Costa Gomes wrote: >> This is still an RFC because two main reasons, I want to confirm that >> this approach (per-queue settings via qdiscs, device settings via >> ethtool) looks good, even though there aren't much more options left ;-) > > I don't want to bother you too much, but a consequence of putting the > per-priority settings into tc-taprio is that those will spill over into > other qdiscs too that have nothing to do with TSN, for whomever will > need frame preemption without time-aware scheduling (and there are > reasons to want that). > So could we see in the next version the frame preemption bits added to > tc-mqprio as well? I just want to make sure that we run this by the tc > maintainers and that the idea gets their informed consent before we end > up in a position where frame preemption with time-aware scheduling is > done in one way, but frame preemption without time-aware scheduling is > done another way. > You should not need to change anything related to TC_SETUP_PREEMPT in > the igc driver, so it should be just code addition. Good suggestion. Will do. Cheers,
Hi, Changes from v2: - Fixed some copy&paste mistakes, documentation formatting and slightly improved error reporting (Jakub Kicinski); Changes from v1: - The minimum fragment size configuration was changed to be configured in bytes to be more future proof, in case the standard changes this (the previous definition was '(X + 1) * 64', X being [0..3]) (Michal Kubecek); - In taprio, frame preemption is now configured by traffic classes (was done by queues) (Jakub Kicinski, Vladimir Oltean); - Various netlink protocol validation improvements (Jakub Kicinski); - Dropped the IGC register dump for frame preemption registers, until a stardandized way of exposing that is agreed (Jakub Kicinski); Changes from RFC v2: - Reorganised the offload enabling/disabling on the driver size; - Added a few igc fixes; Changes from RFC v1: - The per-queue preemptible/express setting is moved to applicable qdiscs (Jakub Kicinski and others); - "min-frag-size" now follows the 802.3br specification more closely, it's expressed as X in '64(1 + X) + 4' (Joergen Andreasen); Another point that should be noted is the addition of the TC_SETUP_PREEMPT offload type, the idea behind this is to allow other qdiscs (was thinking of mqprio) to also configure which traffic classes should be marked as express/preemptible. Original cover letter (lightly edited): This is still an RFC because two main reasons, I want to confirm that this approach (per-queue settings via qdiscs, device settings via ethtool) looks good, even though there aren't much more options left ;-) The other reason is that while testing this I found some weirdness in the driver that I would need a bit more time to investigate. (In case these patches are not enough to give an idea of how things work, I can send the userspace patches, of course.) The idea of this "hybrid" approach is that applications/users would do the following steps to configure frame preemption: $ tc qdisc replace dev $IFACE parent root handle 100 taprio \ num_tc 3 \ map 2 2 1 0 2 2 2 2 2 2 2 2 2 2 2 2 \ queues 1@0 1@1 2@2 \ base-time $BASE_TIME \ sched-entry S 0f 10000000 \ preempt 1110 \ flags 0x2 The "preempt" parameter is the only difference, it configures which traffic classes are marked as preemptible, in this example, traffic class 0 is marked as "not preemptible", so it is express, the rest of the four traffic classes are preemptible. The next step, of this example, would be to enable frame preemption in the device, via ethtool, and set the minimum fragment size to 192 bytes: $ sudo ./ethtool --set-frame-preemption $IFACE fp on min-frag-size 192 Cheers, Vinicius Costa Gomes (8): ethtool: Add support for configuring frame preemption taprio: Add support for frame preemption offload igc: Set the RX packet buffer size for TSN mode igc: Only dump registers if configured to dump HW information igc: Avoid TX Hangs because long cycles igc: Add support for tuning frame preemption via ethtool igc: Add support for Frame Preemption offload igc: Separate TSN configurations that can be updated Documentation/networking/ethtool-netlink.rst | 38 +++++ drivers/net/ethernet/intel/igc/igc.h | 12 ++ drivers/net/ethernet/intel/igc/igc_defines.h | 6 + drivers/net/ethernet/intel/igc/igc_dump.c | 3 + drivers/net/ethernet/intel/igc/igc_ethtool.c | 53 ++++++ drivers/net/ethernet/intel/igc/igc_main.c | 31 +++- drivers/net/ethernet/intel/igc/igc_tsn.c | 162 ++++++++++++++----- drivers/net/ethernet/intel/igc/igc_tsn.h | 1 + include/linux/ethtool.h | 23 ++- include/linux/netdevice.h | 1 + include/net/pkt_sched.h | 4 + include/uapi/linux/ethtool_netlink.h | 17 ++ include/uapi/linux/pkt_sched.h | 1 + net/ethtool/Makefile | 2 +- net/ethtool/common.c | 25 +++ net/ethtool/netlink.c | 19 +++ net/ethtool/netlink.h | 4 + net/ethtool/preempt.c | 146 +++++++++++++++++ net/sched/sch_taprio.c | 43 ++++- 19 files changed, 539 insertions(+), 52 deletions(-) create mode 100644 net/ethtool/preempt.c