| Message ID | 1493915136-19150-1-git-send-email-zhiyong.yang@intel.com (mailing list archive) |
|---|---|
| State | New, archived |
| Headers | show |
On Thu, May 4, 2017 at 8:30 PM Zhiyong Yang <zhiyong.yang@intel.com> wrote: > Qemu2.7~2.9 and vhost user for dpdk 17.02 release work together > to cause failures of new connection when negotiating to set MQ. > (one queue pair works well). > Because there exist some bugs in qemu code when introducing > VHOST_USER_PROTOCOL_F_REPLY_ACK to qemu. When vhost_user_set_mem_table > is invoked to deal with the vhost message VHOST_USER_SET_MEM_TABLE > for the second time, qemu indeed doesn't send the messge (The message > needs to be sent only once)but still will be waiting for dpdk's reply > ack, then, qemu is always freezing, while DPDK is always waiting for > next vhost message from qemu. > The patch aims to fix the bug, MQ can work well. > The same bug is found in function vhost_user_net_set_mtu, it is fixed > at the same time. > DPDK related patch is as following: > http://www.dpdk.org/dev/patchwork/patch/23955/ > > Signed-off-by: Zhiyong Yang <zhiyong.yang@intel.com> > Reviewed-by: Marc-André Lureau <marcandre.lureau@redhat.com> --- > > Changes in V2: > Thanks for Maxime's suggestion, if one-time request, clear the > VHOST_USER_NEED_REPLY flag in function vhost_user_write, > in process_message_reply(), return early, if this flag isn't set. > > hw/virtio/vhost-user.c | 21 +++++++++++++-------- > 1 file changed, 13 insertions(+), 8 deletions(-) > > diff --git a/hw/virtio/vhost-user.c b/hw/virtio/vhost-user.c > index 9334a8a..32a95a8 100644 > --- a/hw/virtio/vhost-user.c > +++ b/hw/virtio/vhost-user.c > @@ -163,22 +163,26 @@ fail: > } > > static int process_message_reply(struct vhost_dev *dev, > - VhostUserRequest request) > + VhostUserMsg msg) > { > - VhostUserMsg msg; > + VhostUserMsg msg_reply; > > - if (vhost_user_read(dev, &msg) < 0) { > + if ((msg.flags & VHOST_USER_NEED_REPLY_MASK) == 0) { > + return 0; > + } > + > + if (vhost_user_read(dev, &msg_reply) < 0) { > return -1; > } > > - if (msg.request != request) { > + if (msg_reply.request != msg.request) { > error_report("Received unexpected msg type." > "Expected %d received %d", > - request, msg.request); > + msg.request, msg_reply.request); > return -1; > } > > - return msg.payload.u64 ? -1 : 0; > + return msg_reply.payload.u64 ? -1 : 0; > } > > static bool vhost_user_one_time_request(VhostUserRequest request) > @@ -208,6 +212,7 @@ static int vhost_user_write(struct vhost_dev *dev, > VhostUserMsg *msg, > * request, we just ignore it. > */ > if (vhost_user_one_time_request(msg->request) && dev->vq_index != 0) { > + msg->flags &= ~VHOST_USER_NEED_REPLY_MASK; > return 0; > } > > @@ -320,7 +325,7 @@ static int vhost_user_set_mem_table(struct vhost_dev > *dev, > } > > if (reply_supported) { > - return process_message_reply(dev, msg.request); > + return process_message_reply(dev, msg); > } > > return 0; > @@ -712,7 +717,7 @@ static int vhost_user_net_set_mtu(struct vhost_dev > *dev, uint16_t mtu) > > /* If reply_ack supported, slave has to ack specified MTU is valid */ > if (reply_supported) { > - return process_message_reply(dev, msg.request); > + return process_message_reply(dev, msg); > } > > return 0; > -- > 2.7.4 > > -- Marc-André Lureau
On Fri, May 05, 2017 at 12:25:36AM +0800, Zhiyong Yang wrote: > Qemu2.7~2.9 and vhost user for dpdk 17.02 release work together > to cause failures of new connection when negotiating to set MQ. > (one queue pair works well). > Because there exist some bugs in qemu code when introducing > VHOST_USER_PROTOCOL_F_REPLY_ACK to qemu. When vhost_user_set_mem_table > is invoked to deal with the vhost message VHOST_USER_SET_MEM_TABLE > for the second time, qemu indeed doesn't send the messge (The message > needs to be sent only once)but still will be waiting for dpdk's reply > ack, then, qemu is always freezing, while DPDK is always waiting for > next vhost message from qemu. > The patch aims to fix the bug, MQ can work well. > The same bug is found in function vhost_user_net_set_mtu, it is fixed > at the same time. > DPDK related patch is as following: > http://www.dpdk.org/dev/patchwork/patch/23955/ > > Signed-off-by: Zhiyong Yang <zhiyong.yang@intel.com> Tested-by: Jens Freimann <jfreiman@redhat.com>
Hi, On 05/04/2017 06:25 PM, Zhiyong Yang wrote: > Qemu2.7~2.9 and vhost user for dpdk 17.02 release work together > to cause failures of new connection when negotiating to set MQ. > (one queue pair works well). > Because there exist some bugs in qemu code when introducing > VHOST_USER_PROTOCOL_F_REPLY_ACK to qemu. When vhost_user_set_mem_table > is invoked to deal with the vhost message VHOST_USER_SET_MEM_TABLE > for the second time, qemu indeed doesn't send the messge (The message > needs to be sent only once)but still will be waiting for dpdk's reply > ack, then, qemu is always freezing, while DPDK is always waiting for > next vhost message from qemu. > The patch aims to fix the bug, MQ can work well. > The same bug is found in function vhost_user_net_set_mtu, it is fixed > at the same time. > DPDK related patch is as following: > http://www.dpdk.org/dev/patchwork/patch/23955/ > > Signed-off-by: Zhiyong Yang <zhiyong.yang@intel.com> > --- > > Changes in V2: > Thanks for Maxime's suggestion, if one-time request, clear the > VHOST_USER_NEED_REPLY flag in function vhost_user_write, > in process_message_reply(), return early, if this flag isn't set. > > hw/virtio/vhost-user.c | 21 +++++++++++++-------- > 1 file changed, 13 insertions(+), 8 deletions(-) > Thanks for the quick fix, it looks good to me. I forgot to ask you to cc qemu-stable, and reference the faulty commit: Cc: qemu-stable@nongnu.org Fixes: ca525ce5618b ("vhost-user: Introduce a new protocol feature REPLY_ACK.") Maybe this can be amended when applied. Michael? Other than that, feel free to add my: Reviewed-by: Maxime Coquelin <maxime.coquelin@redhat.com> Thanks, Maxime
On Fri, May 05, 2017 at 09:34:14AM +0200, Maxime Coquelin wrote: > Hi, > > On 05/04/2017 06:25 PM, Zhiyong Yang wrote: > > Qemu2.7~2.9 and vhost user for dpdk 17.02 release work together > > to cause failures of new connection when negotiating to set MQ. > > (one queue pair works well). > > Because there exist some bugs in qemu code when introducing > > VHOST_USER_PROTOCOL_F_REPLY_ACK to qemu. When vhost_user_set_mem_table > > is invoked to deal with the vhost message VHOST_USER_SET_MEM_TABLE > > for the second time, qemu indeed doesn't send the messge (The message > > needs to be sent only once)but still will be waiting for dpdk's reply > > ack, then, qemu is always freezing, while DPDK is always waiting for > > next vhost message from qemu. > > The patch aims to fix the bug, MQ can work well. > > The same bug is found in function vhost_user_net_set_mtu, it is fixed > > at the same time. > > DPDK related patch is as following: > > http://www.dpdk.org/dev/patchwork/patch/23955/ > > > > Signed-off-by: Zhiyong Yang <zhiyong.yang@intel.com> > > --- > > > > Changes in V2: > > Thanks for Maxime's suggestion, if one-time request, clear the > > VHOST_USER_NEED_REPLY flag in function vhost_user_write, > > in process_message_reply(), return early, if this flag isn't set. > > > > hw/virtio/vhost-user.c | 21 +++++++++++++-------- > > 1 file changed, 13 insertions(+), 8 deletions(-) > > > > Thanks for the quick fix, it looks good to me. > I forgot to ask you to cc qemu-stable, and reference the faulty commit: > > Cc: qemu-stable@nongnu.org > Fixes: ca525ce5618b ("vhost-user: Introduce a new protocol feature > REPLY_ACK.") > > Maybe this can be amended when applied. Michael? Sure. np. > Other than that, feel free to add my: > Reviewed-by: Maxime Coquelin <maxime.coquelin@redhat.com> > > Thanks, > Maxime
diff --git a/hw/virtio/vhost-user.c b/hw/virtio/vhost-user.c index 9334a8a..32a95a8 100644 --- a/hw/virtio/vhost-user.c +++ b/hw/virtio/vhost-user.c @@ -163,22 +163,26 @@ fail: } static int process_message_reply(struct vhost_dev *dev, - VhostUserRequest request) + VhostUserMsg msg) { - VhostUserMsg msg; + VhostUserMsg msg_reply; - if (vhost_user_read(dev, &msg) < 0) { + if ((msg.flags & VHOST_USER_NEED_REPLY_MASK) == 0) { + return 0; + } + + if (vhost_user_read(dev, &msg_reply) < 0) { return -1; } - if (msg.request != request) { + if (msg_reply.request != msg.request) { error_report("Received unexpected msg type." "Expected %d received %d", - request, msg.request); + msg.request, msg_reply.request); return -1; } - return msg.payload.u64 ? -1 : 0; + return msg_reply.payload.u64 ? -1 : 0; } static bool vhost_user_one_time_request(VhostUserRequest request) @@ -208,6 +212,7 @@ static int vhost_user_write(struct vhost_dev *dev, VhostUserMsg *msg, * request, we just ignore it. */ if (vhost_user_one_time_request(msg->request) && dev->vq_index != 0) { + msg->flags &= ~VHOST_USER_NEED_REPLY_MASK; return 0; } @@ -320,7 +325,7 @@ static int vhost_user_set_mem_table(struct vhost_dev *dev, } if (reply_supported) { - return process_message_reply(dev, msg.request); + return process_message_reply(dev, msg); } return 0; @@ -712,7 +717,7 @@ static int vhost_user_net_set_mtu(struct vhost_dev *dev, uint16_t mtu) /* If reply_ack supported, slave has to ack specified MTU is valid */ if (reply_supported) { - return process_message_reply(dev, msg.request); + return process_message_reply(dev, msg); } return 0;
Qemu2.7~2.9 and vhost user for dpdk 17.02 release work together to cause failures of new connection when negotiating to set MQ. (one queue pair works well). Because there exist some bugs in qemu code when introducing VHOST_USER_PROTOCOL_F_REPLY_ACK to qemu. When vhost_user_set_mem_table is invoked to deal with the vhost message VHOST_USER_SET_MEM_TABLE for the second time, qemu indeed doesn't send the messge (The message needs to be sent only once)but still will be waiting for dpdk's reply ack, then, qemu is always freezing, while DPDK is always waiting for next vhost message from qemu. The patch aims to fix the bug, MQ can work well. The same bug is found in function vhost_user_net_set_mtu, it is fixed at the same time. DPDK related patch is as following: http://www.dpdk.org/dev/patchwork/patch/23955/ Signed-off-by: Zhiyong Yang <zhiyong.yang@intel.com> --- Changes in V2: Thanks for Maxime's suggestion, if one-time request, clear the VHOST_USER_NEED_REPLY flag in function vhost_user_write, in process_message_reply(), return early, if this flag isn't set. hw/virtio/vhost-user.c | 21 +++++++++++++-------- 1 file changed, 13 insertions(+), 8 deletions(-)