<div style="font:14px/1.5 'Lucida Grande', '微软雅黑';color:#333;"><p style="font:14px/1.5 'Lucida Grande';margin:0;">Hi, Santosh,</p><p style="font:14px/1.5 'Lucida Grande';margin:0;"><br></p><p style="font:14px/1.5 'Lucida Grande';margin:0;">I can not work with latest tool, either.</p><p style="font:14px/1.5 'Lucida Grande';margin:0;"><br></p><p style="font:14px/1.5 'Lucida Grande';margin:0;">Here is the test log:</p><p style="font:14px/1.5 'Lucida Grande';margin:0;">Server:</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">[root@localhost rds-tools]# ./rds-stress -r 192.168.10.210</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">waiting for incoming connection on 192.168.10.210:4000</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">accepted connection from 192.168.10.211:52681</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">negotiated options, tasks will start in 2 seconds</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">Starting up..Requesting RDMA read for pattern b00008f17 local addr to rdma read 0x7f086dc3b000</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">RDS received request to issue rdma read from len 4096 rva 7fa83b15c000 key 8011f00 pattern b000171f1</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">RDS issuing rdma for token 0xc00000000 key 0x8011f00 len 4096 local_buf 0x7f086dc3c000 vector 1</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">sendto() truncated - 1..</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">tsks tx/s rx/s tx+rx K/s mbi K/s mbo K/s tx us/c rtt us cpu %</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">child pid 36631 exited with status 1</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;"><br></p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">Client:</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">[root@localhost work]# ./rds-stress -r 192.168.10.211 -s 192.168.10.210 -D 4096 -V</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">connecting to 192.168.10.210:4000</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">negotiated options, tasks will start in 2 seconds</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">Starting up..Requesting RDMA read for pattern b000171f1 local addr to rdma read 0x7fa83b15c000</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">RDS received request to issue rdma read from len 4096 rva 7f086dc3b000 key 8011800 pattern b00008f17</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">RDS issuing rdma for token 0xc00000000 key 0x8011800 len 4096 local_buf 0x7fa83b15d000 vector 1</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">sendto() truncated - 1..</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">tsks tx/s rx/s tx+rx K/s mbi K/s mbo K/s tx us/c rtt us cpu %</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;"> 1 0 0 0.00 0.00 0.00 0.00 0.00 -1.00</p><p style="line-height: 1.5; font-family: 'Lucida Grande'; margin: 0px;">child pid 94705 exited with status 1</p><div><br></div><div><br></div><div>Here is the OS and driver information</div><div><div>[root@localhost rds-tools]# uname -a</div><div>Linux localhost.localdomain 3.10.0-123.el7.x86_64 #1 SMP Mon Jun 30 12:09:22 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux</div><div>[root@localhost rds-tools]# modinfo rds_rdma</div><div>filename: /lib/modules/3.10.0-123.el7.x86_64/extra/mlnx-rds/rds_rdma.ko</div><div>license: Dual BSD/GPL</div><div>description: RDS: IB/iWARP transport</div><div>author: Oracle Corporation <rds-devel@oss.oracle.com></div><div>license: GPL</div><div>license: GPL</div><div>srcversion: CB3179F0ED3782E0AEA093E</div><div>depends: rds,mlx_compat,ib_core,rdma_cm</div><div>vermagic: 3.10.0-123.el7.x86_64 SMP mod_unload modversions </div><div>signer: Mellanox Technologies signing key</div><div>sig_key: 61:FE:B0:74:FC:72:92:F9:58:41:93:86:FF:DD:9D:5C:A9:99:E4:03</div><div>sig_hashalgo: sha256</div><div>parm: fastreg_pool_size: Max number of fastreg MRs per device (int)</div><div>parm: fastreg_message_size: Max size of a RDMA transfer (fastreg MRs) (int)</div><div>parm: fmr_pool_size: Max number of fmr per HCA (int)</div><div>parm: fmr_message_size: Max size of a RDMA transfer (int)</div><div>parm: rds_ib_retry_count: Number of hw retries before reporting an error (int)</div><div>[root@localhost rds-tools]# modinfo rds</div><div>filename: /lib/modules/3.10.0-123.el7.x86_64/extra/mlnx-rds/rds.ko</div><div>alias: net-pf-21</div><div>license: Dual BSD/GPL</div><div>version: 4.0</div><div>description: RDS: Reliable Datagram Sockets v4.0 (Feb 12, 2009)</div><div>author: Oracle Corporation <rds-devel@oss.oracle.com></div><div>srcversion: 6FB488DB5C715F6142395C3</div><div>depends: mlx_compat</div><div>vermagic: 3.10.0-123.el7.x86_64 SMP mod_unload modversions </div><div>signer: Mellanox Technologies signing key</div><div>sig_key: 61:FE:B0:74:FC:72:92:F9:58:41:93:86:FF:DD:9D:5C:A9:99:E4:03</div><div>sig_hashalgo: sha256</div><div>parm: send_batch_count: batch factor when working the send queue (int)</div></div><div><br></div><div>Is there anything wrong with my test parameter or rds driver?</div><br><div><div style="font: 14px/1.5 'Lucida Grande';"><div class="" style="line-height: normal; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div class="" style="font-family: Helvetica; font-size: 12px;"><font face="Microsoft YaHei" class="" style="font-size: large; color: rgb(237, 27, 35);"><b class="">PHEGDA </b></font><font color="#220102" face="Microsoft YaHei" size="4" class="">天玑数据</font></div><div class="" style="font-family: Helvetica; font-size: 12px;"><font face="Microsoft YaHei" class=""><span class="" style="font-size: 9px;"><font color="#d8232a" class="">————————</font><font color="#999999" class="">————————</font></span></font></div><div class="" style="font-family: Helvetica; font-size: 12px;"><font color="#999999" size="2" face="MicrosoftYaHeiLight" class="">上海天玑数据技术有限公司</font></div><div class="" style="font-family: Helvetica; font-size: 12px;"><span class="" style="color: rgb(153, 153, 153); text-align: -webkit-auto; orphans: 2; widows: 2;"><font face="Microsoft YaHei" size="2" class=""><b class=""><br class=""></b></font></span></div><div class="" style="font-size: 12px; orphans: 2; widows: 2;"><font color="#999999" class=""><font size="4" class="" face="Microsoft YaHei"><b>康亮</b></font><font size="4" face="MicrosoftYaHeiLight" class="" style="font-family: Helvetica;"> </font><font class=""><font size="4" face="MicrosoftYaHeiLight" class="" style="font-family: Helvetica;">| </font><font size="4" class="" face="Microsoft YaHei"><b>工程师</b></font></font></font></div><div class="" style="font-family: Helvetica; font-size: 12px; orphans: 2; widows: 2;"><span class="" style="text-align: -webkit-auto; color: rgb(153, 153, 153);"><font face="Microsoft YaHei" size="2" class=""><b class=""><br class=""></b></font></span></div><div class="" style="font-family: 'lucida Grande', Verdana; orphans: 2; widows: 2;"><font face="MicrosoftYaHeiLight" size="2" class=""><span class="" style="text-align: -webkit-auto;"><font color="#999999">邮箱 </font><a href="mailto:liang_kang@pbdata.com.cn" title="mailto:liang_kang@pbdata.com.cn"><font color="#003c52">liang_kang@pbdata.com.cn</font></a></span></font></div><div class="" style="font-family: 'lucida Grande', Verdana; orphans: 2; widows: 2;"><font face="MicrosoftYaHeiLight" size="2" class=""><span class="" style="text-align: -webkit-auto; color: rgb(153, 153, 153);"><font class="">手机 </font></span><span class="" style="text-align: -webkit-auto; color: rgb(153, 153, 153);">+86-136-0169-6147 | 传真 +86-21-54279888</span></font></div><div class="" style="font-family: 'lucida Grande', Verdana;"><font face="MicrosoftYaHeiLight" size="2" class=""><font class="" style="orphans: 2; widows: 2;"><font color="#999999" class="">地址 </font><font color="#999999" class="">上海市 徐汇区 桂林路406号 华鑫中心 2号楼 12层 | </font></font><span class="" style="orphans: 2; text-align: -webkit-auto; widows: 2; color: rgb(153, 153, 153);">邮编<font class=""> 200233</font></span></font></div></div></div></div></div></div></div></div><span class="" style="font-family: 'lucida Grande', Verdana; line-height: normal; text-align: -webkit-auto; orphans: 2; widows: 2; color: rgb(153, 153, 153);"><span class=""><span class="" style="text-align: -webkit-auto;"><font face="MicrosoftYaHeiLight" size="2" class=""><br class="Apple-interchange-newline"></font><span class="" style="font-family: Helvetica; font-size: 12px;"><span class=""><span class=""><span class=""><font face="MicrosoftYaHeiLight" size="2" class=""><span class=""><span class=""><font face="MicrosoftYaHeiLight" size="2" class=""><span class="" style="text-align: -webkit-auto;"><img src="cid:01CC6757AAC929BA03D278F7D4C28EB0" modifysize="100%"><br class="Apple-interchange-newline">我们的官方网站 </span><a href="http://www.phegda.com/" class="" target="_blank" style="outline: none; color: rgb(42, 88, 111); text-align: -webkit-auto;">www.phegda.com</a></font></span></span></font></span></span></span></span></span></span></span></div></div><span style="font: 14px/1.5 'Lucida Grande';color:#333;"><br></span><div class="foxmail_blockquote_fromhere_element" style="font: 12px/1.5 'Lucida Grande';padding:2px 0 2px 0;"><span style="color:#333;text-decoration:line-through;white-space:pre-wrap;"> </span> 原始邮件 <span style="color:#333;text-decoration:line-through;white-space:pre-wrap;"> </span></div><div style="font: 12px/1.5 'Lucida Grande';background:#efefef;color:#666666;padding:8px;"><div><b style="color:#999;">发件人:</b> Santosh Shilimkar<santosh.shilimkar@oracle.com></div><div><b style="color:#999;">收件人:</b> liang_kang<liang_kang@pbdata.com.cn></div><div><b style="color:#999;">抄送:</b> rds-devel<rds-devel@oss.oracle.com></div><div><b style="color:#999;">发送时间:</b> 2016年12月3日(周六) 00:33</div><div><b style="color:#999;">主题:</b> Re: [rds-devel] RDS-tools issues</div></div><br><div class="mail_quote_19F42CFB6D674CAF9B8310E688B7E9DA" style="font: 14px/1.5 'Lucida Grande';color:#333;"><pre style="white-space:pre-wrap;">On 12/2/2016 12:57 AM, liang_kang wrote:
> Hi, All,
>
>
> I tested the rds-tools-2.0.7 on cents 7.0 system with RDS driver version
> 4.0.
>
> rds-stress can not work with RDMA options(-D :RDMA size).
>
Yes. This was very old issue and has to to do with older tools and
kernel. Another user reported this a while back [1]
Latest tools: <a href="https://oss.oracle.com/git/?p=rds-tools.git;a=summary" title="https://oss.oracle.com/git/?p=rds-tools.git;a=summary">https://oss.oracle.com/git/?p=rds-tools.git;a=summary</a>
Kernel: Linus's kernel.
Regards,
Santosh
[1] <a href="https://patchwork.kernel.org/patch/8460771/" title="https://patchwork.kernel.org/patch/8460771/">https://patchwork.kernel.org/patch/8460771/</a>
</pre></div></div>