> > BTW, what kind of HCA are you using for this testing? > > A pair of fairly new Mellanox cards. How new? Is it ConnectX or something older -- ie do you use the ib_mthca or mlx4_ib driver? If you're using mlx4, then I could believe there is a firmware bug that leads to lost completions. - R.