fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [9.7% done] [ 20414/   394 kb/s] [eta 00m:28s]
Threads: 3: [mmm] [12.9% done] [ 17895/  2775 kb/s] [eta 00m:27s]
Threads: 3: [mmm] [14.7% done] [  9935/  9801 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [17.1% done] [ 10406/  6123 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [19.4% done] [  6241/ 10938 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [21.6% done] [  9276/  5233 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [25.7% done] [ 11255/  7265 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [28.6% done] [  9610/  7200 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [30.6% done] [ 10979/  5002 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [32.4% done] [ 12999/  1852 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [35.1% done] [  7915/  6213 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [36.8% done] [  8638/  4112 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [38.5% done] [  5091/  7907 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [41.0% done] [  6152/  5510 kb/s] [eta 00m:23s]
Threads: 3: [mVm] [43.6% done] [ 11125/  1836 kb/s] [eta 00m:22s]
Threads: 3: [mVV] [46.2% done] [ 12588/  2755 kb/s] [eta 00m:21s]
Threads: 2: [m_V] [48.7% done] [ 18090/   341 kb/s] [eta 00m:20s]
Threads: 2: [m_V] [51.3% done] [ 17607/   235 kb/s] [eta 00m:19s]
Threads: 2: [m_V] [55.3% done] [ 10812/  5449 kb/s] [eta 00m:17s]
Threads: 2: [m_V] [61.1% done] [ 14169/     0 kb/s] [eta 00m:14s]
Threads: 1: [V__] [67.6% done] [ 10406/     0 kb/s] [eta 00m:11s]
Threads: 1: [V__] [82.8% done] [ 21016/     0 kb/s] [eta 00m:05s]
fio: (groupid=0): err= 0: pid=20026
  read : io=100MiB, bw=4,234KiB/s, runt= 24762msec
    slat (msec): min=    0, max= 1764, avg=266.43, stdev=489.47
    clat (msec): min=    0, max=  957, avg=77.22, stdev=152.06
    bw (KiB/s) : min=  265, max=24788, per=42.71%, avg=5424.82, stdev=6423.83
  write: io=37,296KiB, bw=1,659KiB/s, runt= 23014msec
    slat (msec): min=    0, max=    1, avg= 0.01, stdev= 0.10
    clat (msec): min=    0, max=  843, avg=148.65, stdev=261.92
    bw (KiB/s) : min=    0, max=12490, per=64.97%, avg=2811.40, stdev=3052.72
  cpu          : usr=4.02%, sys=0.24%, ctx=1965
  IO depths    : 1=0.2%, 2=0.3%, 4=1.5%, 8=98.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=8.1%, 4=2.5%, 10=14.7%, 20=24.5%, 50=20.9%, 100=9.0%
     lat (msec): 250=9.4%, 500=4.5%, 750=2.9%, 1000=3.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20027
  read : io=100MiB, bw=5,596KiB/s, runt= 18737msec
    slat (msec): min=    0, max= 2488, avg=252.22, stdev=600.57
    clat (msec): min=    0, max=  695, avg=72.40, stdev=90.10
    bw (KiB/s) : min=  231, max=11906, per=44.55%, avg=5658.77, stdev=3164.13
  write: io=18,704KiB, bw=1,169KiB/s, runt= 16383msec
    slat (msec): min=    0, max=    3, avg= 0.05, stdev= 0.33
    clat (msec): min=    0, max=  818, avg=89.36, stdev=147.32
    bw (KiB/s) : min=    0, max= 8152, per=60.49%, avg=2617.31, stdev=2647.27
  cpu          : usr=4.44%, sys=0.28%, ctx=1859
  IO depths    : 1=0.2%, 2=0.3%, 4=1.3%, 8=98.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=4.4%, 4=1.1%, 10=8.3%, 20=18.1%, 50=25.8%, 100=19.4%
     lat (msec): 250=16.1%, 500=5.7%, 750=0.8%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20028
  read : io=100MiB, bw=4,676KiB/s, runt= 22423msec
    slat (msec): min=    0, max= 4961, avg=1395.70, stdev=1680.27
    clat (msec): min=    0, max=  848, avg=66.71, stdev=101.02
    bw (KiB/s) : min=   13, max=18182, per=45.66%, avg=5799.64, stdev=4260.01
  write: io=41,252KiB, bw=2,438KiB/s, runt= 17323msec
    slat (msec): min=    0, max=  104, avg= 0.20, stdev= 3.82
    clat (msec): min=    0, max=  825, avg=83.59, stdev=147.06
    bw (KiB/s) : min=    0, max= 7617, per=73.26%, avg=3170.04, stdev=2412.98
  cpu          : usr=4.19%, sys=0.30%, ctx=2193
  IO depths    : 1=0.1%, 2=0.2%, 4=2.1%, 8=97.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=10.7%, 4=2.0%, 10=10.2%, 20=18.4%, 50=23.1%, 100=14.1%
     lat (msec): 250=14.8%, 500=4.6%, 750=1.4%, 1000=0.6%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,703KiB/s, minb=4,234KiB/s, maxb=5,596KiB/s, mint=18737msec, maxt=24762msec
  WRITE: io=97,252KiB, aggrb=4,327KiB/s, minb=1,169KiB/s, maxb=2,438KiB/s, mint=18737msec, maxt=24762msec

Disk stats (read/write):
  sda: ios=5450/1681, merge=75/72, ticks=382948/174020, in_queue=556968, util=99.24%
2.82user 0.18system 0:25.05elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2379minor)pagefaults 0swaps