fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [6.7% done] [  5464/ 62296 kb/s] [eta 00m:42s]
Threads: 3: [mFF] [7.1% done] [   812/ 29916 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [8.5% done] [  1948/     0 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [10.0% done] [  2212/     0 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [50.0% done] [   787/ 56145 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [50.0% done] [  1250/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [   364/ 28780 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.4% done] [   868/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [70.0% done] [ 20920/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [75.0% done] [ 31856/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [72.7% done] [ 22824/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 31220/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 34440/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [86.4% done] [ 30056/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.2% done] [ 35244/     0 kb/s] [eta 00m:01s]
Threads: 2: [V_V] [100.0% done] [ 34312/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 30896/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=22659
  read : io=100MiB, bw=4,645KiB/s, runt= 22570msec
    slat (msec): min=  137, max=14167, avg=10476.62, stdev=3885.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=23474, per=46.42%, avg=6469.27, stdev=6529.91
  write: io=84,980KiB, bw=6,704KiB/s, runt= 12980msec
    slat (msec): min=    0, max=   10, avg= 1.70, stdev= 1.77
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=27970, per=63.82%, avg=13985.00, stdev=19777.78
  cpu          : usr=5.19%, sys=1.63%, ctx=918
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22660
  read : io=100MiB, bw=4,957KiB/s, runt= 21150msec
    slat (msec): min=  177, max=19664, avg=15676.51, stdev=2889.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=24543, per=83.68%, avg=11661.80, stdev=7236.75
  write: io=98MiB, bw=7,933KiB/s, runt= 12980msec
    slat (msec): min=    0, max=   12, avg= 1.97, stdev= 1.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111707, per=254.90%, avg=55853.50, stdev=78988.78
  cpu          : usr=5.90%, sys=1.93%, ctx=787
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22661
  read : io=100MiB, bw=4,754KiB/s, runt= 22055msec
    slat (msec): min=  118, max=18849, avg=14124.26, stdev=3932.27
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=18867, per=64.16%, avg=8941.95, stdev=5912.61
  write: io=92,212KiB, bw=7,276KiB/s, runt= 12976msec
    slat (msec): min=    0, max=   13, avg= 1.74, stdev= 1.95
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112484, per=256.67%, avg=56242.00, stdev=79538.20
  cpu          : usr=5.73%, sys=1.49%, ctx=892
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,937KiB/s, minb=4,645KiB/s, maxb=4,957KiB/s, mint=21150msec, maxt=22570msec
  WRITE: io=271MiB, aggrb=21,912KiB/s, minb=6,704KiB/s, maxb=7,933KiB/s, mint=21150msec, maxt=22570msec

Disk stats (read/write):
  sda: ios=3358/1513, merge=1473/67796, ticks=77020/1621088, in_queue=1700788, util=98.81%
3.74user 1.12system 0:22.82elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps