fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [42.9% done] [  2780/ 14684 kb/s] [eta 00m:04s]
Threads: 3: [FmF] [44.4% done] [  1060/     0 kb/s] [eta 00m:05s]
Threads: 3: [FmF] [45.5% done] [   724/     0 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [42.9% done] [   880/     0 kb/s] [eta 00m:08s]
Threads: 3: [FmF] [43.8% done] [   523/     0 kb/s] [eta 00m:09s]
Threads: 3: [FFF] [100.0% done] [   338/ 35698 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [  8164/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 16734/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 32578/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [87.0% done] [ 36856/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [91.3% done] [ 29652/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 31913/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32775/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33059/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33008/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4457
  read : io=100MiB, bw=3,991KiB/s, runt= 26269msec
    slat (msec): min=   16, max=24110, avg=18368.99, stdev=5669.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=15428, per=74.75%, avg=8847.17, stdev=4541.93
  write: io=96,392KiB, bw=5,828KiB/s, runt= 16936msec
    slat (msec): min=    0, max=   22, avg= 2.46, stdev= 2.37
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114688, per=262.77%, avg=45648.00, stdev=56017.48
  cpu          : usr=5.24%, sys=1.37%, ctx=976
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4458
  read : io=100MiB, bw=3,946KiB/s, runt= 26573msec
    slat (msec): min=   20, max=19079, avg=13904.85, stdev=4734.17
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=20929, per=55.08%, avg=6519.33, stdev=5557.61
  write: io=92,392KiB, bw=5,591KiB/s, runt= 16920msec
    slat (msec): min=    0, max=   23, avg= 1.87, stdev= 2.35
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111746, per=214.54%, avg=37270.33, stdev=64497.83
  cpu          : usr=4.47%, sys=1.29%, ctx=1047
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4459
  read : io=100MiB, bw=3,945KiB/s, runt= 26576msec
    slat (msec): min=   81, max=23862, avg=19462.30, stdev=4203.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=17993, per=74.92%, avg=8867.26, stdev=5752.61
  write: io=98,544KiB, bw=5,959KiB/s, runt= 16932msec
    slat (msec): min=    0, max=   94, avg= 2.65, stdev= 6.73
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=97648, per=183.81%, avg=31931.20, stdev=45219.01
  cpu          : usr=5.06%, sys=1.48%, ctx=1066
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,836KiB/s, minb=3,945KiB/s, maxb=3,991KiB/s, mint=26269msec, maxt=26576msec
  WRITE: io=281MiB, aggrb=17,372KiB/s, minb=5,591KiB/s, maxb=5,959KiB/s, mint=26269msec, maxt=26576msec

Disk stats (read/write):
  sda: ios=3313/2446, merge=1217/69235, ticks=107992/2080996, in_queue=2189712, util=97.56%
3.98user 1.10system 0:26.89elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2426minor)pagefaults 0swaps