fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [6.4% done] [  4752/  5973 kb/s] [eta 00m:44s]
Threads: 3: [mFm] [9.1% done] [  6644/ 50048 kb/s] [eta 00m:40s]
Threads: 3: [mFF] [10.4% done] [  2048/   880 kb/s] [eta 00m:43s]
Threads: 3: [mFF] [50.0% done] [   780/ 55564 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [50.0% done] [  1432/   392 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [50.0% done] [   672/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [   492/ 27312 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  3032/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 23584/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 35620/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [73.9% done] [ 22648/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [85.7% done] [ 29552/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 33876/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35876/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32812/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 24804/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=658
  read : io=100MiB, bw=4,494KiB/s, runt= 23331msec
    slat (msec): min=  114, max=14984, avg=10198.90, stdev=3964.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=18560, per=50.84%, avg=6854.25, stdev=5642.06
  write: io=83,268KiB, bw=6,168KiB/s, runt= 13822msec
    slat (msec): min=    0, max=  388, avg= 2.61, stdev=19.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=64942, per=107.67%, avg=21715.67, stdev=37435.24
  cpu          : usr=5.11%, sys=1.70%, ctx=1115
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=659
  read : io=100MiB, bw=4,522KiB/s, runt= 23184msec
    slat (msec): min=  131, max=21733, avg=17386.96, stdev=3531.15
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=25739, per=74.36%, avg=10026.41, stdev=7116.66
  write: io=99,944KiB, bw=7,406KiB/s, runt= 13818msec
    slat (msec): min=    0, max=   14, avg= 1.77, stdev= 2.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=109052, per=270.35%, avg=54526.00, stdev=77111.41
  cpu          : usr=5.50%, sys=1.62%, ctx=810
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=660
  read : io=100MiB, bw=4,561KiB/s, runt= 22990msec
    slat (msec): min=  103, max=19003, avg=13410.91, stdev=4485.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   19, max=22863, per=62.70%, avg=8453.75, stdev=6085.98
  write: io=89,200KiB, bw=6,604KiB/s, runt= 13830msec
    slat (msec): min=    0, max=  356, avg= 3.53, stdev=25.38
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=55775, per=93.31%, avg=18819.33, stdev=32006.37
  cpu          : usr=5.31%, sys=1.44%, ctx=1012
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,483KiB/s, minb=4,494KiB/s, maxb=4,561KiB/s, mint=22990msec, maxt=23331msec
  WRITE: io=266MiB, aggrb=20,169KiB/s, minb=6,168KiB/s, maxb=7,406KiB/s, mint=22990msec, maxt=23331msec

Disk stats (read/write):
  sda: ios=3559/1488, merge=1143/66558, ticks=73640/1693840, in_queue=1772084, util=99.34%
3.74user 1.13system 0:23.56elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2415minor)pagefaults 0swaps