fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [   574/ 43252 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [68.4% done] [  3472/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [70.0% done] [ 23200/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [75.0% done] [ 29232/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [80.0% done] [ 29544/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [89.5% done] [ 30396/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [94.7% done] [ 36376/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 38068/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31972/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35880/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 31172/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=26863
  read : io=100MiB, bw=4,698KiB/s, runt= 22319msec
    slat (msec): min=   43, max=20706, avg=16744.21, stdev=3706.31
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=22728, per=71.71%, avg=9987.44, stdev=6130.93
  write: io=98,876KiB, bw=7,684KiB/s, runt= 13176msec
    slat (msec): min=    0, max=   13, avg= 2.09, stdev= 2.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=44528, per=96.42%, avg=22264.00, stdev=31486.05
  cpu          : usr=5.77%, sys=1.61%, ctx=823
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26864
  read : io=100MiB, bw=4,780KiB/s, runt= 21933msec
    slat (msec): min=   76, max=19398, avg=14574.90, stdev=4068.24
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=20853, per=67.78%, avg=9441.05, stdev=6039.09
  write: io=95,840KiB, bw=7,758KiB/s, runt= 12650msec
    slat (msec): min=    0, max=   81, avg= 2.06, stdev= 4.45
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=92892, per=134.68%, avg=31098.67, stdev=53514.98
  cpu          : usr=5.64%, sys=1.90%, ctx=857
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26865
  read : io=100MiB, bw=4,642KiB/s, runt= 22585msec
    slat (msec): min=12536, max=21643, avg=17374.90, stdev=2587.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   18, max=17070, per=76.06%, avg=10593.88, stdev=4864.39
  write: io=100MiB, bw=8,254KiB/s, runt= 12703msec
    slat (msec): min=    0, max=   13, avg= 2.04, stdev= 2.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111447, per=241.33%, avg=55723.50, stdev=78804.93
  cpu          : usr=5.56%, sys=1.82%, ctx=1593
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,928KiB/s, minb=4,642KiB/s, maxb=4,780KiB/s, mint=21933msec, maxt=22585msec
  WRITE: io=290MiB, aggrb=23,090KiB/s, minb=7,684KiB/s, maxb=8,254KiB/s, mint=21933msec, maxt=22585msec

Disk stats (read/write):
  sda: ios=3013/1960, merge=1076/72157, ticks=76544/1629120, in_queue=1720104, util=98.78%
3.83user 1.22system 0:22.87elapsed 22%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2431minor)pagefaults 0swaps