fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [50.0% done] [  1312/ 40612 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [   227/ 45347 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.6% done] [  7199/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 30384/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 33904/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [82.6% done] [ 27494/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [95.2% done] [ 39768/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 37192/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34092/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36772/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35416/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14352
  read : io=100MiB, bw=4,206KiB/s, runt= 24928msec
    slat (msec): min=   21, max=21764, avg=17464.07, stdev=4049.80
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=14779, per=68.26%, avg=8613.18, stdev=5412.05
  write: io=96,600KiB, bw=6,379KiB/s, runt= 15505msec
    slat (msec): min=    0, max=   33, avg= 2.55, stdev= 3.78
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117784, per=222.25%, avg=44066.75, stdev=56214.69
  cpu          : usr=5.62%, sys=1.56%, ctx=897
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14353
  read : io=100MiB, bw=4,227KiB/s, runt= 24804msec
    slat (msec): min=   88, max=21534, avg=16894.18, stdev=3312.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=14987, per=67.68%, avg=8541.00, stdev=5660.71
  write: io=99MiB, bw=6,689KiB/s, runt= 15509msec
    slat (msec): min=    0, max=   90, avg= 2.66, stdev= 5.70
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=94172, per=194.06%, avg=38479.00, stdev=46542.05
  cpu          : usr=6.03%, sys=1.60%, ctx=1000
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14354
  read : io=100MiB, bw=4,213KiB/s, runt= 24884msec
    slat (msec): min=14982, max=23956, avg=19974.97, stdev=2486.44
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=14806, per=84.75%, avg=10694.00, stdev=4419.96
  write: io=100MiB, bw=6,776KiB/s, runt= 15473msec
    slat (msec): min=    0, max=   15, avg= 2.03, stdev= 2.11
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113494, per=286.20%, avg=56747.00, stdev=80252.38
  cpu          : usr=4.87%, sys=1.61%, ctx=870
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,619KiB/s, minb=4,206KiB/s, maxb=4,227KiB/s, mint=24804msec, maxt=24928msec
  WRITE: io=293MiB, aggrb=19,828KiB/s, minb=6,379KiB/s, maxb=6,776KiB/s, mint=24804msec, maxt=24928msec

Disk stats (read/write):
  sda: ios=2965/2355, merge=1175/72560, ticks=104352/2060052, in_queue=2166008, util=96.96%
4.12user 1.21system 0:25.20elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2421minor)pagefaults 0swaps