fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [6.8% done] [   536/ 19195 kb/s] [eta 00m:41s]
Threads: 3: [FFm] [50.0% done] [  1080/ 57965 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [45.5% done] [   780/   231 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [50.0% done] [  1507/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [46.7% done] [   211/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [   934/ 30858 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  6078/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 30687/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 25944/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 27761/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 35361/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35592/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36575/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31872/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30976/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=23438
  read : io=100MiB, bw=4,429KiB/s, runt= 23670msec
    slat (msec): min=   46, max=21616, avg=17645.56, stdev=3375.23
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=27434, per=75.22%, avg=9892.89, stdev=7646.27
  write: io=99,540KiB, bw=7,119KiB/s, runt= 14317msec
    slat (msec): min=    0, max=   49, avg= 2.12, stdev= 3.67
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103067, per=168.94%, avg=34528.00, stdev=59357.08
  cpu          : usr=5.54%, sys=1.40%, ctx=829
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=23439
  read : io=100MiB, bw=4,495KiB/s, runt= 23326msec
    slat (msec): min=  158, max=21816, avg=17571.23, stdev=3483.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=22916, per=78.51%, avg=10326.00, stdev=6116.12
  write: io=98,560KiB, bw=7,054KiB/s, runt= 14306msec
    slat (msec): min=    0, max=   12, avg= 1.86, stdev= 2.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116699, per=285.50%, avg=58349.50, stdev=82518.65
  cpu          : usr=5.28%, sys=1.53%, ctx=782
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=23440
  read : io=100MiB, bw=4,384KiB/s, runt= 23917msec
    slat (msec): min=   99, max=15992, avg=10826.43, stdev=4155.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   20, max=14235, per=43.89%, avg=5772.18, stdev=4884.62
  write: io=87,664KiB, bw=6,275KiB/s, runt= 14305msec
    slat (msec): min=    0, max=  539, avg= 2.61, stdev=23.77
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=56464, per=92.20%, avg=18843.00, stdev=32580.76
  cpu          : usr=4.88%, sys=1.27%, ctx=963
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,152KiB/s, minb=4,384KiB/s, maxb=4,495KiB/s, mint=23326msec, maxt=23917msec
  WRITE: io=279MiB, aggrb=20,438KiB/s, minb=6,275KiB/s, maxb=7,119KiB/s, mint=23326msec, maxt=23917msec

Disk stats (read/write):
  sda: ios=3200/2171, merge=1434/69185, ticks=79448/1771048, in_queue=1851164, util=99.27%
3.78user 1.00system 0:24.16elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2440minor)pagefaults 0swaps