fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [5.8% done] [  3624/ 97369 kb/s] [eta 00m:49s]
Threads: 3: [mFm] [7.1% done] [  2795/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFm] [8.3% done] [   560/ 16749 kb/s] [eta 00m:55s]
Threads: 3: [mFF] [10.0% done] [     0/ 23645 kb/s] [eta 00m:54s]
Threads: 3: [mFF] [11.7% done] [     0/     0 kb/s] [eta 00m:53s]
Threads: 3: [mFF] [13.3% done] [     0/     0 kb/s] [eta 00m:52s]
Threads: 3: [mFF] [15.0% done] [     0/     0 kb/s] [eta 00m:51s]
Threads: 3: [mFF] [16.7% done] [     0/     0 kb/s] [eta 00m:50s]
Threads: 3: [mFF] [42.3% done] [  1304/ 52150 kb/s] [eta 00m:15s]
Threads: 3: [mFF] [44.4% done] [     0/  2499 kb/s] [eta 00m:15s]
Threads: 3: [FVV] [68.4% done] [   337/ 36774 kb/s] [eta 00m:06s]
Threads: 3: [FVV] [70.0% done] [ 11987/     0 kb/s] [eta 00m:06s]
Threads: 3: [FVV] [78.9% done] [ 23901/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVV] [88.9% done] [ 24100/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVV] [89.5% done] [ 14681/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVV] [100.0% done] [ 23925/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 24161/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 19842/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVV] [100.0% done] [ 25417/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [71.0% done] [ 31065/     0 kb/s] [eta 00m:09s]
Threads: 1: [V__] [88.5% done] [ 28676/     0 kb/s] [eta 00m:03s]
Threads: 1: [V__] [100.0% done] [ 36372/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15654
  read : io=100MiB, bw=4,259KiB/s, runt= 24619msec
    slat (msec): min=  101, max=11724, avg=9969.59, stdev=2370.46
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=37766, per=103.63%, avg=13241.29, stdev=16009.40
  write: io=89,996KiB, bw=4,342KiB/s, runt= 21221msec
    slat (msec): min=    0, max=   29, avg= 1.79, stdev= 2.55
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=26065, per=96.07%, avg=13032.50, stdev=18430.74
  cpu          : usr=4.96%, sys=1.19%, ctx=956
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15655
  read : io=100MiB, bw=4,814KiB/s, runt= 21779msec
    slat (msec): min=   58, max=19043, avg=14590.59, stdev=3741.39
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=19493, per=70.71%, avg=9034.22, stdev=4790.71
  write: io=95,672KiB, bw=7,759KiB/s, runt= 12626msec
    slat (msec): min=    0, max=   13, avg= 1.78, stdev= 1.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116572, per=429.68%, avg=58286.00, stdev=82428.85
  cpu          : usr=5.53%, sys=1.63%, ctx=948
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15656
  read : io=100MiB, bw=4,790KiB/s, runt= 21888msec
    slat (msec): min=  203, max=16789, avg=12572.71, stdev=3416.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=16274, per=60.09%, avg=7677.70, stdev=5642.88
  write: io=95,464KiB, bw=7,737KiB/s, runt= 12634msec
    slat (msec): min=    0, max=  271, avg= 1.99, stdev= 9.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=74733, per=183.83%, avg=24936.67, stdev=43124.91
  cpu          : usr=5.50%, sys=1.54%, ctx=1001
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,777KiB/s, minb=4,259KiB/s, maxb=4,814KiB/s, mint=21779msec, maxt=24619msec
  WRITE: io=275MiB, aggrb=13,565KiB/s, minb=4,342KiB/s, maxb=7,759KiB/s, mint=21779msec, maxt=24619msec

Disk stats (read/write):
  sda: ios=3305/2336, merge=1276/67753, ticks=95192/2281096, in_queue=2422216, util=98.50%
3.68user 1.04system 0:25.00elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2426minor)pagefaults 0swaps