fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [5.0% done] [   390/     0 kb/s] [eta 00m:57s]
Threads: 3: [mFm] [6.7% done] [     0/     0 kb/s] [eta 00m:56s]
Threads: 3: [mFm] [8.3% done] [     0/     0 kb/s] [eta 00m:55s]
Threads: 3: [mFm] [10.0% done] [   629/     0 kb/s] [eta 00m:54s]
Threads: 3: [mFm] [11.7% done] [  1670/     0 kb/s] [eta 00m:53s]
Threads: 3: [mVm] [13.3% done] [ 16607/     0 kb/s] [eta 00m:52s]
Threads: 3: [mVm] [15.0% done] [ 26424/     0 kb/s] [eta 00m:51s]
Threads: 3: [mVm] [28.6% done] [ 27448/ 37250 kb/s] [eta 00m:25s]
Threads: 3: [mVm] [39.3% done] [ 25916/ 16136 kb/s] [eta 00m:17s]
Threads: 2: [m_F] [63.2% done] [ 15863/ 77941 kb/s] [eta 00m:07s]
Threads: 2: [F_F] [100.0% done] [     0/  5975 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [F_F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [71.4% done] [ 17282/     0 kb/s] [eta 00m:08s]
Threads: 2: [V_V] [80.8% done] [ 30126/     0 kb/s] [eta 00m:05s]
Threads: 2: [V_V] [88.0% done] [ 31191/     0 kb/s] [eta 00m:03s]
Threads: 2: [V_V] [100.0% done] [ 36677/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 37904/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 26237/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=6721
  read : io=100MiB, bw=4,131KiB/s, runt= 25378msec
    slat (msec): min=   31, max=13382, avg=10395.62, stdev=2986.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=35644, per=73.38%, avg=9095.40, stdev=9547.05
  write: io=92,300KiB, bw=4,967KiB/s, runt= 19026msec
    slat (msec): min=    0, max=  361, avg= 3.00, stdev=20.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=62838, per=135.76%, avg=21019.00, stdev=36216.48
  cpu          : usr=4.63%, sys=1.64%, ctx=920
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=6722
  read : io=100MiB, bw=9,208KiB/s, runt= 11387msec
    slat (msec): min=  129, max= 9948, avg=7953.81, stdev=1514.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=27468, per=158.32%, avg=19623.22, stdev=10472.03
  write: io=99,096KiB, bw=14,230KiB/s, runt=  7131msec
    slat (msec): min=    0, max=   11, avg= 1.98, stdev= 2.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112183, per=362.28%, avg=56091.50, stdev=79325.36
  cpu          : usr=10.08%, sys=4.07%, ctx=805
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=6723
  read : io=100MiB, bw=4,229KiB/s, runt= 24794msec
    slat (msec): min=  124, max=13093, avg=10014.43, stdev=2572.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   21, max=22617, per=74.97%, avg=9292.40, stdev=9079.50
  write: io=96,288KiB, bw=5,185KiB/s, runt= 19015msec
    slat (msec): min=    0, max=   17, avg= 1.93, stdev= 2.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 4839, per=15.63%, avg=2419.50, stdev=3421.69
  cpu          : usr=4.97%, sys=1.68%, ctx=888
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,395KiB/s, minb=4,131KiB/s, maxb=9,208KiB/s, mint=11387msec, maxt=25378msec
  WRITE: io=281MiB, aggrb=15,483KiB/s, minb=4,967KiB/s, maxb=14,230KiB/s, mint=11387msec, maxt=25378msec

Disk stats (read/write):
  sda: ios=3277/2805, merge=1212/68895, ticks=63944/1830160, in_queue=1900408, util=98.36%
3.60user 1.38system 0:25.83elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2429minor)pagefaults 0swaps