fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [33.3% done] [  8212/ 65112 kb/s] [eta 00m:06s]
Threads: 3: [mFm] [50.0% done] [  2604/ 34180 kb/s] [eta 00m:04s]
Threads: 3: [mFF] [45.5% done] [     0/ 19952 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [66.7% done] [  2020/ 27288 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/  4028 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  1797/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 21632/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 29756/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 22868/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [90.5% done] [ 30696/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [90.9% done] [ 33592/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 35056/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 33136/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 23328/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 37532/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=13899
  read : io=100MiB, bw=4,261KiB/s, runt= 24605msec
    slat (msec): min=   54, max=18577, avg=13417.80, stdev=4689.44
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=18701, per=56.20%, avg=7185.05, stdev=4944.79
  write: io=86,220KiB, bw=5,952KiB/s, runt= 14832msec
    slat (msec): min=    0, max=  285, avg= 2.60, stdev=16.36
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=72173, per=127.01%, avg=24107.00, stdev=41626.44
  cpu          : usr=4.76%, sys=1.25%, ctx=1033
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13900
  read : io=100MiB, bw=4,283KiB/s, runt= 24480msec
    slat (msec): min=   96, max=22330, avg=17824.11, stdev=4781.69
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=22317, per=73.08%, avg=9342.95, stdev=7577.17
  write: io=96,324KiB, bw=6,653KiB/s, runt= 14824msec
    slat (msec): min=    0, max=   99, avg= 1.72, stdev= 3.02
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=95334, per=167.47%, avg=31785.33, stdev=55034.76
  cpu          : usr=5.00%, sys=1.32%, ctx=874
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13901
  read : io=100MiB, bw=4,382KiB/s, runt= 23924msec
    slat (msec): min=   49, max=19798, avg=14505.98, stdev=4732.67
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=27004, per=65.69%, avg=8397.59, stdev=7419.48
  write: io=92,456KiB, bw=6,381KiB/s, runt= 14836msec
    slat (msec): min=    0, max=   11, avg= 1.78, stdev= 1.96
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=15052, per=39.65%, avg=7526.00, stdev=10643.37
  cpu          : usr=5.02%, sys=1.67%, ctx=1027
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,784KiB/s, minb=4,261KiB/s, maxb=4,382KiB/s, mint=23924msec, maxt=24605msec
  WRITE: io=269MiB, aggrb=18,980KiB/s, minb=5,952KiB/s, maxb=6,653KiB/s, mint=23924msec, maxt=24605msec

Disk stats (read/write):
  sda: ios=3505/2144, merge=1303/66491, ticks=74948/1783876, in_queue=1859804, util=99.04%
3.64user 1.04system 0:24.90elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps