fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [10.7% done] [  5964/     0 kb/s] [eta 00m:25s]
Threads: 3: [mmF] [40.0% done] [  3688/ 55428 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [38.5% done] [  3364/ 27148 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [40.0% done] [  1192/     0 kb/s] [eta 00m:09s]
Threads: 3: [mFF] [41.2% done] [  1160/     0 kb/s] [eta 00m:10s]
Threads: 3: [FFF] [100.0% done] [   652/ 41128 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  7984/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 25880/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 26432/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 25880/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 34004/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.2% done] [ 33756/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 29516/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34008/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 31488/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17605
  read : io=100MiB, bw=4,376KiB/s, runt= 23961msec
    slat (msec): min=   98, max=16380, avg=12012.39, stdev=4389.53
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   11, max=15813, per=45.93%, avg=5966.35, stdev=5310.20
  write: io=89,700KiB, bw=6,333KiB/s, runt= 14502msec
    slat (msec): min=    0, max=  159, avg= 2.33, stdev= 9.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=76600, per=131.81%, avg=25563.67, stdev=44198.78
  cpu          : usr=5.19%, sys=1.60%, ctx=1057
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17606
  read : io=100MiB, bw=4,512KiB/s, runt= 23236msec
    slat (msec): min=   62, max=18386, avg=12967.89, stdev=4933.69
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=21028, per=60.76%, avg=7892.55, stdev=5181.88
  write: io=82,576KiB, bw=5,831KiB/s, runt= 14501msec
    slat (msec): min=    0, max=   99, avg= 1.73, stdev= 3.97
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=95811, per=164.89%, avg=31980.67, stdev=55278.73
  cpu          : usr=5.20%, sys=1.55%, ctx=1102
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17607
  read : io=100MiB, bw=4,330KiB/s, runt= 24215msec
    slat (msec): min=13807, max=23248, avg=18998.03, stdev=2646.07
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=19488, per=80.75%, avg=10490.06, stdev=5101.06
  write: io=100MiB, bw=7,233KiB/s, runt= 14497msec
    slat (msec): min=    0, max=   13, avg= 1.97, stdev= 1.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=109862, per=283.22%, avg=54931.00, stdev=77684.17
  cpu          : usr=5.37%, sys=1.50%, ctx=734
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,990KiB/s, minb=4,330KiB/s, maxb=4,512KiB/s, mint=23236msec, maxt=24215msec
  WRITE: io=268MiB, aggrb=19,395KiB/s, minb=5,831KiB/s, maxb=7,233KiB/s, mint=23236msec, maxt=24215msec

Disk stats (read/write):
  sda: ios=3496/1847, merge=1177/66831, ticks=78524/1813532, in_queue=1892056, util=99.00%
3.80user 1.17system 0:24.47elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2424minor)pagefaults 0swaps