fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [33.3% done] [   456/ 67565 kb/s] [eta 00m:06s]
Threads: 3: [mFF] [33.3% done] [     0/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [31.2% done] [     0/     0 kb/s] [eta 00m:11s]
Threads: 3: [mFF] [31.6% done] [     0/     0 kb/s] [eta 00m:13s]
Threads: 3: [mFF] [31.8% done] [     0/     0 kb/s] [eta 00m:15s]
Threads: 3: [mFF] [32.0% done] [     0/     0 kb/s] [eta 00m:17s]
Threads: 3: [mFF] [39.1% done] [   692/ 11568 kb/s] [eta 00m:14s]
Threads: 3: [FFF] [100.0% done] [     0/ 42308 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [ 10972/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 31808/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 31024/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 29860/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [80.0% done] [ 31656/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 27040/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.7% done] [ 34300/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 37620/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 32492/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=30412
  read : io=100MiB, bw=4,186KiB/s, runt= 25048msec
    slat (msec): min=   29, max=15597, avg=12647.57, stdev=3500.10
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   10, max=33354, per=66.68%, avg=8374.00, stdev=8178.30
  write: io=91,776KiB, bw=6,132KiB/s, runt= 15324msec
    slat (msec): min=    0, max=   40, avg= 2.22, stdev= 3.23
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=72483, per=124.85%, avg=24179.67, stdev=41831.92
  cpu          : usr=5.14%, sys=1.74%, ctx=983
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30413
  read : io=100MiB, bw=4,418KiB/s, runt= 23734msec
    slat (msec): min=    8, max=21614, avg=16842.20, stdev=3746.30
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=19025, per=80.63%, avg=10125.59, stdev=6221.84
  write: io=99,128KiB, bw=6,623KiB/s, runt= 15325msec
    slat (msec): min=    0, max=   18, avg= 1.98, stdev= 2.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=106251, per=183.87%, avg=35609.33, stdev=61178.16
  cpu          : usr=5.16%, sys=1.79%, ctx=894
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30414
  read : io=100MiB, bw=4,307KiB/s, runt= 24345msec
    slat (msec): min=  151, max=22051, avg=17657.78, stdev=3789.49
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=23167, per=82.44%, avg=10353.44, stdev=6728.48
  write: io=98,948KiB, bw=6,616KiB/s, runt= 15313msec
    slat (msec): min=    0, max=  164, avg= 2.62, stdev= 6.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=82958, per=206.97%, avg=40084.25, stdev=46183.00
  cpu          : usr=5.75%, sys=1.64%, ctx=980
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,558KiB/s, minb=4,186KiB/s, maxb=4,418KiB/s, mint=23734msec, maxt=25048msec
  WRITE: io=283MiB, aggrb=19,367KiB/s, minb=6,132KiB/s, maxb=6,623KiB/s, mint=23734msec, maxt=25048msec

Disk stats (read/write):
  sda: ios=3162/2668, merge=1031/69774, ticks=116004/1842712, in_queue=1958712, util=96.96%
3.94user 1.30system 0:25.42elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2422minor)pagefaults 0swaps