fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [68.8% done] [   772/     0 kb/s] [eta 00m:05s]
Threads: 3: [FFV] [75.0% done] [  6208/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFV] [68.4% done] [  6396/     0 kb/s] [eta 00m:06s]
Threads: 3: [VFV] [70.0% done] [ 25432/     0 kb/s] [eta 00m:06s]
Threads: 3: [VFV] [78.9% done] [ 26880/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFV] [84.2% done] [ 24284/     0 kb/s] [eta 00m:03s]
Threads: 3: [VFV] [100.0% done] [ 31280/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 29380/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFV] [100.0% done] [ 28056/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [74.1% done] [ 29280/     0 kb/s] [eta 00m:07s]
Threads: 1: [_V_] [95.5% done] [ 36700/     0 kb/s] [eta 00m:01s]
Threads: 1: [_V_] [100.0% done] [ 33876/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=22710
  read : io=100MiB, bw=5,063KiB/s, runt= 20707msec
    slat (msec): min=12295, max=19533, avg=16597.88, stdev=1768.39
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=26540, per=98.67%, avg=13477.57, stdev=7591.44
  write: io=100MiB, bw=8,017KiB/s, runt= 13079msec
    slat (msec): min=    0, max=   17, avg= 2.36, stdev= 2.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111344, per=364.18%, avg=57839.33, stdev=55798.42
  cpu          : usr=7.07%, sys=1.93%, ctx=762
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22711
  read : io=100MiB, bw=4,553KiB/s, runt= 23029msec
    slat (msec): min=   60, max=21331, avg=19669.76, stdev=2751.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    9, max=38366, per=154.41%, avg=21090.50, stdev=16722.87
  write: io=99,320KiB, bw=5,186KiB/s, runt= 19608msec
    slat (msec): min=    0, max=   73, avg= 2.54, stdev= 4.43
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117451, per=270.65%, avg=42985.00, stdev=55587.34
  cpu          : usr=6.17%, sys=1.93%, ctx=893
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22712
  read : io=100MiB, bw=5,363KiB/s, runt= 19549msec
    slat (msec): min=10132, max=18618, avg=14855.77, stdev=2312.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=25043, per=80.14%, avg=10946.67, stdev=6424.21
  write: io=100MiB, bw=9,784KiB/s, runt= 10717msec
    slat (msec): min=    0, max=   13, avg= 1.81, stdev= 1.91
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117465, per=369.81%, avg=58732.50, stdev=83060.30
  cpu          : usr=6.47%, sys=2.01%, ctx=752
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,659KiB/s, minb=4,553KiB/s, maxb=5,363KiB/s, mint=19549msec, maxt=23029msec
  WRITE: io=297MiB, aggrb=15,882KiB/s, minb=5,186KiB/s, maxb=9,784KiB/s, mint=19549msec, maxt=23029msec

Disk stats (read/write):
  sda: ios=2916/2104, merge=947/73569, ticks=56512/2286016, in_queue=2417128, util=95.95%
4.19user 1.27system 0:23.41elapsed 23%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps