fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [37.5% done] [  8948/ 51740 kb/s] [eta 00m:05s]
Threads: 3: [mFm] [44.4% done] [  7732/ 33788 kb/s] [eta 00m:05s]
Threads: 3: [FFm] [45.5% done] [   480/  8708 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   380/ 33668 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [71.4% done] [  1732/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [73.3% done] [  6184/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [75.0% done] [  4440/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [81.2% done] [  5896/     0 kb/s] [eta 00m:03s]
Threads: 3: [FVF] [87.5% done] [ 11536/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVF] [93.8% done] [  4432/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVF] [94.1% done] [  7500/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVF] [100.0% done] [  7888/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [  9604/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [  5828/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [ 16744/     0 kb/s] [eta 00m:10s]
Threads: 2: [V_V] [70.0% done] [ 25720/     0 kb/s] [eta 00m:09s]
Threads: 2: [V_V] [78.6% done] [ 27124/     0 kb/s] [eta 00m:06s]
Threads: 2: [V_V] [88.5% done] [ 28936/     0 kb/s] [eta 00m:03s]
Threads: 2: [V_V] [100.0% done] [ 35896/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 32872/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 28572/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17330
  read : io=100MiB, bw=3,918KiB/s, runt= 26758msec
    slat (msec): min=   38, max=22711, avg=17686.25, stdev=6325.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=22825, per=84.08%, avg=9846.11, stdev=6943.37
  write: io=87,244KiB, bw=4,505KiB/s, runt= 19827msec
    slat (msec): min=    0, max=   49, avg= 2.12, stdev= 2.69
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=84441, per=200.35%, avg=28185.00, stdev=48719.16
  cpu          : usr=4.74%, sys=1.49%, ctx=1011
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17331
  read : io=100MiB, bw=4,999KiB/s, runt= 20974msec
    slat (msec): min=  168, max=18601, avg=14071.10, stdev=4042.72
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=18435, per=63.67%, avg=7456.23, stdev=4092.32
  write: io=96,284KiB, bw=10,514KiB/s, runt=  9377msec
    slat (msec): min=    0, max=   21, avg= 2.05, stdev= 2.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=90754, per=322.55%, avg=45377.00, stdev=64172.77
  cpu          : usr=6.45%, sys=1.95%, ctx=831
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17332
  read : io=100MiB, bw=3,903KiB/s, runt= 26861msec
    slat (msec): min=   64, max=20939, avg=16423.01, stdev=5916.48
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=20889, per=75.02%, avg=8785.30, stdev=7637.25
  write: io=88,872KiB, bw=4,590KiB/s, runt= 19823msec
    slat (msec): min=    0, max=  152, avg= 2.87, stdev=11.70
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=100739, per=239.04%, avg=33628.33, stdev=58119.59
  cpu          : usr=4.18%, sys=1.47%, ctx=981
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,711KiB/s, minb=3,903KiB/s, maxb=4,999KiB/s, mint=20974msec, maxt=26861msec
  WRITE: io=266MiB, aggrb=14,068KiB/s, minb=4,505KiB/s, maxb=10,514KiB/s, mint=20974msec, maxt=26861msec

Disk stats (read/write):
  sda: ios=3468/2307, merge=1416/65636, ticks=79396/2437600, in_queue=2539644, util=98.59%
3.76user 1.22system 0:27.08elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2431minor)pagefaults 0swaps