fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [   102/ 58017 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  7928/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.2% done] [ 30436/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.0% done] [ 34154/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 28904/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [90.5% done] [ 36974/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.2% done] [ 37329/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 37584/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 26702/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36032/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=25344
  read : io=100MiB, bw=4,332KiB/s, runt= 24205msec
    slat (msec): min=  188, max=22740, avg=18203.59, stdev=3026.15
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=19369, per=81.07%, avg=10536.31, stdev=5843.90
  write: io=99MiB, bw=7,036KiB/s, runt= 14718msec
    slat (msec): min=    0, max=   11, avg= 1.81, stdev= 1.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114753, per=278.00%, avg=57376.50, stdev=81142.62
  cpu          : usr=5.30%, sys=1.54%, ctx=783
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25345
  read : io=100MiB, bw=4,350KiB/s, runt= 24101msec
    slat (msec): min=   64, max=21766, avg=17686.20, stdev=3945.64
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=23059, per=68.15%, avg=8857.00, stdev=6108.62
  write: io=96,864KiB, bw=6,749KiB/s, runt= 14696msec
    slat (msec): min=    0, max=   76, avg= 2.40, stdev= 4.10
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116219, per=206.04%, avg=42524.25, stdev=55240.85
  cpu          : usr=5.88%, sys=1.73%, ctx=816
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25346
  read : io=100MiB, bw=4,367KiB/s, runt= 24008msec
    slat (msec): min=   48, max=21236, avg=16580.12, stdev=3471.75
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   19, max=22206, per=71.60%, avg=9304.63, stdev=6812.23
  write: io=98,652KiB, bw=6,875KiB/s, runt= 14692msec
    slat (msec): min=    0, max=   50, avg= 2.62, stdev= 4.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=98674, per=198.82%, avg=41033.50, stdev=49217.15
  cpu          : usr=5.96%, sys=1.87%, ctx=831
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,996KiB/s, minb=4,332KiB/s, maxb=4,367KiB/s, mint=24008msec, maxt=24205msec
  WRITE: io=290MiB, aggrb=20,639KiB/s, minb=6,749KiB/s, maxb=7,036KiB/s, mint=24008msec, maxt=24205msec

Disk stats (read/write):
  sda: ios=3020/2474, merge=1625/71493, ticks=65604/1847596, in_queue=1920160, util=96.95%
4.18user 1.26system 0:24.49elapsed 22%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2425minor)pagefaults 0swaps