fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [21.4% done] [   873/ 24856 kb/s] [eta 00m:11s]
Threads: 3: [mFm] [36.4% done] [     0/ 30264 kb/s] [eta 00m:07s]
Threads: 3: [mFm] [35.7% done] [   686/     0 kb/s] [eta 00m:09s]
Threads: 3: [mFm] [35.3% done] [     0/     0 kb/s] [eta 00m:11s]
Threads: 3: [mFm] [36.8% done] [   833/     0 kb/s] [eta 00m:12s]
Threads: 3: [mVm] [36.4% done] [  5827/     0 kb/s] [eta 00m:14s]
Threads: 3: [mVm] [36.0% done] [  5680/     0 kb/s] [eta 00m:16s]
Threads: 3: [mVF] [37.0% done] [  1186/ 38265 kb/s] [eta 00m:17s]
Threads: 3: [mVF] [36.7% done] [   463/     0 kb/s] [eta 00m:19s]
Threads: 3: [mVF] [36.4% done] [     0/     0 kb/s] [eta 00m:21s]
Threads: 3: [mVV] [37.1% done] [ 10731/     0 kb/s] [eta 00m:22s]
Threads: 3: [mVV] [36.8% done] [ 19667/     0 kb/s] [eta 00m:24s]
Threads: 3: [mVV] [37.5% done] [ 34429/     0 kb/s] [eta 00m:25s]
Threads: 3: [mVV] [37.2% done] [ 31439/     0 kb/s] [eta 00m:27s]
Threads: 3: [mVV] [37.8% done] [ 29285/     0 kb/s] [eta 00m:28s]
Threads: 2: [m_V] [38.3% done] [ 34730/     0 kb/s] [eta 00m:29s]
Threads: 2: [m_V] [46.3% done] [ 27455/ 10826 kb/s] [eta 00m:22s]
Threads: 1: [F__] [100.0% done] [  3303/ 32876 kb/s] [eta 00m:00s]
Threads: 1: [F__] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [81.5% done] [ 21724/     0 kb/s] [eta 00m:05s]
Threads: 1: [V__] [100.0% done] [ 39008/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4079
  read : io=100MiB, bw=4,359KiB/s, runt= 24052msec
    slat (msec): min=   81, max= 4713, avg=3370.97, stdev=952.83
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=42472, per=88.40%, avg=11560.75, stdev=17164.33
  write: io=93,860KiB, bw=4,512KiB/s, runt= 21297msec
    slat (msec): min=    0, max=   86, avg= 2.11, stdev= 4.15
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=88906, per=213.90%, avg=29638.33, stdev=51327.31
  cpu          : usr=4.99%, sys=1.78%, ctx=947
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4080
  read : io=100MiB, bw=5,870KiB/s, runt= 17862msec
    slat (msec): min= 6805, max=16880, avg=13901.60, stdev=2480.73
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   27, max=26523, per=92.73%, avg=12127.07, stdev=8170.63
  write: io=100MiB, bw=13,835KiB/s, runt=  7579msec
    slat (msec): min=    0, max=   15, avg= 2.10, stdev= 2.25
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=105269, per=379.87%, avg=52634.50, stdev=74436.42
  cpu          : usr=6.85%, sys=2.51%, ctx=750
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4081
  read : io=100MiB, bw=5,480KiB/s, runt= 19134msec
    slat (msec): min=   62, max= 9824, avg=7158.85, stdev=2298.86
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   50, max=32089, per=79.50%, avg=10396.38, stdev=9025.69
  write: io=91,928KiB, bw=7,503KiB/s, runt= 12546msec
    slat (msec): min=    0, max=   10, avg= 1.92, stdev= 1.86
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 8819, per=31.82%, avg=4409.50, stdev=6235.97
  cpu          : usr=6.48%, sys=1.97%, ctx=937
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,078KiB/s, minb=4,359KiB/s, maxb=5,870KiB/s, mint=17862msec, maxt=24052msec
  WRITE: io=281MiB, aggrb=13,856KiB/s, minb=4,512KiB/s, maxb=13,835KiB/s, mint=17862msec, maxt=24052msec

Disk stats (read/write):
  sda: ios=3283/2500, merge=1142/69498, ticks=75028/1602740, in_queue=1678964, util=97.05%
3.72user 1.32system 0:24.37elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2424minor)pagefaults 0swaps