fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [37.5% done] [ 10517/ 94970 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [57.1% done] [  4337/103979 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/ 17577 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  2206/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 23702/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 33720/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 25853/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 30469/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.5% done] [ 34662/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [91.7% done] [ 21535/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 36748/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 31819/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=5116
  read : io=100MiB, bw=4,102KiB/s, runt= 25560msec
    slat (msec): min=   83, max=21418, avg=17606.47, stdev=5119.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=33814, per=67.56%, avg=8314.55, stdev=7863.34
  write: io=90,240KiB, bw=5,789KiB/s, runt= 15960msec
    slat (msec): min=    0, max=   15, avg= 1.71, stdev= 1.88
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=39846, per=113.42%, avg=19923.00, stdev=28175.38
  cpu          : usr=5.09%, sys=1.13%, ctx=1024
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5117
  read : io=100MiB, bw=4,266KiB/s, runt= 24577msec
    slat (msec): min=    1, max=21198, avg=15820.77, stdev=4517.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=16903, per=73.48%, avg=9043.22, stdev=5507.99
  write: io=91,768KiB, bw=5,890KiB/s, runt= 15952msec
    slat (msec): min=    0, max=  256, avg= 1.97, stdev= 9.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=118038, per=286.16%, avg=50267.00, stdev=60934.68
  cpu          : usr=4.93%, sys=1.33%, ctx=1019
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5118
  read : io=100MiB, bw=4,197KiB/s, runt= 24978msec
    slat (msec): min=   71, max=21083, avg=15758.11, stdev=5062.85
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=20673, per=66.91%, avg=8234.80, stdev=5441.47
  write: io=91,784KiB, bw=5,888KiB/s, runt= 15960msec
    slat (msec): min=    0, max=   74, avg= 1.90, stdev= 4.45
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=99662, per=189.48%, avg=33283.33, stdev=57485.69
  cpu          : usr=5.11%, sys=1.12%, ctx=1178
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,307KiB/s, minb=4,102KiB/s, maxb=4,266KiB/s, mint=24577msec, maxt=25560msec
  WRITE: io=267MiB, aggrb=17,566KiB/s, minb=5,789KiB/s, maxb=5,890KiB/s, mint=24577msec, maxt=25560msec

Disk stats (read/write):
  sda: ios=3501/1990, merge=1333/66315, ticks=102468/1809364, in_queue=1913504, util=99.02%
3.85user 0.93system 0:25.91elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2426minor)pagefaults 0swaps