fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [42.9% done] [  3058/ 75247 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [44.4% done] [   376/ 24492 kb/s] [eta 00m:05s]
Threads: 3: [FFm] [45.5% done] [   819/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [  1309/ 36430 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [   811/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 20136/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.0% done] [ 35056/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 29374/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 30464/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 31179/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [91.3% done] [ 29032/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 34189/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 36181/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4488
  read : io=100MiB, bw=4,301KiB/s, runt= 24376msec
    slat (msec): min=  157, max=21227, avg=18207.90, stdev=4257.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=39105, per=79.67%, avg=10281.35, stdev=10762.73
  write: io=93,824KiB, bw=6,448KiB/s, runt= 14900msec
    slat (msec): min=    0, max=   11, avg= 1.79, stdev= 1.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=52359, per=134.54%, avg=26179.50, stdev=37023.40
  cpu          : usr=5.12%, sys=1.39%, ctx=933
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4489
  read : io=100MiB, bw=4,490KiB/s, runt= 23352msec
    slat (msec): min=  141, max=21227, avg=16580.47, stdev=3797.66
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=20330, per=74.67%, avg=9636.31, stdev=6394.44
  write: io=98,144KiB, bw=6,761KiB/s, runt= 14864msec
    slat (msec): min=    0, max=   16, avg= 2.03, stdev= 2.15
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=32291, per=82.97%, avg=16145.50, stdev=22833.19
  cpu          : usr=5.48%, sys=1.54%, ctx=930
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4490
  read : io=100MiB, bw=4,458KiB/s, runt= 23521msec
    slat (msec): min=   53, max=17594, avg=12662.52, stdev=4251.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   21, max=17993, per=60.00%, avg=7742.59, stdev=6071.45
  write: io=91,188KiB, bw=6,283KiB/s, runt= 14860msec
    slat (msec): min=    0, max=   12, avg= 1.77, stdev= 1.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=11312, per=29.07%, avg=5656.00, stdev=7998.79
  cpu          : usr=5.22%, sys=1.60%, ctx=1107
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,905KiB/s, minb=4,301KiB/s, maxb=4,490KiB/s, mint=23352msec, maxt=24376msec
  WRITE: io=277MiB, aggrb=19,459KiB/s, minb=6,283KiB/s, maxb=6,761KiB/s, mint=23352msec, maxt=24376msec

Disk stats (read/write):
  sda: ios=3304/1881, merge=1378/68840, ticks=103440/1758764, in_queue=1862344, util=98.73%
3.81user 1.16system 0:24.69elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2417minor)pagefaults 0swaps