fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [42.9% done] [  8688/122024 kb/s] [eta 00m:04s]
Threads: 3: [mFF] [44.4% done] [  1276/  5340 kb/s] [eta 00m:05s]
Threads: 3: [mFF] [41.7% done] [  1560/     0 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [42.9% done] [  1228/     0 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [50.0% done] [  1144/  9920 kb/s] [eta 00m:07s]
Threads: 3: [FFF] [100.0% done] [     0/ 26336 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [75.0% done] [ 10596/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [86.7% done] [ 12680/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVF] [93.3% done] [  9776/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVF] [100.0% done] [ 10884/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [ 11539/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [ 12656/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [100.0% done] [  9504/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [67.9% done] [ 15212/     0 kb/s] [eta 00m:09s]
Threads: 2: [V_V] [74.1% done] [ 20392/     0 kb/s] [eta 00m:07s]
Threads: 2: [V_V] [84.0% done] [ 29784/     0 kb/s] [eta 00m:04s]
Threads: 2: [V_V] [91.7% done] [ 33196/     0 kb/s] [eta 00m:02s]
Threads: 2: [V_V] [100.0% done] [ 36316/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 32296/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [100.0% done] [ 24988/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1060
  read : io=100MiB, bw=4,148KiB/s, runt= 25277msec
    slat (msec): min=   49, max=18009, avg=13691.40, stdev=5194.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=22407, per=64.51%, avg=7933.76, stdev=7576.93
  write: io=90,040KiB, bw=4,839KiB/s, runt= 19052msec
    slat (msec): min=    0, max=  211, avg= 2.17, stdev= 9.54
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=78592, per=178.20%, avg=26202.33, stdev=45370.78
  cpu          : usr=5.03%, sys=1.25%, ctx=1096
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1061
  read : io=100MiB, bw=5,506KiB/s, runt= 19043msec
    slat (msec): min=  102, max=16296, avg=12086.84, stdev=3546.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   22, max=20980, per=84.34%, avg=10373.11, stdev=4781.24
  write: io=91,692KiB, bw=8,435KiB/s, runt= 11131msec
    slat (msec): min=    0, max=   11, avg= 1.71, stdev= 1.87
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=115291, per=392.04%, avg=57645.50, stdev=81523.05
  cpu          : usr=6.11%, sys=2.27%, ctx=948
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1062
  read : io=100MiB, bw=4,099KiB/s, runt= 25577msec
    slat (msec): min=   24, max=22595, avg=18316.05, stdev=5377.15
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=20749, per=85.46%, avg=10510.29, stdev=6909.25
  write: io=91,848KiB, bw=4,970KiB/s, runt= 18924msec
    slat (msec): min=    0, max=   27, avg= 1.98, stdev= 2.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=110457, per=250.79%, avg=36876.67, stdev=63722.50
  cpu          : usr=4.61%, sys=1.28%, ctx=959
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,299KiB/s, minb=4,099KiB/s, maxb=5,506KiB/s, mint=19043msec, maxt=25577msec
  WRITE: io=267MiB, aggrb=14,704KiB/s, minb=4,839KiB/s, maxb=8,435KiB/s, mint=19043msec, maxt=25577msec

Disk stats (read/write):
  sda: ios=3561/1833, merge=1287/66520, ticks=62452/2270380, in_queue=2335012, util=98.06%
3.67user 1.08system 0:26.19elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2421minor)pagefaults 0swaps