fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [6.5% done] [  9924/  1552 kb/s] [eta 00m:43s]
Threads: 3: [mmm] [9.5% done] [  8820/  2392 kb/s] [eta 00m:38s]
Threads: 3: [mmm] [11.6% done] [  7308/  7516 kb/s] [eta 00m:38s]
Threads: 3: [mmm] [13.6% done] [  6600/  6784 kb/s] [eta 00m:38s]
Threads: 3: [mmm] [15.6% done] [  8344/  1892 kb/s] [eta 00m:38s]
Threads: 3: [mmm] [17.8% done] [  9072/  2440 kb/s] [eta 00m:37s]
Threads: 3: [mmm] [20.0% done] [  6456/  3812 kb/s] [eta 00m:36s]
Threads: 3: [mmm] [22.7% done] [  8744/  2576 kb/s] [eta 00m:34s]
Threads: 3: [mmm] [25.0% done] [  7134/  3030 kb/s] [eta 00m:33s]
Threads: 3: [mmm] [27.3% done] [  9168/  1556 kb/s] [eta 00m:32s]
Threads: 3: [mmm] [28.3% done] [  5196/  4756 kb/s] [eta 00m:33s]
Threads: 3: [mmm] [31.1% done] [  3104/  6596 kb/s] [eta 00m:31s]
Threads: 3: [mmm] [33.3% done] [  8692/   988 kb/s] [eta 00m:30s]
Threads: 3: [mmm] [34.8% done] [  7320/  1436 kb/s] [eta 00m:30s]
Threads: 3: [mmm] [37.0% done] [  8756/   804 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [38.3% done] [  5604/  2800 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [40.4% done] [  4780/  2896 kb/s] [eta 00m:28s]
Threads: 3: [mmm] [41.7% done] [  7008/  1968 kb/s] [eta 00m:28s]
Threads: 3: [mmm] [43.8% done] [  9000/     0 kb/s] [eta 00m:27s]
Threads: 3: [mmm] [46.8% done] [  5616/  3724 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [48.9% done] [  4056/  3848 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [49.0% done] [  6756/  1604 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [50.0% done] [  5356/  3132 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [50.0% done] [  7016/  1100 kb/s] [eta 00m:26s]
Threads: 3: [Vmm] [51.9% done] [  4384/  4040 kb/s] [eta 00m:25s]
Threads: 3: [Vmm] [51.9% done] [ 10796/   216 kb/s] [eta 00m:26s]
Threads: 2: [_mm] [52.7% done] [  7860/  1076 kb/s] [eta 00m:26s]
Threads: 2: [_mm] [55.6% done] [  7076/     0 kb/s] [eta 00m:24s]
Threads: 2: [_mm] [57.4% done] [  5056/  1616 kb/s] [eta 00m:23s]
Threads: 2: [_mm] [58.2% done] [  7020/     0 kb/s] [eta 00m:23s]
Threads: 2: [_mV] [57.9% done] [ 11488/   288 kb/s] [eta 00m:24s]
Threads: 2: [_mV] [58.6% done] [ 17460/   400 kb/s] [eta 00m:24s]
Threads: 2: [_mV] [58.3% done] [ 11700/   328 kb/s] [eta 00m:25s]
Threads: 1: [_m_] [62.1% done] [  4020/  5340 kb/s] [eta 00m:22s]
Threads: 1: [_V_] [67.3% done] [  3804/  4008 kb/s] [eta 00m:18s]
Threads: 1: [_V_] [76.0% done] [ 14172/     0 kb/s] [eta 00m:12s]
Threads: 1: [_V_] [86.7% done] [ 15876/     0 kb/s] [eta 00m:06s]
fio: (groupid=0): err= 0: pid=5113
  read : io=100MiB, bw=3,594KiB/s, runt= 29175msec
    slat (msec): min=    3, max= 2129, avg=337.61, stdev=504.91
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   70, max=12328, per=50.00%, avg=3901.00, stdev=2836.39
  write: io=18,820KiB, bw=707KiB/s, runt= 27225msec
    slat (msec): min=   20, max=  332, avg=128.20, stdev=59.34
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 5027, per=67.27%, avg=1793.36, stdev=1952.05
  cpu          : usr=2.89%, sys=0.59%, ctx=2196
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.8%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5114
  read : io=100MiB, bw=2,600KiB/s, runt= 40318msec
    slat (msec): min=   11, max= 2627, avg=808.62, stdev=813.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   59, max=19033, per=40.43%, avg=3154.16, stdev=3959.67
  write: io=37,756KiB, bw=1,025KiB/s, runt= 37712msec
    slat (msec): min=    0, max=  907, avg=115.88, stdev=147.06
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 7872, per=57.97%, avg=1545.42, stdev=1917.29
  cpu          : usr=2.41%, sys=0.67%, ctx=2756
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.8%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5115
  read : io=100MiB, bw=2,914KiB/s, runt= 35981msec
    slat (msec): min=    0, max= 2967, avg=558.91, stdev=800.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   32, max=18314, per=46.96%, avg=3663.98, stdev=4205.99
  write: io=41,632KiB, bw=1,290KiB/s, runt= 33039msec
    slat (msec): min=   51, max=  837, avg=180.91, stdev=123.67
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max= 6378, per=74.92%, avg=1997.48, stdev=1693.04
  cpu          : usr=2.89%, sys=0.72%, ctx=2654
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=7,802KiB/s, minb=2,600KiB/s, maxb=3,594KiB/s, mint=29175msec, maxt=40318msec
  WRITE: io=98,208KiB, aggrb=2,666KiB/s, minb=707KiB/s, maxb=1,290KiB/s, mint=29175msec, maxt=40318msec

Disk stats (read/write):
  sda: ios=5967/1848, merge=951/22790, ticks=94980/37392, in_queue=132372, util=98.87%
2.88user 0.80system 0:40.96elapsed 9%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2439minor)pagefaults 0swaps