fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [ 14189/  5575 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [14.8% done] [ 16343/  3644 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [19.2% done] [ 17238/     0 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [23.1% done] [ 16020/  1316 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [25.0% done] [ 11440/  2056 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [28.6% done] [ 13468/  1472 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [31.0% done] [ 10524/  5024 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [33.3% done] [ 10460/  6184 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [36.7% done] [ 11600/  1544 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [40.0% done] [  6300/  8200 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [41.9% done] [  5828/  7612 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [45.2% done] [ 11536/  1968 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [48.4% done] [  4100/  7376 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [50.0% done] [  6456/  5484 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [53.1% done] [  9788/  1056 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [56.2% done] [ 10144/  1108 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [57.6% done] [  5856/  3856 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [58.8% done] [  6320/  2216 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [61.8% done] [  4440/  4028 kb/s] [eta 00m:13s]
Threads: 3: [VVV] [68.8% done] [  2220/  7116 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [71.9% done] [ 18404/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.0% done] [ 18636/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [78.1% done] [ 16996/     0 kb/s] [eta 00m:07s]
Threads: 1: [V__] [89.7% done] [ 16040/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=30529
  read : io=100MiB, bw=3,874KiB/s, runt= 27066msec
    slat (msec): min=    0, max= 4969, avg=1477.71, stdev=1847.62
    clat (msec): min=    0, max=  529, avg=75.82, stdev=79.63
    bw (KiB/s) : min=    5, max=17501, per=39.64%, avg=4607.36, stdev=4087.45
  write: io=45,108KiB, bw=2,077KiB/s, runt= 22229msec
    slat (msec): min=    0, max=   12, avg= 0.12, stdev= 0.78
    clat (msec): min=    0, max=  926, avg=95.15, stdev=133.33
    bw (KiB/s) : min=    0, max= 9606, per=70.57%, avg=2660.43, stdev=2337.29
  cpu          : usr=3.86%, sys=0.18%, ctx=1923
  IO depths    : 1=0.1%, 2=0.2%, 4=18.7%, 8=81.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.9%, 4=1.3%, 10=7.1%, 20=18.5%, 50=23.7%, 100=18.5%
     lat (msec): 250=22.3%, 500=5.7%, 750=0.6%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30530
  read : io=100MiB, bw=4,011KiB/s, runt= 26140msec
    slat (msec): min=    0, max= 5095, avg=801.37, stdev=1520.12
    clat (msec): min=    4, max=  513, avg=94.20, stdev=77.43
    bw (KiB/s) : min=   37, max= 8601, per=38.19%, avg=4438.19, stdev=2010.99
  write: io=20,376KiB, bw=965KiB/s, runt= 21609msec
    slat (msec): min=    0, max=    2, avg= 0.05, stdev= 0.27
    clat (msec): min=    0, max=  994, avg=97.67, stdev=108.03
    bw (KiB/s) : min=    0, max= 4811, per=58.37%, avg=2200.47, stdev=2015.72
  cpu          : usr=3.58%, sys=0.20%, ctx=1837
  IO depths    : 1=0.1%, 2=0.2%, 4=9.1%, 8=90.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.2%, 10=3.4%, 20=11.4%, 50=21.3%, 100=26.2%
     lat (msec): 250=31.6%, 500=4.8%, 750=0.5%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30531
  read : io=100MiB, bw=4,047KiB/s, runt= 25906msec
    slat (msec): min=    0, max= 5925, avg=838.44, stdev=1710.91
    clat (msec): min=    4, max=  705, avg=98.85, stdev=80.95
    bw (KiB/s) : min=   18, max= 9369, per=38.85%, avg=4514.84, stdev=2327.00
  write: io=16,356KiB, bw=836KiB/s, runt= 20032msec
    slat (msec): min=    0, max=    2, avg= 0.06, stdev= 0.30
    clat (msec): min=    1, max=  545, avg=97.70, stdev=80.38
    bw (KiB/s) : min=    0, max= 4399, per=45.64%, avg=1720.62, stdev=1522.53
  cpu          : usr=3.67%, sys=0.31%, ctx=1673
  IO depths    : 1=0.2%, 2=0.3%, 4=8.7%, 8=90.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=0.3%, 10=1.7%, 20=7.6%, 50=22.5%, 100=29.0%
     lat (msec): 250=32.5%, 500=5.8%, 750=0.2%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,622KiB/s, minb=3,874KiB/s, maxb=4,047KiB/s, mint=25906msec, maxt=27066msec
  WRITE: io=81,840KiB, aggrb=3,770KiB/s, minb=836KiB/s, maxb=2,077KiB/s, mint=25906msec, maxt=27066msec

Disk stats (read/write):
  sda: ios=5114/1643, merge=1322/267, ticks=483996/197728, in_queue=681732, util=99.27%
2.98user 0.28system 0:27.35elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2388minor)pagefaults 0swaps