fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [10.7% done] [ 13968/  6312 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [15.4% done] [ 11248/  8620 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [20.0% done] [ 13584/  4136 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [22.2% done] [ 13260/  4592 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [25.9% done] [ 13660/  1256 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [28.6% done] [ 11204/  2908 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [33.3% done] [  8248/  7232 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [37.0% done] [  9052/  4996 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [40.7% done] [ 12496/  2684 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.4% done] [  7744/  6976 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [46.4% done] [ 10412/  2376 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [48.3% done] [  8328/  4504 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [51.7% done] [  4632/  6832 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.3% done] [  9464/  2232 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [56.7% done] [  7456/  3904 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [60.0% done] [  4620/  5376 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [61.3% done] [  4412/  4924 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [62.5% done] [ 10816/     0 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [65.6% done] [  5984/  2572 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [66.7% done] [  7392/  2696 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [71.9% done] [ 18260/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [77.4% done] [ 18736/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [78.1% done] [ 18704/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [81.2% done] [ 17656/     0 kb/s] [eta 00m:06s]
Threads: 2: [_VV] [87.1% done] [ 17576/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=21796
  read : io=100MiB, bw=3,879KiB/s, runt= 27027msec
    slat (msec): min=    0, max= 5055, avg=896.50, stdev=1447.90
    clat (msec): min=    1, max=  829, avg=88.36, stdev=89.75
    bw (KiB/s) : min=   13, max=10787, per=37.32%, avg=4204.30, stdev=2834.41
  write: io=32,100KiB, bw=1,492KiB/s, runt= 22025msec
    slat (msec): min=    0, max=    5, avg= 0.10, stdev= 0.42
    clat (msec): min=    0, max=  927, avg=116.14, stdev=133.02
    bw (KiB/s) : min=    0, max= 6230, per=45.32%, avg=2136.93, stdev=1907.07
  cpu          : usr=3.64%, sys=0.19%, ctx=1809
  IO depths    : 1=0.1%, 2=0.2%, 4=12.6%, 8=87.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.5%, 10=3.8%, 20=12.5%, 50=25.1%, 100=23.3%
     lat (msec): 250=27.2%, 500=6.0%, 750=0.8%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21797
  read : io=100MiB, bw=3,755KiB/s, runt= 27923msec
    slat (msec): min=    0, max= 7076, avg=1558.24, stdev=2456.12
    clat (msec): min=    3, max=  562, avg=85.43, stdev=83.63
    bw (KiB/s) : min=   30, max=18932, per=38.79%, avg=4370.14, stdev=3416.75
  write: io=35,832KiB, bw=1,759KiB/s, runt= 20849msec
    slat (msec): min=    0, max=    2, avg= 0.04, stdev= 0.24
    clat (msec): min=    0, max=  862, avg=116.70, stdev=124.81
    bw (KiB/s) : min=    0, max= 7630, per=52.39%, avg=2470.00, stdev=2085.93
  cpu          : usr=3.14%, sys=0.20%, ctx=1875
  IO depths    : 1=0.1%, 2=0.2%, 4=12.2%, 8=87.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.3%, 10=3.3%, 20=12.3%, 50=23.3%, 100=27.7%
     lat (msec): 250=25.1%, 500=6.6%, 750=0.5%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21798
  read : io=100MiB, bw=3,806KiB/s, runt= 27549msec
    slat (msec): min=    0, max= 5424, avg=967.30, stdev=1672.89
    clat (msec): min=    2, max=  591, avg=97.25, stdev=82.50
    bw (KiB/s) : min=   30, max= 9358, per=34.30%, avg=3863.33, stdev=2312.29
  write: io=34,128KiB, bw=1,576KiB/s, runt= 22165msec
    slat (msec): min=    0, max=   14, avg= 0.15, stdev= 1.03
    clat (msec): min=    0, max=  908, avg=92.44, stdev=106.01
    bw (KiB/s) : min=    0, max=12099, per=52.44%, avg=2472.62, stdev=3067.84
  cpu          : usr=3.63%, sys=0.26%, ctx=1865
  IO depths    : 1=0.1%, 2=0.2%, 4=12.8%, 8=86.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.7%, 4=0.4%, 10=3.6%, 20=9.4%, 50=22.2%, 100=25.5%
     lat (msec): 250=31.0%, 500=5.6%, 750=0.3%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,265KiB/s, minb=3,755KiB/s, maxb=3,879KiB/s, mint=27027msec, maxt=27923msec
  WRITE: io=100MiB, aggrb=4,715KiB/s, minb=1,492KiB/s, maxb=1,759KiB/s, mint=27027msec, maxt=27923msec

Disk stats (read/write):
  sda: ios=5101/1742, merge=1391/324, ticks=480532/208768, in_queue=689308, util=99.54%
2.91user 0.26system 0:28.20elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2392minor)pagefaults 0swaps