fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [ 13981/  4552 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [15.4% done] [  9282/ 10606 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [19.2% done] [ 17364/   673 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [24.0% done] [  8534/  6644 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [28.0% done] [ 11618/  6782 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [30.8% done] [ 11395/  2538 kb/s] [eta 00m:18s]
Threads: 3: [mmm] [34.6% done] [  9928/  5024 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [38.5% done] [ 16132/     0 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [40.7% done] [  9984/  4632 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [44.4% done] [  9792/  3912 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [46.4% done] [  8032/  5512 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [50.0% done] [  1120/ 11600 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [53.6% done] [  4488/  7432 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [55.2% done] [  4372/  7424 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [58.6% done] [  8308/  2536 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [60.0% done] [  7952/  2096 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [63.3% done] [  6584/  3376 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [64.5% done] [  7408/  2124 kb/s] [eta 00m:11s]
Threads: 3: [mVm] [65.6% done] [ 13540/   776 kb/s] [eta 00m:11s]
Threads: 3: [mVm] [66.7% done] [ 12648/  1064 kb/s] [eta 00m:11s]
Threads: 3: [mVm] [67.6% done] [ 14692/   252 kb/s] [eta 00m:11s]
Threads: 2: [V_V] [70.6% done] [ 17384/     0 kb/s] [eta 00m:10s]
Threads: 2: [V_V] [73.5% done] [ 19708/     0 kb/s] [eta 00m:09s]
Threads: 2: [V_V] [81.2% done] [ 19344/     0 kb/s] [eta 00m:06s]
Threads: 1: [V_E] [93.1% done] [ 20548/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=16272
  read : io=100MiB, bw=3,779KiB/s, runt= 27747msec
    slat (msec): min=    0, max= 5515, avg=1399.70, stdev=1897.39
    clat (msec): min=    0, max=  841, avg=88.23, stdev=99.77
    bw (KiB/s) : min=   11, max=19694, per=40.03%, avg=4538.70, stdev=4100.98
  write: io=39,872KiB, bw=1,780KiB/s, runt= 22928msec
    slat (msec): min=    0, max=    9, avg= 0.14, stdev= 0.65
    clat (msec): min=    0, max=  952, avg=109.27, stdev=119.54
    bw (KiB/s) : min=    0, max=10464, per=60.92%, avg=2932.80, stdev=2673.28
  cpu          : usr=3.73%, sys=0.20%, ctx=1803
  IO depths    : 1=0.1%, 2=0.2%, 4=13.2%, 8=86.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.9%, 4=1.1%, 10=4.8%, 20=14.0%, 50=21.7%, 100=22.8%
     lat (msec): 250=28.7%, 500=4.6%, 750=0.8%, 1000=0.5%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16273
  read : io=100MiB, bw=4,384KiB/s, runt= 23914msec
    slat (msec): min=    0, max= 3370, avg=608.79, stdev=1009.46
    clat (msec): min=    1, max=  412, avg=72.46, stdev=59.96
    bw (KiB/s) : min=    8, max=16644, per=42.27%, avg=4791.92, stdev=4289.59
  write: io=38,956KiB, bw=1,932KiB/s, runt= 20643msec
    slat (msec): min=    0, max=    6, avg= 0.12, stdev= 0.60
    clat (msec): min=    0, max=  828, avg=116.60, stdev=126.88
    bw (KiB/s) : min=    0, max=11216, per=56.87%, avg=2737.92, stdev=2433.26
  cpu          : usr=3.98%, sys=0.18%, ctx=1837
  IO depths    : 1=0.1%, 2=0.2%, 4=13.5%, 8=86.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.4%, 4=0.7%, 10=2.2%, 20=11.5%, 50=26.1%, 100=28.9%
     lat (msec): 250=25.1%, 500=3.5%, 750=0.3%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16274
  read : io=100MiB, bw=3,794KiB/s, runt= 27636msec
    slat (msec): min=    0, max= 3380, avg=526.37, stdev=928.32
    clat (msec): min=    4, max=  832, avg=92.98, stdev=90.63
    bw (KiB/s) : min=   23, max=16040, per=39.15%, avg=4437.88, stdev=3393.26
  write: io=31,900KiB, bw=1,387KiB/s, runt= 23550msec
    slat (msec): min=    0, max=    4, avg= 0.07, stdev= 0.33
    clat (msec): min=    0, max=  818, avg=119.47, stdev=113.13
    bw (KiB/s) : min=    0, max= 5870, per=57.83%, avg=2784.15, stdev=2207.46
  cpu          : usr=3.29%, sys=0.33%, ctx=1843
  IO depths    : 1=0.1%, 2=0.2%, 4=10.5%, 8=89.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.7%, 4=0.2%, 10=3.2%, 20=10.9%, 50=20.3%, 100=25.1%
     lat (msec): 250=34.9%, 500=3.2%, 750=0.8%, 1000=0.4%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,337KiB/s, minb=3,779KiB/s, maxb=4,384KiB/s, mint=23914msec, maxt=27747msec
  WRITE: io=108MiB, aggrb=4,814KiB/s, minb=1,387KiB/s, maxb=1,932KiB/s, mint=23914msec, maxt=27747msec

Disk stats (read/write):
  sda: ios=5053/1843, merge=1294/461, ticks=443780/237440, in_queue=681220, util=99.48%
2.92user 0.26system 0:28.03elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2391minor)pagefaults 0swaps