fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [15.0% done] [ 12820/ 14492 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [21.1% done] [ 18172/  4480 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [25.0% done] [ 14248/  7784 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [30.0% done] [ 17460/  5164 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [35.0% done] [ 10596/  9308 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.0% done] [ 10872/  8408 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [42.9% done] [ 17304/  1656 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [47.6% done] [ 16760/  1552 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.4% done] [ 11668/  3896 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [54.5% done] [  9220/  5280 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [59.1% done] [ 10436/  3588 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [60.9% done] [  9356/  3664 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [62.5% done] [  7064/  3084 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  5556/  4308 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [68.0% done] [  7844/  4460 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [75.0% done] [ 22924/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [79.2% done] [ 21472/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [83.3% done] [ 17984/     0 kb/s] [eta 00m:04s]
Threads: 2: [V_V] [87.5% done] [ 17964/     0 kb/s] [eta 00m:03s]
fio: (groupid=0): err= 0: pid=22533
  read : io=100MiB, bw=4,869KiB/s, runt= 21534msec
    slat (msec): min=    0, max= 5181, avg=1084.00, stdev=1707.60
    clat (msec): min=    0, max=  831, avg=74.59, stdev=75.33
    bw (KiB/s) : min=   16, max=12328, per=37.44%, avg=5468.83, stdev=3133.23
  write: io=33,288KiB, bw=2,084KiB/s, runt= 16350msec
    slat (msec): min=    0, max=    4, avg= 0.06, stdev= 0.34
    clat (msec): min=    0, max=  787, avg=84.30, stdev=100.42
    bw (KiB/s) : min=    0, max= 8080, per=65.19%, avg=3496.35, stdev=2703.42
  cpu          : usr=4.38%, sys=0.41%, ctx=1744
  IO depths    : 1=0.1%, 2=0.2%, 4=12.7%, 8=86.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.3%, 4=0.9%, 10=4.4%, 20=13.1%, 50=29.5%, 100=25.9%
     lat (msec): 250=21.0%, 500=3.4%, 750=0.3%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22534
  read : io=100MiB, bw=5,000KiB/s, runt= 20968msec
    slat (msec): min=    0, max= 5373, avg=1005.30, stdev=1689.07
    clat (msec): min=    2, max=  669, avg=74.90, stdev=71.19
    bw (KiB/s) : min=   13, max=13751, per=37.56%, avg=5487.27, stdev=3523.42
  write: io=27,612KiB, bw=1,793KiB/s, runt= 15769msec
    slat (msec): min=    0, max=    3, avg= 0.03, stdev= 0.22
    clat (msec): min=    0, max= 1025, avg=79.98, stdev=102.79
    bw (KiB/s) : min=    0, max= 9695, per=58.05%, avg=3113.00, stdev=3201.28
  cpu          : usr=4.64%, sys=0.25%, ctx=1726
  IO depths    : 1=0.1%, 2=0.2%, 4=11.1%, 8=88.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.7%, 4=0.9%, 10=3.8%, 20=12.1%, 50=29.6%, 100=27.2%
     lat (msec): 250=20.9%, 500=3.4%, 750=0.3%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22535
  read : io=100MiB, bw=4,894KiB/s, runt= 21424msec
    slat (msec): min=    0, max= 4489, avg=704.81, stdev=1311.46
    clat (msec): min=    1, max=  382, avg=79.89, stdev=68.11
    bw (KiB/s) : min=  128, max=11063, per=34.18%, avg=4992.70, stdev=2771.15
  write: io=27,992KiB, bw=1,689KiB/s, runt= 16970msec
    slat (msec): min=    0, max=    7, avg= 0.13, stdev= 0.74
    clat (msec): min=    0, max=  815, avg=72.40, stdev=107.45
    bw (KiB/s) : min=    0, max=11084, per=50.06%, avg=2684.81, stdev=3215.41
  cpu          : usr=4.76%, sys=0.34%, ctx=1798
  IO depths    : 1=0.1%, 2=0.2%, 4=11.6%, 8=88.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=2.9%, 4=1.3%, 10=4.0%, 20=11.4%, 50=26.3%, 100=26.1%
     lat (msec): 250=23.6%, 500=4.0%, 750=0.1%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,608KiB/s, minb=4,869KiB/s, maxb=5,000KiB/s, mint=20968msec, maxt=21534msec
  WRITE: io=88,892KiB, aggrb=5,363KiB/s, minb=1,689KiB/s, maxb=2,084KiB/s, mint=20968msec, maxt=21534msec

Disk stats (read/write):
  sda: ios=4515/1515, merge=1361/371, ticks=347348/130892, in_queue=478248, util=99.30%
3.00user 0.22system 0:21.79elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2378minor)pagefaults 0swaps