fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [7.9% done] [  2488/   596 kb/s] [eta 00m:35s]
Threads: 3: [FFm] [8.7% done] [  1268/ 51872 kb/s] [eta 00m:42s]
Threads: 3: [FFm] [9.6% done] [  1380/     0 kb/s] [eta 00m:47s]
Threads: 3: [FFm] [11.1% done] [  1812/   672 kb/s] [eta 00m:48s]
Threads: 3: [FFm] [11.9% done] [  1056/     0 kb/s] [eta 00m:52s]
Threads: 3: [FFm] [13.3% done] [  1064/     0 kb/s] [eta 00m:52s]
Threads: 3: [FFm] [15.0% done] [  1080/     0 kb/s] [eta 00m:51s]
Threads: 3: [FFm] [16.7% done] [  1420/     0 kb/s] [eta 00m:50s]
Threads: 3: [FFm] [18.3% done] [  1488/     0 kb/s] [eta 00m:49s]
Threads: 3: [FFm] [27.3% done] [  1772/ 16092 kb/s] [eta 00m:32s]
Threads: 3: [FFm] [27.7% done] [  1244/     0 kb/s] [eta 00m:34s]
Threads: 3: [FFm] [34.1% done] [  1812/  8228 kb/s] [eta 00m:27s]
Threads: 3: [VVm] [34.9% done] [  9520/     0 kb/s] [eta 00m:28s]
Threads: 3: [VVm] [35.6% done] [ 35348/     0 kb/s] [eta 00m:29s]
Threads: 3: [VVm] [35.4% done] [ 23992/   320 kb/s] [eta 00m:31s]
Threads: 3: [VVm] [36.0% done] [ 39108/     0 kb/s] [eta 00m:32s]
Threads: 3: [VVm] [35.8% done] [ 28340/    84 kb/s] [eta 00m:34s]
Threads: 3: [VVm] [36.4% done] [ 26676/     0 kb/s] [eta 00m:35s]
Threads: 2: [V_m] [36.2% done] [ 29696/     0 kb/s] [eta 00m:37s]
Threads: 1: [__F] [100.0% done] [ 12668/ 46136 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [75.8% done] [ 12640/     0 kb/s] [eta 00m:08s]
Threads: 1: [__V] [92.9% done] [ 25188/     0 kb/s] [eta 00m:02s]
Threads: 1: [__V] [100.0% done] [ 27836/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15016
  read : io=100MiB, bw=4,746KiB/s, runt= 22075msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  711, avg=45.47, stdev=103.18
    bw (KiB/s) : min=    1, max=24438, per=82.49%, avg=9260.05, stdev=8051.19
  write: io=99,512KiB, bw=6,857KiB/s, runt= 14860msec
    slat (msec): min=    0, max=    3, avg= 0.00, stdev= 0.08
    clat (msec): min=    0, max=  563, avg= 1.64, stdev=22.93
    bw (KiB/s) : min=    0, max=14937, per=65.70%, avg=7468.50, stdev=10562.05
  cpu          : usr=4.19%, sys=1.65%, ctx=7041
  IO depths    : 1=1.3%, 2=56.5%, 4=31.1%, 8=11.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.3%, 4=2.1%, 10=22.9%, 20=15.2%, 50=2.9%, 100=0.9%
     lat (msec): 250=5.4%, 500=1.2%, 750=0.9%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15017
  read : io=100MiB, bw=4,875KiB/s, runt= 21494msec
    clat (msec): min=    0, max=  515, avg=31.68, stdev=57.47
    bw (KiB/s) : min=    2, max=23117, per=129.32%, avg=14515.67, stdev=7194.20
  write: io=100MiB, bw=7,050KiB/s, runt= 14872msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=   11, avg= 0.40, stdev= 1.06
    bw (KiB/s) : min=    0, max=83648, per=367.94%, avg=41824.00, stdev=59148.07
  cpu          : usr=4.47%, sys=1.92%, ctx=7082
  IO depths    : 1=2.4%, 2=55.2%, 4=31.5%, 8=10.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.6%, 4=3.1%, 10=21.3%, 20=15.8%, 50=5.2%, 100=1.0%
     lat (msec): 250=5.3%, 500=0.4%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15018
  read : io=100MiB, bw=3,743KiB/s, runt= 28010msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2575, avg=106.03, stdev=265.85
    bw (KiB/s) : min=   58, max=30097, per=38.96%, avg=4373.27, stdev=8505.61
  write: io=73,172KiB, bw=3,023KiB/s, runt= 24780msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 2167, avg=20.58, stdev=145.07
    bw (KiB/s) : min=    0, max=56205, per=68.36%, avg=7770.56, stdev=18436.62
  cpu          : usr=2.04%, sys=1.10%, ctx=8750
  IO depths    : 1=1.1%, 2=49.4%, 4=29.0%, 8=20.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.5%, 4=0.3%, 10=15.0%, 20=19.5%, 50=8.7%, 100=1.8%
     lat (msec): 250=2.2%, 500=2.0%, 750=4.0%, 1000=1.0%, >=2000=0.7%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,225KiB/s, minb=3,743KiB/s, maxb=4,875KiB/s, mint=21494msec, maxt=28010msec
  WRITE: io=269MiB, aggrb=11,367KiB/s, minb=3,023KiB/s, maxb=7,050KiB/s, mint=21494msec, maxt=28010msec

Disk stats (read/write):
  sda: ios=3422/2517, merge=1129/66139, ticks=87488/2402044, in_queue=2493824, util=97.61%
2.51user 1.14system 0:28.41elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2481minor)pagefaults 0swaps