fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [9.4% done] [  9007/143245 kb/s] [eta 00m:29s]
Threads: 3: [mFF] [10.5% done] [  2091/  8038 kb/s] [eta 00m:34s]
Threads: 3: [mFF] [35.7% done] [  2406/ 32405 kb/s] [eta 00m:09s]
Threads: 3: [FFF] [100.0% done] [     0/ 50156 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FVF] [71.4% done] [  3954/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [73.3% done] [  3895/     0 kb/s] [eta 00m:04s]
Threads: 3: [FVF] [80.0% done] [ 10271/     0 kb/s] [eta 00m:03s]
Threads: 3: [FVF] [86.7% done] [  4860/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVF] [87.5% done] [  5836/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVF] [93.8% done] [  9129/     0 kb/s] [eta 00m:01s]
Threads: 3: [FVF] [100.0% done] [  5572/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [ 14454/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [69.2% done] [ 21370/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 30292/     0 kb/s] [eta 00m:07s]
Threads: 2: [V_V] [77.8% done] [ 28033/     0 kb/s] [eta 00m:06s]
Threads: 2: [V_V] [91.7% done] [ 31877/     0 kb/s] [eta 00m:02s]
Threads: 2: [V_V] [100.0% done] [ 32783/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 30767/     0 kb/s] [eta 00m:00s]
Threads: 1: [V_E] [100.0% done] [ 26820/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=20853
  read : io=100MiB, bw=4,146KiB/s, runt= 25287msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  872, avg=57.94, stdev=111.76
    bw (KiB/s) : min=    7, max=20111, per=61.74%, avg=7679.21, stdev=6741.87
  write: io=83,852KiB, bw=4,987KiB/s, runt= 17216msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  571, avg= 2.50, stdev=28.24
    bw (KiB/s) : min=    0, max=138240, per=287.16%, avg=46290.33, stdev=79631.37
  cpu          : usr=2.56%, sys=1.57%, ctx=4421
  IO depths    : 1=3.1%, 2=56.7%, 4=28.1%, 8=12.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.9%, 4=0.2%, 10=10.7%, 20=20.4%, 50=7.1%, 100=2.2%
     lat (msec): 250=7.0%, 500=2.6%, 750=0.7%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20854
  read : io=100MiB, bw=5,179KiB/s, runt= 20237msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  417, avg=61.78, stdev=77.74
    bw (KiB/s) : min=   15, max=18262, per=63.50%, avg=7897.25, stdev=5218.84
  write: io=93,708KiB, bw=10,058KiB/s, runt=  9540msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  262, avg= 0.77, stdev=10.44
    bw (KiB/s) : min=    0, max=126787, per=393.26%, avg=63393.50, stdev=89651.95
  cpu          : usr=3.81%, sys=2.39%, ctx=4008
  IO depths    : 1=2.2%, 2=55.3%, 4=29.4%, 8=13.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.9%, 4=0.3%, 10=8.4%, 20=12.7%, 50=10.9%, 100=7.4%
     lat (msec): 250=8.8%, 500=2.3%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20855
  read : io=100MiB, bw=4,201KiB/s, runt= 24949msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  671, avg=44.37, stdev=74.59
    bw (KiB/s) : min=    6, max=21690, per=75.60%, avg=9402.21, stdev=7382.60
  write: io=93,464KiB, bw=5,560KiB/s, runt= 17212msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  311, avg= 1.23, stdev=15.28
    bw (KiB/s) : min=    0, max=133619, per=328.32%, avg=52925.00, stdev=71005.97
  cpu          : usr=2.98%, sys=1.60%, ctx=4428
  IO depths    : 1=3.6%, 2=57.1%, 4=28.7%, 8=10.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.6%, 4=0.2%, 10=13.8%, 20=18.3%, 50=7.7%, 100=2.4%
     lat (msec): 250=7.0%, 500=1.6%, 750=0.1%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,437KiB/s, minb=4,146KiB/s, maxb=5,179KiB/s, mint=20237msec, maxt=25287msec
  WRITE: io=265MiB, aggrb=16,120KiB/s, minb=4,987KiB/s, maxb=10,058KiB/s, mint=20237msec, maxt=25287msec

Disk stats (read/write):
  sda: ios=3516/1768, merge=1677/65927, ticks=84920/1929640, in_queue=2048256, util=98.93%
2.20user 1.34system 0:25.60elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2478minor)pagefaults 0swaps