fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [7.1% done] [  9979/  4347 kb/s] [eta 00m:39s]
Threads: 3: [mmm] [10.3% done] [  9882/  5993 kb/s] [eta 00m:35s]
Threads: 3: [mmm] [13.2% done] [  2694/ 14376 kb/s] [eta 00m:33s]
Threads: 3: [mmm] [16.2% done] [  5957/  7513 kb/s] [eta 00m:31s]
Threads: 3: [mmm] [19.4% done] [ 13998/   353 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [21.6% done] [ 13287/     0 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [24.3% done] [  9573/  1613 kb/s] [eta 00m:28s]
Threads: 3: [mmm] [26.3% done] [  7517/  5725 kb/s] [eta 00m:28s]
Threads: 3: [mmm] [29.7% done] [  6180/  6144 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [31.6% done] [  5420/  8216 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [33.3% done] [  3197/  8508 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [35.9% done] [  5579/  6867 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [38.5% done] [  2677/  9805 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [41.0% done] [  8427/  1869 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [43.6% done] [  8053/  1305 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [45.0% done] [  8427/   715 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [46.3% done] [  4278/  4998 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [48.8% done] [  7159/   593 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [50.0% done] [  7058/  1308 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [51.2% done] [  5522/  1564 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [53.5% done] [  1759/  7598 kb/s] [eta 00m:20s]
Threads: 3: [mmV] [54.5% done] [   264/  7610 kb/s] [eta 00m:20s]
Threads: 3: [mmV] [55.6% done] [ 14153/   926 kb/s] [eta 00m:20s]
Threads: 3: [mmV] [55.3% done] [ 13807/   654 kb/s] [eta 00m:21s]
Threads: 3: [mmV] [55.1% done] [ 14327/   109 kb/s] [eta 00m:22s]
Threads: 2: [mm_] [59.6% done] [  5298/  6160 kb/s] [eta 00m:19s]
Threads: 2: [mm_] [61.7% done] [  3831/  3246 kb/s] [eta 00m:18s]
Threads: 2: [mV_] [62.5% done] [ 12162/  1206 kb/s] [eta 00m:18s]
Threads: 2: [mV_] [63.3% done] [ 16509/   325 kb/s] [eta 00m:18s]
Threads: 1: [m__] [64.0% done] [ 12422/   199 kb/s] [eta 00m:18s]
Threads: 1: [V__] [73.3% done] [ 13177/     0 kb/s] [eta 00m:12s]
Threads: 1: [V__] [87.2% done] [ 20081/     0 kb/s] [eta 00m:05s]
Threads: 1: [V__] [100.0% done] [ 19195/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=20583
  read : io=100MiB, bw=2,958KiB/s, runt= 35441msec
    clat (msec): min=    0, max=  249, avg=11.83, stdev=22.48
    bw (KiB/s) : min=    4, max=24274, per=44.36%, avg=3936.92, stdev=5502.55
  write: io=48,072KiB, bw=1,497KiB/s, runt= 32871msec
    clat (msec): min=    0, max=  432, avg=17.08, stdev=45.69
    bw (KiB/s) : min=    0, max= 7040, per=59.15%, avg=2392.45, stdev=2482.29
  cpu          : usr=2.71%, sys=0.34%, ctx=2474
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=43.6%, 4=8.7%, 10=19.3%, 20=11.0%, 50=9.8%, 100=4.5%
     lat (msec): 250=2.7%, 500=0.2%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20584
  read : io=100MiB, bw=3,272KiB/s, runt= 32038msec
    clat (msec): min=    0, max=  141, avg=11.76, stdev=15.21
    bw (KiB/s) : min=    8, max=17243, per=43.18%, avg=3832.48, stdev=4182.14
  write: io=36,904KiB, bw=1,286KiB/s, runt= 29371msec
    clat (msec): min=    0, max=  246, avg=15.68, stdev=36.33
    bw (KiB/s) : min=    0, max= 6877, per=47.26%, avg=1911.58, stdev=2018.45
  cpu          : usr=2.68%, sys=0.35%, ctx=2354
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=33.0%, 4=7.7%, 10=22.4%, 20=18.8%, 50=13.2%, 100=3.5%
     lat (msec): 250=1.4%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20585
  read : io=100MiB, bw=3,781KiB/s, runt= 27731msec
    clat (msec): min=    0, max=  161, avg=10.54, stdev=13.95
    bw (KiB/s) : min=    7, max=16162, per=51.90%, avg=4605.93, stdev=4290.29
  write: io=44,892KiB, bw=1,911KiB/s, runt= 24049msec
    clat (msec): min=    0, max=  239, avg= 9.90, stdev=24.89
    bw (KiB/s) : min=    0, max= 8444, per=77.14%, avg=3120.21, stdev=2832.00
  cpu          : usr=3.59%, sys=0.39%, ctx=2470
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=38.6%, 4=7.8%, 10=20.5%, 20=17.3%, 50=12.1%, 100=2.9%
     lat (msec): 250=0.7%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=8,875KiB/s, minb=2,958KiB/s, maxb=3,781KiB/s, mint=27731msec, maxt=35441msec
  WRITE: io=127MiB, aggrb=4,045KiB/s, minb=1,286KiB/s, maxb=1,911KiB/s, mint=27731msec, maxt=35441msec

Disk stats (read/write):
  sda: ios=5699/2579, merge=833/278, ticks=72524/48308, in_queue=120828, util=98.73%
2.82user 0.50system 0:35.71elapsed 9%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+1078minor)pagefaults 0swaps