fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [9.7% done] [   120/  3388 kb/s] [eta 00m:28s]
Threads: 3: [FFm] [9.5% done] [     0/    28 kb/s] [eta 00m:38s]
Threads: 3: [FFm] [9.6% done] [     0/     0 kb/s] [eta 00m:47s]
Threads: 3: [FFm] [50.0% done] [   172/ 57720 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [50.0% done] [     4/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFm] [50.0% done] [   172/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [   120/ 29644 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [ 11484/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [71.4% done] [ 32804/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.2% done] [ 31572/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.0% done] [ 28700/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [94.7% done] [ 38668/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36432/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32732/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 39124/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 32692/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4473
  read : io=100MiB, bw=4,634KiB/s, runt= 22624msec
    clat (msec): min=    0, max=  275, avg= 5.09, stdev=27.72
    bw (KiB/s) : min=    0, max=20660, per=73.82%, avg=10264.38, stdev=6184.92
  write: io=100MiB, bw=7,859KiB/s, runt= 13342msec
    clat (msec): min=    0, max=   74, avg= 0.33, stdev= 3.44
    bw (KiB/s) : min=    0, max=108822, per=182.81%, avg=41134.67, stdev=59070.64
  cpu          : usr=5.50%, sys=1.73%, ctx=711
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=87.8%, 4=3.8%, 10=5.9%, 20=0.7%, 50=0.4%, 100=0.2%
     lat (msec): 250=1.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4474
  read : io=100MiB, bw=4,786KiB/s, runt= 21906msec
    clat (msec): min=    0, max=  229, avg= 4.79, stdev=25.07
    bw (KiB/s) : min=    4, max=20848, per=76.52%, avg=10639.06, stdev=5494.57
  write: io=98MiB, bw=7,688KiB/s, runt= 13354msec
    clat (msec): min=    0, max=   33, avg= 0.18, stdev= 1.75
    bw (KiB/s) : min=    0, max=110223, per=194.37%, avg=43735.33, stdev=58528.02
  cpu          : usr=5.62%, sys=1.68%, ctx=788
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=86.4%, 4=4.8%, 10=6.1%, 20=0.8%, 50=0.8%, 100=0.1%
     lat (msec): 250=0.8%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4475
  read : io=100MiB, bw=4,740KiB/s, runt= 22121msec
    clat (msec): min=    0, max= 1903, avg= 9.40, stdev=66.77
    bw (KiB/s) : min=   23, max=13634, per=52.64%, avg=7318.50, stdev=4998.37
  write: io=90,780KiB, bw=6,961KiB/s, runt= 13354msec
    clat (msec): min=    0, max= 1029, avg= 0.70, stdev=26.90
    bw (KiB/s) : min=    0, max=19883, per=25.77%, avg=5798.00, stdev=9504.84
  cpu          : usr=5.10%, sys=1.56%, ctx=933
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=83.6%, 4=5.3%, 10=7.0%, 20=1.5%, 50=1.0%, 100=0.2%
     lat (msec): 250=1.1%, 500=0.1%, 750=0.0%, 1000=0.1%, >=2000=0.1%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,904KiB/s, minb=4,634KiB/s, maxb=4,786KiB/s, mint=21906msec, maxt=22624msec
  WRITE: io=287MiB, aggrb=22,501KiB/s, minb=6,961KiB/s, maxb=7,859KiB/s, mint=21906msec, maxt=22624msec

Disk stats (read/write):
  sda: ios=3188/2214, merge=1403/70999, ticks=70328/1501868, in_queue=1573924, util=98.55%
3.61user 1.20system 0:23.01elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (3major+1069minor)pagefaults 0swaps