fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [8.1% done] [ 12220/  3716 kb/s] [eta 00m:34s]
Threads: 3: [mmm] [9.3% done] [  6588/  9084 kb/s] [eta 00m:39s]
Threads: 3: [mmm] [14.3% done] [  9208/  7492 kb/s] [eta 00m:30s]
Threads: 3: [mmm] [17.6% done] [  7152/  7008 kb/s] [eta 00m:28s]
Threads: 3: [mmm] [19.4% done] [  7408/  6076 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [20.5% done] [  3376/  7260 kb/s] [eta 00m:31s]
Threads: 3: [mmm] [22.5% done] [  5508/  7140 kb/s] [eta 00m:31s]
Threads: 3: [mmm] [25.0% done] [ 11872/  1012 kb/s] [eta 00m:30s]
Threads: 3: [mmm] [26.8% done] [ 10212/  2692 kb/s] [eta 00m:30s]
Threads: 3: [mmm] [29.3% done] [  5564/  6216 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [31.0% done] [  5804/  6748 kb/s] [eta 00m:29s]
Threads: 3: [mmm] [34.1% done] [  6684/  4752 kb/s] [eta 00m:27s]
Threads: 3: [mmm] [36.6% done] [  7996/  1648 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [38.1% done] [  5616/  4864 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [40.5% done] [  4384/  5492 kb/s] [eta 00m:25s]
Threads: 3: [mmm] [43.9% done] [  3920/  5576 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [44.2% done] [  1996/  7052 kb/s] [eta 00m:24s]
Threads: 3: [mmm] [46.5% done] [  5000/  3352 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [47.7% done] [  4028/  3380 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [48.9% done] [   764/  7735 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [50.0% done] [  4956/  2084 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [52.2% done] [  4784/  2172 kb/s] [eta 00m:22s]
Threads: 3: [mVV] [53.2% done] [  2884/  2384 kb/s] [eta 00m:22s]
Threads: 3: [mVV] [54.2% done] [ 13212/  1004 kb/s] [eta 00m:22s]
Threads: 3: [mVV] [54.0% done] [ 16700/   468 kb/s] [eta 00m:23s]
Threads: 3: [mVV] [53.8% done] [ 13332/     0 kb/s] [eta 00m:24s]
Threads: 3: [mVV] [54.7% done] [ 16844/   232 kb/s] [eta 00m:24s]
Threads: 3: [mVV] [54.5% done] [ 19276/   108 kb/s] [eta 00m:25s]
Threads: 1: [m__] [56.4% done] [ 12468/  2020 kb/s] [eta 00m:24s]
Threads: 1: [m__] [61.5% done] [  3700/  5148 kb/s] [eta 00m:20s]
Threads: 1: [V__] [68.0% done] [  3580/  4568 kb/s] [eta 00m:16s]
Threads: 1: [V__] [79.5% done] [ 17268/     0 kb/s] [eta 00m:09s]
Threads: 1: [V__] [94.7% done] [ 23284/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=969
  read : io=100MiB, bw=2,882KiB/s, runt= 36376msec
    clat (msec): min=    0, max=  230, avg=12.11, stdev=24.13
    bw (KiB/s) : min=    7, max=24504, per=37.78%, avg=3267.06, stdev=5237.78
  write: io=50,024KiB, bw=1,512KiB/s, runt= 33857msec
    clat (msec): min=    0, max=  570, avg=15.26, stdev=45.06
    bw (KiB/s) : min=    0, max=10559, per=51.89%, avg=2224.92, stdev=2681.15
  cpu          : usr=2.95%, sys=0.20%, ctx=2605
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=47.5%, 4=8.9%, 10=16.7%, 20=9.9%, 50=10.0%, 100=4.0%
     lat (msec): 250=2.6%, 500=0.2%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=970
  read : io=100MiB, bw=3,389KiB/s, runt= 30932msec
    clat (msec): min=    0, max=  203, avg=12.87, stdev=17.91
    bw (KiB/s) : min=   14, max=12340, per=45.62%, avg=3944.81, stdev=2814.55
  write: io=37,636KiB, bw=1,515KiB/s, runt= 25426msec
    clat (msec): min=    0, max=  164, avg= 9.63, stdev=21.70
    bw (KiB/s) : min=    0, max= 6947, per=77.13%, avg=3307.47, stdev=2637.61
  cpu          : usr=2.75%, sys=0.23%, ctx=2419
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=35.0%, 4=6.7%, 10=21.0%, 20=18.2%, 50=15.1%, 100=2.7%
     lat (msec): 250=1.3%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=971
  read : io=100MiB, bw=3,311KiB/s, runt= 31665msec
    clat (msec): min=    0, max=  208, avg=10.83, stdev=18.79
    bw (KiB/s) : min=    5, max=19171, per=47.53%, avg=4109.67, stdev=4466.99
  write: io=54,124KiB, bw=2,220KiB/s, runt= 24958msec
    clat (msec): min=    0, max=  276, avg=11.58, stdev=26.88
    bw (KiB/s) : min=    0, max= 8916, per=76.60%, avg=3284.57, stdev=3038.76
  cpu          : usr=3.21%, sys=0.39%, ctx=2659
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.1%, 4=7.0%, 10=18.5%, 20=13.5%, 50=11.9%, 100=3.2%
     lat (msec): 250=1.6%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=8,647KiB/s, minb=2,882KiB/s, maxb=3,389KiB/s, mint=30932msec, maxt=36376msec
  WRITE: io=138MiB, aggrb=4,288KiB/s, minb=1,512KiB/s, maxb=2,220KiB/s, mint=30932msec, maxt=36376msec

Disk stats (read/write):
  sda: ios=5763/3014, merge=797/406, ticks=78464/68552, in_queue=147016, util=98.50%
2.94user 0.39system 0:36.68elapsed 9%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+1081minor)pagefaults 0swaps