fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [7.3% done] [  2367/ 43760 kb/s] [eta 00m:38s]
Threads: 3: [FFm] [50.0% done] [  1114/ 55579 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [50.0% done] [   681/   535 kb/s] [eta 00m:05s]
Threads: 3: [FFm] [50.0% done] [  1181/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   303/ 30393 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  6073/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 31385/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.2% done] [ 27431/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.0% done] [ 24804/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 37470/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 33528/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34678/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35599/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 30554/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=25255
  read : io=100MiB, bw=4,490KiB/s, runt= 23352msec
    slat (msec): min=  139, max=20581, avg=16804.85, stdev=3785.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=18629, per=67.92%, avg=9148.33, stdev=5794.62
  write: io=96,616KiB, bw=7,100KiB/s, runt= 13934msec
    slat (msec): min=    0, max=  364, avg= 2.24, stdev=12.76
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=62231, per=99.04%, avg=20879.67, stdev=35811.89
  cpu          : usr=5.09%, sys=1.94%, ctx=838
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25256
  read : io=100MiB, bw=4,654KiB/s, runt= 22529msec
    slat (msec): min=12922, max=21574, avg=17458.03, stdev=2684.00
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=26496, per=81.39%, avg=10963.33, stdev=6787.78
  write: io=100MiB, bw=7,648KiB/s, runt= 13710msec
    slat (msec): min=    0, max=   16, avg= 1.92, stdev= 2.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=109316, per=259.26%, avg=54658.00, stdev=77298.08
  cpu          : usr=5.49%, sys=1.76%, ctx=762
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25257
  read : io=100MiB, bw=4,541KiB/s, runt= 23087msec
    slat (msec): min=   69, max=16457, avg=11386.73, stdev=3996.94
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   30, max=15608, per=52.41%, avg=7059.20, stdev=5154.55
  write: io=87,860KiB, bw=6,548KiB/s, runt= 13738msec
    slat (msec): min=    0, max=  245, avg= 2.48, stdev=15.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=78971, per=125.30%, avg=26415.00, stdev=45515.04
  cpu          : usr=5.16%, sys=1.61%, ctx=944
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,470KiB/s, minb=4,490KiB/s, maxb=4,654KiB/s, mint=22529msec, maxt=23352msec
  WRITE: io=280MiB, aggrb=21,082KiB/s, minb=6,548KiB/s, maxb=7,648KiB/s, mint=22529msec, maxt=23352msec

Disk stats (read/write):
  sda: ios=3189/2038, merge=1138/69653, ticks=82388/1787112, in_queue=1870200, util=98.93%
3.67user 1.26system 0:23.65elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2419minor)pagefaults 0swaps