fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFF] [100.0% done] [     0/ 84988 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  4448/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [71.4% done] [ 25476/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.2% done] [ 31660/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.0% done] [ 24984/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [94.7% done] [ 35903/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35624/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 38052/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31100/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32424/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=21400
  read : io=100MiB, bw=4,553KiB/s, runt= 23026msec
    slat (msec): min=   56, max=20350, avg=15469.17, stdev=4263.72
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=23273, per=68.12%, avg=9160.00, stdev=6058.64
  write: io=91,056KiB, bw=6,790KiB/s, runt= 13732msec
    slat (msec): min=    0, max=   46, avg= 1.95, stdev= 3.49
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=106561, per=245.28%, avg=53280.50, stdev=75350.01
  cpu          : usr=5.51%, sys=1.29%, ctx=834
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21401
  read : io=100MiB, bw=4,531KiB/s, runt= 23138msec
    slat (msec): min=  261, max=21626, avg=17510.44, stdev=3347.28
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=19788, per=73.88%, avg=9933.24, stdev=6099.33
  write: io=98MiB, bw=7,551KiB/s, runt= 13599msec
    slat (msec): min=    0, max=   13, avg= 1.95, stdev= 2.05
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108690, per=250.18%, avg=54345.00, stdev=76855.44
  cpu          : usr=5.60%, sys=1.63%, ctx=1379
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=21402
  read : io=100MiB, bw=4,482KiB/s, runt= 23394msec
    slat (msec): min=  143, max=21894, avg=17362.63, stdev=3300.47
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=17114, per=68.58%, avg=9220.94, stdev=5185.16
  write: io=99,960KiB, bw=7,528KiB/s, runt= 13597msec
    slat (msec): min=    0, max=   16, avg= 2.03, stdev= 2.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103579, per=238.42%, avg=51789.50, stdev=73241.41
  cpu          : usr=5.49%, sys=1.83%, ctx=1113
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,446KiB/s, minb=4,482KiB/s, maxb=4,553KiB/s, mint=23026msec, maxt=23394msec
  WRITE: io=284MiB, aggrb=21,722KiB/s, minb=6,790KiB/s, maxb=7,551KiB/s, mint=23026msec, maxt=23394msec

Disk stats (read/write):
  sda: ios=3056/2235, merge=1193/70440, ticks=78780/1748748, in_queue=1827520, util=98.98%
3.92user 1.14system 0:23.65elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2436minor)pagefaults 0swaps