fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [15.8% done] [  4639/ 53484 kb/s] [eta 00m:16s]
Threads: 3: [FFm] [50.0% done] [    27/ 43925 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [45.5% done] [   494/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFm] [46.2% done] [  1161/     0 kb/s] [eta 00m:07s]
Threads: 3: [FFm] [46.7% done] [   433/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFm] [47.1% done] [   728/     0 kb/s] [eta 00m:09s]
Threads: 3: [FFF] [100.0% done] [   354/ 29987 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [70.0% done] [ 18741/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVF] [78.9% done] [ 27711/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [66.7% done] [ 30381/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [68.0% done] [ 26155/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 33150/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [79.2% done] [ 30085/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 36682/     0 kb/s] [eta 00m:03s]
Threads: 1: [__V] [95.5% done] [ 30349/     0 kb/s] [eta 00m:01s]
Threads: 1: [__V] [100.0% done] [ 36099/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=13395
  read : io=100MiB, bw=4,885KiB/s, runt= 21463msec
    slat (msec): min=  169, max=20067, avg=15864.69, stdev=2536.74
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=22685, per=88.33%, avg=11999.21, stdev=7760.51
  write: io=98MiB, bw=7,684KiB/s, runt= 13382msec
    slat (msec): min=    0, max=   11, avg= 1.83, stdev= 1.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=117253, per=327.80%, avg=58626.50, stdev=82910.39
  cpu          : usr=5.57%, sys=1.60%, ctx=757
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13396
  read : io=100MiB, bw=4,859KiB/s, runt= 21577msec
    slat (msec): min=  123, max=18857, avg=14682.69, stdev=3816.77
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=25535, per=73.54%, avg=9990.61, stdev=7913.52
  write: io=97,116KiB, bw=7,429KiB/s, runt= 13386msec
    slat (msec): min=    0, max=  125, avg= 1.82, stdev= 3.63
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=90171, per=168.24%, avg=30089.33, stdev=52032.27
  cpu          : usr=5.51%, sys=1.85%, ctx=850
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=13397
  read : io=100MiB, bw=4,528KiB/s, runt= 23155msec
    slat (msec): min=   96, max=14413, avg=11578.21, stdev=3849.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   28, max=39028, per=58.54%, avg=7952.50, stdev=11023.91
  write: io=86,740KiB, bw=5,457KiB/s, runt= 16276msec
    slat (msec): min=    0, max=  246, avg= 3.03, stdev=16.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=77606, per=144.85%, avg=25906.00, stdev=44773.55
  cpu          : usr=4.89%, sys=1.95%, ctx=983
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,585KiB/s, minb=4,528KiB/s, maxb=4,885KiB/s, mint=21463msec, maxt=23155msec
  WRITE: io=278MiB, aggrb=17,885KiB/s, minb=5,457KiB/s, maxb=7,684KiB/s, mint=21463msec, maxt=23155msec

Disk stats (read/write):
  sda: ios=3343/1966, merge=1394/69066, ticks=89308/1612468, in_queue=1701776, util=98.80%
3.56user 1.24system 0:23.49elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2417minor)pagefaults 0swaps