fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [10.3% done] [  6224/ 50760 kb/s] [eta 00m:26s]
Threads: 3: [FFm] [11.4% done] [  1624/     0 kb/s] [eta 00m:31s]
Threads: 3: [FFm] [50.0% done] [   700/ 58684 kb/s] [eta 00m:05s]
Threads: 3: [FFF] [100.0% done] [     0/ 25664 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  1004/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 24236/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 24108/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 31282/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 25892/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.5% done] [ 29452/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.2% done] [ 31888/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 28500/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 33360/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 26024/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=12336
  read : io=100MiB, bw=4,372KiB/s, runt= 23979msec
    slat (msec): min=   13, max=21910, avg=16951.83, stdev=5690.78
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=30585, per=71.01%, avg=9314.58, stdev=7567.43
  write: io=98,688KiB, bw=7,352KiB/s, runt= 13745msec
    slat (msec): min=    0, max=   18, avg= 2.18, stdev= 2.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111270, per=244.83%, avg=50246.25, stdev=58614.18
  cpu          : usr=5.35%, sys=1.82%, ctx=268
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12337
  read : io=100MiB, bw=4,804KiB/s, runt= 21825msec
    slat (msec): min=   27, max=19094, avg=14859.85, stdev=4241.48
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=25769, per=76.78%, avg=10071.47, stdev=6325.52
  write: io=92,944KiB, bw=6,911KiB/s, runt= 13770msec
    slat (msec): min=    0, max=   31, avg= 2.29, stdev= 3.32
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=83516, per=136.21%, avg=27953.67, stdev=48118.70
  cpu          : usr=5.83%, sys=2.05%, ctx=349
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=12338
  read : io=100MiB, bw=4,485KiB/s, runt= 23377msec
    slat (msec): min=   57, max=18271, avg=12808.59, stdev=4774.59
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=14014, per=57.76%, avg=7576.86, stdev=4004.57
  write: io=84,348KiB, bw=6,282KiB/s, runt= 13749msec
    slat (msec): min=    0, max=   25, avg= 1.64, stdev= 2.24
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111501, per=271.65%, avg=55750.50, stdev=78843.11
  cpu          : usr=5.06%, sys=1.54%, ctx=403
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,118KiB/s, minb=4,372KiB/s, maxb=4,804KiB/s, mint=21825msec, maxt=23979msec
  WRITE: io=270MiB, aggrb=20,523KiB/s, minb=6,282KiB/s, maxb=7,352KiB/s, mint=21825msec, maxt=23979msec

Disk stats (read/write):
  sda: ios=1656/1916, merge=9291/66941, ticks=142556/1650380, in_queue=1794144, util=98.42%
3.77user 1.24system 0:24.40elapsed 20%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2417minor)pagefaults 0swaps