fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [Fmm] [30.0% done] [  5564/ 53104 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [40.0% done] [  1344/ 54728 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   432/ 40644 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [ 12296/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 25972/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.0% done] [ 30260/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [85.7% done] [ 29656/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.5% done] [ 32308/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.2% done] [ 33096/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 37296/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 28491/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 29888/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=2150
  read : io=100MiB, bw=4,517KiB/s, runt= 23210msec
    slat (msec): min=   71, max=21066, avg=16713.12, stdev=3722.44
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=18326, per=76.18%, avg=9979.94, stdev=5404.19
  write: io=98,248KiB, bw=7,050KiB/s, runt= 14270msec
    slat (msec): min=    0, max=  102, avg= 2.07, stdev= 5.31
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=95706, per=175.50%, avg=35034.00, stdev=52753.10
  cpu          : usr=5.20%, sys=1.53%, ctx=841
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2151
  read : io=100MiB, bw=4,384KiB/s, runt= 23916msec
    slat (msec): min=   82, max=19019, avg=14021.04, stdev=5039.37
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=23553, per=55.85%, avg=7317.48, stdev=6163.48
  write: io=87,684KiB, bw=6,282KiB/s, runt= 14291msec
    slat (msec): min=    0, max=  110, avg= 2.53, stdev= 9.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=79436, per=133.43%, avg=26635.33, stdev=45727.32
  cpu          : usr=4.97%, sys=1.47%, ctx=1027
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=2152
  read : io=100MiB, bw=4,367KiB/s, runt= 24010msec
    slat (msec): min=   66, max=20433, avg=15349.84, stdev=4553.89
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=17185, per=61.56%, avg=8064.38, stdev=5160.57
  write: io=92,672KiB, bw=6,652KiB/s, runt= 14264msec
    slat (msec): min=    0, max=   96, avg= 2.09, stdev= 5.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=96973, per=162.51%, avg=32440.67, stdev=55886.91
  cpu          : usr=5.10%, sys=1.40%, ctx=951
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,101KiB/s, minb=4,367KiB/s, maxb=4,517KiB/s, mint=23210msec, maxt=24010msec
  WRITE: io=272MiB, aggrb=19,962KiB/s, minb=6,282KiB/s, maxb=7,050KiB/s, mint=23210msec, maxt=24010msec

Disk stats (read/write):
  sda: ios=3394/2023, merge=1388/67595, ticks=82184/1604292, in_queue=1686720, util=99.09%
3.68user 1.08system 0:24.27elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps