fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [42.9% done] [   972/ 54964 kb/s] [eta 00m:04s]
Threads: 3: [FFm] [57.1% done] [   812/ 17136 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/ 20724 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.0% done] [  9264/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [71.4% done] [ 25164/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [76.2% done] [ 29968/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [81.0% done] [ 29684/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 35292/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 35684/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31412/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 40092/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 35212/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=16347
  read : io=100MiB, bw=4,569KiB/s, runt= 22949msec
    slat (msec): min=12805, max=21986, avg=18664.59, stdev=2344.20
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=20601, per=78.36%, avg=10692.62, stdev=6356.21
  write: io=100MiB, bw=7,825KiB/s, runt= 13399msec
    slat (msec): min=    0, max=   15, avg= 1.99, stdev= 2.18
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=108250, per=240.81%, avg=54125.00, stdev=76544.31
  cpu          : usr=5.56%, sys=1.78%, ctx=775
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16348
  read : io=100MiB, bw=4,742KiB/s, runt= 22110msec
    slat (msec): min=  114, max=20690, avg=16432.91, stdev=3242.21
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=16472, per=77.15%, avg=10527.94, stdev=4437.65
  write: io=99,424KiB, bw=7,587KiB/s, runt= 13419msec
    slat (msec): min=    0, max=   11, avg= 1.86, stdev= 2.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=106899, per=237.81%, avg=53449.50, stdev=75589.01
  cpu          : usr=5.81%, sys=1.59%, ctx=1027
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=16349
  read : io=100MiB, bw=4,548KiB/s, runt= 23052msec
    slat (msec): min=   74, max=18918, avg=14383.75, stdev=3983.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=13730, per=56.69%, avg=7735.45, stdev=5195.36
  write: io=92,804KiB, bw=7,079KiB/s, runt= 13423msec
    slat (msec): min=    0, max=  442, avg= 2.37, stdev=18.75
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=60403, per=89.76%, avg=20174.33, stdev=34839.10
  cpu          : usr=5.05%, sys=1.54%, ctx=1029
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,646KiB/s, minb=4,548KiB/s, maxb=4,742KiB/s, mint=22110msec, maxt=23052msec
  WRITE: io=288MiB, aggrb=22,476KiB/s, minb=7,079KiB/s, maxb=7,825KiB/s, mint=22110msec, maxt=23052msec

Disk stats (read/write):
  sda: ios=3047/1899, merge=1226/71619, ticks=98932/1761620, in_queue=1864020, util=98.67%
3.78user 1.14system 0:23.43elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps