fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.0% done] [ 18096/  6192 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [17.4% done] [ 12576/ 11248 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [22.7% done] [  9364/ 13336 kb/s] [eta 00m:17s]
Threads: 3: [mmm] [27.3% done] [  9952/  9848 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [33.3% done] [ 18380/  2352 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [38.1% done] [ 13296/  6244 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [40.9% done] [ 15236/  3240 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [45.5% done] [ 14144/  4452 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [50.0% done] [  8932/  7840 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [54.5% done] [  8512/  6132 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [56.5% done] [  8868/  4832 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  6000/  6280 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [62.5% done] [  8700/  3480 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  6592/  4316 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [68.0% done] [  6556/  4276 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 22640/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 21820/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.3% done] [ 22728/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [87.5% done] [ 22624/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [91.7% done] [ 21752/     0 kb/s] [eta 00m:02s]
fio: (groupid=0): err= 0: pid=25217
  read : io=100MiB, bw=4,518KiB/s, runt= 23204msec
    slat (msec): min=    0, max= 5940, avg=1070.93, stdev=1734.42
    clat (msec): min=    0, max=  833, avg=75.08, stdev=80.15
    bw (KiB/s) : min=    5, max=12725, per=36.17%, avg=4902.94, stdev=3260.11
  write: io=44,848KiB, bw=2,666KiB/s, runt= 17223msec
    slat (msec): min=    0, max=   11, avg= 0.15, stdev= 0.83
    clat (msec): min=    0, max=  827, avg=107.08, stdev=126.28
    bw (KiB/s) : min=    0, max= 9019, per=45.89%, avg=3502.27, stdev=2900.45
  cpu          : usr=4.60%, sys=0.36%, ctx=1755
  IO depths    : 1=0.1%, 2=0.4%, 4=13.7%, 8=85.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.7%, 4=0.4%, 10=3.9%, 20=13.1%, 50=27.5%, 100=27.3%
     lat (msec): 250=20.7%, 500=4.4%, 750=0.6%, 1000=0.3%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25218
  read : io=100MiB, bw=4,518KiB/s, runt= 23204msec
    slat (msec): min=    0, max= 6849, avg=1307.24, stdev=2005.77
    clat (msec): min=    0, max=  782, avg=78.13, stdev=81.75
    bw (KiB/s) : min=    3, max=10072, per=36.78%, avg=4986.51, stdev=3159.86
  write: io=37,208KiB, bw=2,346KiB/s, runt= 16239msec
    slat (msec): min=    0, max=    6, avg= 0.13, stdev= 0.56
    clat (msec): min=    0, max=  815, avg=81.57, stdev=89.44
    bw (KiB/s) : min=    0, max=11444, per=47.33%, avg=3612.32, stdev=3266.58
  cpu          : usr=3.98%, sys=0.29%, ctx=1803
  IO depths    : 1=0.2%, 2=0.3%, 4=13.2%, 8=86.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.8%, 4=0.6%, 10=3.9%, 20=14.8%, 50=27.4%, 100=28.3%
     lat (msec): 250=19.2%, 500=4.5%, 750=0.3%, 1000=0.1%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25219
  read : io=100MiB, bw=4,554KiB/s, runt= 23024msec
    slat (msec): min=    0, max= 6433, avg=1789.06, stdev=2278.71
    clat (msec): min=    0, max=  370, avg=71.54, stdev=69.68
    bw (KiB/s) : min=   23, max=11616, per=39.30%, avg=5328.15, stdev=3106.19
  write: io=46,320KiB, bw=2,831KiB/s, runt= 16750msec
    slat (msec): min=    0, max=    7, avg= 0.09, stdev= 0.60
    clat (msec): min=    0, max=  817, avg=81.36, stdev=109.79
    bw (KiB/s) : min=    0, max=14815, per=54.32%, avg=4145.81, stdev=3792.25
  cpu          : usr=4.12%, sys=0.42%, ctx=1834
  IO depths    : 1=0.1%, 2=0.3%, 4=16.4%, 8=83.2%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=3.5%, 4=1.5%, 10=7.3%, 20=13.4%, 50=24.6%, 100=26.1%
     lat (msec): 250=19.2%, 500=3.8%, 750=0.5%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,556KiB/s, minb=4,518KiB/s, maxb=4,554KiB/s, mint=23024msec, maxt=23204msec
  WRITE: io=125MiB, aggrb=7,632KiB/s, minb=2,346KiB/s, maxb=2,831KiB/s, mint=23024msec, maxt=23204msec

Disk stats (read/write):
  sda: ios=4375/1942, merge=1459/479, ticks=323620/185828, in_queue=509448, util=99.34%
2.97user 0.27system 0:23.47elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2398minor)pagefaults 0swaps