fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [27.3% done] [  3260/ 22720 kb/s] [eta 00m:08s]
Threads: 3: [FmF] [66.7% done] [  1748/ 46316 kb/s] [eta 00m:02s]
Threads: 3: [FFF] [100.0% done] [     0/ 13981 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [66.7% done] [     0/     0 kb/s] [eta 00m:05s]
Threads: 3: [FFV] [73.3% done] [  7244/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [85.7% done] [ 14608/     0 kb/s] [eta 00m:02s]
Threads: 3: [FFV] [92.9% done] [ 11952/     0 kb/s] [eta 00m:01s]
Threads: 3: [FFV] [100.0% done] [  7460/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [100.0% done] [ 10812/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [100.0% done] [  7188/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [100.0% done] [ 11448/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.2% done] [ 27800/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [76.0% done] [ 28372/     0 kb/s] [eta 00m:06s]
Threads: 2: [VV_] [83.3% done] [ 28256/     0 kb/s] [eta 00m:04s]
Threads: 2: [VV_] [95.5% done] [ 36476/     0 kb/s] [eta 00m:01s]
Threads: 2: [VV_] [100.0% done] [ 34288/     0 kb/s] [eta 00m:00s]
Threads: 2: [VV_] [100.0% done] [ 28024/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17949
  read : io=100MiB, bw=4,317KiB/s, runt= 24285msec
    slat (msec): min=   62, max=21999, avg=18472.84, stdev=4159.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=32833, per=89.55%, avg=11599.27, stdev=9906.76
  write: io=99,008KiB, bw=5,865KiB/s, runt= 17284msec
    slat (msec): min=    0, max=   65, avg= 2.78, stdev= 4.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=83900, per=217.22%, avg=36777.25, stdev=43174.42
  cpu          : usr=6.21%, sys=1.58%, ctx=901
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17950
  read : io=100MiB, bw=4,344KiB/s, runt= 24137msec
    slat (msec): min=   34, max=20053, avg=15974.72, stdev=5002.66
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=21045, per=74.61%, avg=9664.05, stdev=6963.98
  write: io=90,216KiB, bw=5,347KiB/s, runt= 17274msec
    slat (msec): min=    0, max=   66, avg= 2.68, stdev= 5.78
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=103209, per=237.42%, avg=40197.00, stdev=49941.80
  cpu          : usr=5.82%, sys=1.57%, ctx=1020
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17951
  read : io=100MiB, bw=5,292KiB/s, runt= 19812msec
    slat (msec): min=   78, max=18342, avg=13581.42, stdev=3494.46
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=16046, per=73.98%, avg=9582.47, stdev=4297.88
  write: io=96,568KiB, bw=9,974KiB/s, runt=  9914msec
    slat (msec): min=    0, max=   16, avg= 2.01, stdev= 2.47
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=94712, per=279.70%, avg=47356.00, stdev=66971.50
  cpu          : usr=6.32%, sys=2.40%, ctx=873
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,953KiB/s, minb=4,317KiB/s, maxb=5,292KiB/s, mint=19812msec, maxt=24285msec
  WRITE: io=279MiB, aggrb=16,931KiB/s, minb=5,347KiB/s, maxb=9,974KiB/s, mint=19812msec, maxt=24285msec

Disk stats (read/write):
  sda: ios=3327/1877, merge=1449/69485, ticks=63384/2162156, in_queue=2256300, util=98.70%
4.22user 1.26system 0:24.60elapsed 22%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2420minor)pagefaults 0swaps