fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [7.3% done] [ 10452/     0 kb/s] [eta 00m:38s]
Threads: 3: [mmm] [9.8% done] [ 11880/     0 kb/s] [eta 00m:37s]
Threads: 3: [mFm] [41.7% done] [  5688/120932 kb/s] [eta 00m:07s]
Threads: 3: [mFF] [42.9% done] [  5139/ 35948 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [  1120/ 38852 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.0% done] [ 12544/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 29860/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 21720/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [83.3% done] [ 26144/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [91.3% done] [ 31072/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 33828/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31552/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 24176/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32328/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=32392
  read : io=100MiB, bw=4,068KiB/s, runt= 25776msec
    slat (msec): min=   45, max=18824, avg=13518.28, stdev=5060.40
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=15078, per=53.31%, avg=6505.83, stdev=4696.98
  write: io=82,528KiB, bw=5,143KiB/s, runt= 16431msec
    slat (msec): min=    0, max=   51, avg= 2.06, stdev= 3.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=82462, per=176.40%, avg=27577.00, stdev=47531.99
  cpu          : usr=4.73%, sys=1.30%, ctx=1099
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32393
  read : io=100MiB, bw=4,085KiB/s, runt= 25663msec
    slat (msec): min=   82, max=20758, avg=14959.94, stdev=5923.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=20900, per=59.71%, avg=7287.50, stdev=5791.78
  write: io=89,600KiB, bw=5,595KiB/s, runt= 16396msec
    slat (msec): min=    0, max=   91, avg= 2.18, stdev= 5.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=94243, per=201.37%, avg=31480.67, stdev=54353.87
  cpu          : usr=4.79%, sys=1.23%, ctx=1089
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32394
  read : io=100MiB, bw=4,101KiB/s, runt= 25565msec
    slat (msec): min=   53, max=19674, avg=13059.37, stdev=5600.72
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=20320, per=59.01%, avg=7201.59, stdev=5030.42
  write: io=78,720KiB, bw=4,911KiB/s, runt= 16412msec
    slat (msec): min=    0, max=  144, avg= 2.36, stdev= 7.90
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=70126, per=187.86%, avg=29368.00, stdev=36424.07
  cpu          : usr=4.79%, sys=1.19%, ctx=1169
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,204KiB/s, minb=4,068KiB/s, maxb=4,101KiB/s, mint=25565msec, maxt=25776msec
  WRITE: io=245MiB, aggrb=15,633KiB/s, minb=4,911KiB/s, maxb=5,595KiB/s, mint=25565msec, maxt=25776msec

Disk stats (read/write):
  sda: ios=3917/1980, merge=1501/60643, ticks=79916/1736032, in_queue=1815948, util=97.70%
3.74user 0.96system 0:26.65elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps