fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [42.9% done] [  1016/     0 kb/s] [eta 00m:04s]
Threads: 3: [mFF] [40.0% done] [   684/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFF] [100.0% done] [   560/ 42576 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [71.4% done] [  2512/     0 kb/s] [eta 00m:04s]
Threads: 3: [FFV] [78.6% done] [  8240/     0 kb/s] [eta 00m:03s]
Threads: 3: [FFV] [85.7% done] [ 13108/     0 kb/s] [eta 00m:02s]
Threads: 3: [FFV] [86.7% done] [  2668/     0 kb/s] [eta 00m:02s]
Threads: 3: [FVV] [70.0% done] [  4728/     0 kb/s] [eta 00m:06s]
Threads: 3: [FVV] [83.3% done] [ 31440/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [66.7% done] [ 28220/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [70.8% done] [ 31020/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [75.0% done] [ 29012/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.6% done] [ 31084/     0 kb/s] [eta 00m:04s]
Threads: 2: [VV_] [90.9% done] [ 30460/     0 kb/s] [eta 00m:02s]
Threads: 2: [VV_] [100.0% done] [ 37980/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 38408/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=17844
  read : io=100MiB, bw=4,634KiB/s, runt= 22626msec
    slat (msec): min=   37, max=17678, avg=15142.94, stdev=3563.23
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=38145, per=82.13%, avg=11418.00, stdev=12414.25
  write: io=97,160KiB, bw=6,306KiB/s, runt= 15777msec
    slat (msec): min=    0, max=   60, avg= 2.12, stdev= 3.87
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=101131, per=175.23%, avg=33754.00, stdev=58350.23
  cpu          : usr=5.16%, sys=2.02%, ctx=872
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17845
  read : io=100MiB, bw=4,852KiB/s, runt= 21611msec
    slat (msec): min=13156, max=20624, avg=17105.09, stdev=2331.19
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   13, max=19797, per=90.11%, avg=12527.46, stdev=5272.26
  write: io=100MiB, bw=7,639KiB/s, runt= 13725msec
    slat (msec): min=    0, max=   17, avg= 2.09, stdev= 2.38
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=104651, per=271.64%, avg=52325.50, stdev=73999.43
  cpu          : usr=5.94%, sys=1.81%, ctx=791
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=17846
  read : io=100MiB, bw=5,266KiB/s, runt= 19909msec
    slat (msec): min=   63, max=18507, avg=13616.20, stdev=3408.26
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    6, max=25980, per=67.09%, avg=9328.05, stdev=6423.68
  write: io=97,232KiB, bw=10,876KiB/s, runt=  9154msec
    slat (msec): min=    0, max=   13, avg= 1.91, stdev= 2.04
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112595, per=292.26%, avg=56297.50, stdev=79616.69
  cpu          : usr=6.19%, sys=1.85%, ctx=869
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,903KiB/s, minb=4,634KiB/s, maxb=5,266KiB/s, mint=19909msec, maxt=22626msec
  WRITE: io=290MiB, aggrb=19,263KiB/s, minb=6,306KiB/s, maxb=10,876KiB/s, mint=19909msec, maxt=22626msec

Disk stats (read/write):
  sda: ios=3002/1755, merge=974/72388, ticks=76292/1766652, in_queue=1849588, util=98.51%
3.73user 1.25system 0:22.93elapsed 21%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2415minor)pagefaults 0swaps