fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [7.1% done] [  5541/     0 kb/s] [eta 00m:39s]
Threads: 3: [mFm] [9.8% done] [  6648/ 28490 kb/s] [eta 00m:37s]
Threads: 3: [FFm] [10.6% done] [  1378/  5312 kb/s] [eta 00m:42s]
Threads: 3: [FFm] [12.5% done] [  2914/     0 kb/s] [eta 00m:42s]
Threads: 3: [FFm] [14.3% done] [  2445/     0 kb/s] [eta 00m:42s]
Threads: 3: [FFm] [53.3% done] [  1394/ 55780 kb/s] [eta 00m:07s]
Threads: 3: [FFm] [52.9% done] [   803/     0 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [   799/ 20838 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [     0/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [68.2% done] [ 25856/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 29384/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [81.0% done] [ 23154/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [90.0% done] [ 31503/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 33843/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 34021/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30302/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30373/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=32557
  read : io=100MiB, bw=4,453KiB/s, runt= 23546msec
    slat (msec): min=   87, max=19346, avg=14401.50, stdev=4857.24
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    7, max=15161, per=62.42%, avg=8338.05, stdev=4969.68
  write: io=89,372KiB, bw=6,464KiB/s, runt= 14156msec
    slat (msec): min=    0, max=  152, avg= 2.66, stdev=11.22
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=24006, per=61.59%, avg=12003.00, stdev=16974.81
  cpu          : usr=5.05%, sys=1.58%, ctx=1027
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32558
  read : io=100MiB, bw=4,560KiB/s, runt= 22995msec
    slat (msec): min=13604, max=22055, avg=18353.93, stdev=2730.92
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   16, max=19996, per=86.41%, avg=11544.13, stdev=6170.42
  write: io=100MiB, bw=7,403KiB/s, runt= 14164msec
    slat (msec): min=    0, max=   16, avg= 1.87, stdev= 2.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=112132, per=287.67%, avg=56066.00, stdev=79289.30
  cpu          : usr=5.64%, sys=1.20%, ctx=796
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32559
  read : io=100MiB, bw=4,477KiB/s, runt= 23420msec
    slat (msec): min=   73, max=13262, avg=7792.45, stdev=3845.51
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=15384, per=43.12%, avg=5760.17, stdev=4548.72
  write: io=77,816KiB, bw=5,627KiB/s, runt= 14160msec
    slat (msec): min=    0, max=   84, avg= 1.83, stdev= 5.18
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=100649, per=172.44%, avg=33609.33, stdev=58058.12
  cpu          : usr=4.90%, sys=1.76%, ctx=1227
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,359KiB/s, minb=4,453KiB/s, maxb=4,560KiB/s, mint=22995msec, maxt=23546msec
  WRITE: io=263MiB, aggrb=19,490KiB/s, minb=5,627KiB/s, maxb=7,403KiB/s, mint=22995msec, maxt=23546msec

Disk stats (read/write):
  sda: ios=3571/1628, merge=1070/65592, ticks=72772/1822840, in_queue=1907052, util=99.06%
3.68user 1.06system 0:23.88elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2411minor)pagefaults 0swaps