fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [7.7% done] [  8212/ 57820 kb/s] [eta 00m:36s]
Threads: 3: [mFm] [9.5% done] [  4216/ 27940 kb/s] [eta 00m:38s]
Threads: 3: [mFm] [12.2% done] [  5888/     0 kb/s] [eta 00m:36s]
Threads: 3: [FFm] [13.3% done] [  2460/ 30412 kb/s] [eta 00m:39s]
Threads: 3: [FFm] [14.6% done] [  1864/     0 kb/s] [eta 00m:41s]
Threads: 3: [FFm] [16.0% done] [  1956/     0 kb/s] [eta 00m:42s]
Threads: 3: [FFm] [47.4% done] [   844/ 45668 kb/s] [eta 00m:10s]
Threads: 3: [FFF] [100.0% done] [     0/ 31650 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [ 15635/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 29992/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 23252/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 24944/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.5% done] [ 34028/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 33580/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 29208/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30228/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 27394/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=26987
  read : io=100MiB, bw=4,399KiB/s, runt= 23832msec
    slat (msec): min=   89, max=18479, avg=13252.49, stdev=4950.01
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=21013, per=56.16%, avg=7411.95, stdev=5358.06
  write: io=86,220KiB, bw=6,233KiB/s, runt= 14164msec
    slat (msec): min=    0, max=  285, avg= 2.00, stdev= 7.85
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=73317, per=129.38%, avg=24440.67, stdev=42328.15
  cpu          : usr=5.00%, sys=1.51%, ctx=964
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26988
  read : io=100MiB, bw=4,524KiB/s, runt= 23174msec
    slat (msec): min=  131, max=20992, avg=16464.15, stdev=3856.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=22423, per=74.58%, avg=9843.61, stdev=6350.37
  write: io=97,796KiB, bw=7,070KiB/s, runt= 14164msec
    slat (msec): min=    0, max=  147, avg= 2.13, stdev= 6.59
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=88359, per=167.32%, avg=31608.33, stdev=49253.74
  cpu          : usr=5.47%, sys=1.69%, ctx=819
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=26989
  read : io=100MiB, bw=4,425KiB/s, runt= 23692msec
    slat (msec): min=   93, max=14344, avg=8975.23, stdev=3957.02
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   14, max=13072, per=46.20%, avg=6098.11, stdev=4179.67
  write: io=77,288KiB, bw=5,587KiB/s, runt= 14164msec
    slat (msec): min=    0, max=   10, avg= 1.41, stdev= 1.60
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116817, per=309.19%, avg=58408.50, stdev=82602.09
  cpu          : usr=4.64%, sys=1.60%, ctx=1043
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,199KiB/s, minb=4,399KiB/s, maxb=4,524KiB/s, mint=23174msec, maxt=23832msec
  WRITE: io=255MiB, aggrb=18,891KiB/s, minb=5,587KiB/s, maxb=7,070KiB/s, mint=23174msec, maxt=23832msec

Disk stats (read/write):
  sda: ios=3629/1430, merge=1543/63716, ticks=101836/1595940, in_queue=1763396, util=99.22%
3.61user 1.17system 0:24.16elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2413minor)pagefaults 0swaps