fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [15.8% done] [ 18428/  7380 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [20.0% done] [ 16007/  6338 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [25.0% done] [ 16180/  5460 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [31.6% done] [ 18960/  3692 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [35.0% done] [ 13384/  7832 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [38.1% done] [ 11268/  6196 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [42.9% done] [ 11520/  6728 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [45.5% done] [ 10992/  7224 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [50.0% done] [  3532/ 11744 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [52.2% done] [  9460/  4548 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.5% done] [  8940/  5304 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  5168/  6396 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [60.0% done] [  7700/  3404 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [61.5% done] [  5800/  4248 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [65.4% done] [  5208/  4876 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.2% done] [  9480/  3076 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.1% done] [ 21188/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.9% done] [ 21872/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.8% done] [ 17776/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.6% done] [ 18764/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=32599
  read : io=100MiB, bw=4,622KiB/s, runt= 22682msec
    slat (msec): min=    0, max= 4567, avg=696.66, stdev=1306.18
    clat (msec): min=    2, max=  397, avg=78.02, stdev=69.39
    bw (KiB/s) : min=  221, max= 9516, per=35.41%, avg=4761.26, stdev=2656.40
  write: io=25,644KiB, bw=1,466KiB/s, runt= 17910msec
    slat (msec): min=    0, max=    2, avg= 0.02, stdev= 0.17
    clat (msec): min=    0, max=  553, avg=70.36, stdev=83.53
    bw (KiB/s) : min=    0, max= 9380, per=52.48%, avg=3215.27, stdev=2931.66
  cpu          : usr=4.02%, sys=0.25%, ctx=1943
  IO depths    : 1=0.1%, 2=0.2%, 4=11.2%, 8=88.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.9%, 4=0.6%, 10=5.3%, 20=15.1%, 50=24.9%, 100=26.6%
     lat (msec): 250=22.2%, 500=4.2%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32600
  read : io=100MiB, bw=4,626KiB/s, runt= 22667msec
    slat (msec): min=    0, max= 6098, avg=1262.39, stdev=1978.47
    clat (msec): min=    2, max=  403, avg=71.78, stdev=65.46
    bw (KiB/s) : min=   88, max= 9256, per=38.73%, avg=5207.64, stdev=3018.14
  write: io=32,276KiB, bw=2,009KiB/s, runt= 16450msec
    slat (msec): min=    0, max=    4, avg= 0.06, stdev= 0.32
    clat (msec): min=    0, max=  743, avg=86.04, stdev=84.29
    bw (KiB/s) : min=    0, max= 9630, per=51.17%, avg=3135.15, stdev=2814.66
  cpu          : usr=4.57%, sys=0.32%, ctx=1780
  IO depths    : 1=0.1%, 2=0.4%, 4=14.1%, 8=85.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.4%, 4=0.4%, 10=3.1%, 20=14.7%, 50=26.8%, 100=30.1%
     lat (msec): 250=20.6%, 500=3.7%, 750=0.1%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=32601
  read : io=100MiB, bw=4,482KiB/s, runt= 23393msec
    slat (msec): min=    0, max= 6404, avg=2350.53, stdev=2488.74
    clat (msec): min=    0, max=  365, avg=60.88, stdev=66.26
    bw (KiB/s) : min=   21, max=17839, per=39.47%, avg=5307.28, stdev=4073.62
  write: io=49,248KiB, bw=2,959KiB/s, runt= 17038msec
    slat (msec): min=    0, max=    3, avg= 0.05, stdev= 0.27
    clat (msec): min=    0, max=  864, avg=76.35, stdev=85.35
    bw (KiB/s) : min=    0, max= 9539, per=56.57%, avg=3466.08, stdev=2632.40
  cpu          : usr=4.63%, sys=0.22%, ctx=1963
  IO depths    : 1=0.1%, 2=0.3%, 4=16.5%, 8=83.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.7%, 4=1.4%, 10=8.5%, 20=17.3%, 50=26.4%, 100=23.9%
     lat (msec): 250=17.7%, 500=2.9%, 750=0.1%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,447KiB/s, minb=4,482KiB/s, maxb=4,626KiB/s, mint=22667msec, maxt=23393msec
  WRITE: io=105MiB, aggrb=6,127KiB/s, minb=1,466KiB/s, maxb=2,959KiB/s, mint=22667msec, maxt=23393msec

Disk stats (read/write):
  sda: ios=4772/1991, merge=1622/375, ticks=336860/185876, in_queue=522736, util=99.48%
3.12user 0.26system 0:23.66elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2382minor)pagefaults 0swaps