fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [12.5% done] [ 13478/ 10296 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [17.4% done] [ 18895/  5233 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [23.8% done] [ 15396/  8029 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [27.3% done] [ 10089/ 12283 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [33.3% done] [ 11211/  8208 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [36.4% done] [ 16444/  3254 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [40.9% done] [ 10085/  8508 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [45.5% done] [ 13763/  4043 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [47.8% done] [ 14592/  3080 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [52.2% done] [ 12779/  2234 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [56.5% done] [  7001/  6282 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  7745/  4266 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [62.5% done] [  7972/  3368 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [ 10662/   629 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [68.0% done] [  4372/  5530 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 18464/   524 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 19699/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 21219/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 20313/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=20075
  read : io=100MiB, bw=4,771KiB/s, runt= 21976msec
    slat (msec): min=    0, max= 4840, avg=1205.52, stdev=1737.16
    clat (msec): min=    1, max=  835, avg=70.60, stdev=77.74
    bw (KiB/s) : min=   75, max=12043, per=35.53%, avg=5085.57, stdev=3019.74
  write: io=40,248KiB, bw=2,402KiB/s, runt= 17153msec
    slat (msec): min=    0, max=    2, avg= 0.04, stdev= 0.23
    clat (msec): min=    0, max=  656, avg=81.17, stdev=96.28
    bw (KiB/s) : min=    0, max= 8568, per=56.63%, avg=3252.32, stdev=2788.47
  cpu          : usr=4.35%, sys=0.31%, ctx=1822
  IO depths    : 1=0.1%, 2=0.3%, 4=14.2%, 8=85.3%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=2.3%, 4=0.9%, 10=6.3%, 20=15.8%, 50=25.9%, 100=25.8%
     lat (msec): 250=17.9%, 500=4.3%, 750=0.5%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20076
  read : io=100MiB, bw=4,870KiB/s, runt= 21531msec
    slat (msec): min=    0, max= 5495, avg=940.61, stdev=1653.75
    clat (msec): min=    0, max=  660, avg=74.92, stdev=76.74
    bw (KiB/s) : min=  178, max=12714, per=36.45%, avg=5217.08, stdev=3212.56
  write: io=28,572KiB, bw=1,778KiB/s, runt= 16455msec
    slat (msec): min=    0, max=    4, avg= 0.06, stdev= 0.32
    clat (msec): min=    0, max=  799, avg=89.59, stdev=92.40
    bw (KiB/s) : min=    0, max= 8698, per=49.98%, avg=2870.53, stdev=2962.41
  cpu          : usr=4.35%, sys=0.52%, ctx=1769
  IO depths    : 1=0.1%, 2=0.2%, 4=11.0%, 8=88.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=1.2%, 4=0.4%, 10=3.6%, 20=11.3%, 50=29.5%, 100=29.0%
     lat (msec): 250=20.2%, 500=4.2%, 750=0.4%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=20077
  read : io=100MiB, bw=4,929KiB/s, runt= 21272msec
    slat (msec): min=    0, max= 4792, avg=663.50, stdev=1291.14
    clat (msec): min=    3, max=  601, avg=76.28, stdev=67.93
    bw (KiB/s) : min=   16, max=10627, per=35.13%, avg=5027.92, stdev=2963.70
  write: io=27,392KiB, bw=1,700KiB/s, runt= 16498msec
    slat (msec): min=    0, max=    6, avg= 0.13, stdev= 0.67
    clat (msec): min=    0, max=  808, avg=84.94, stdev=122.26
    bw (KiB/s) : min=    0, max=10034, per=59.95%, avg=3443.14, stdev=3637.63
  cpu          : usr=4.23%, sys=0.30%, ctx=1787
  IO depths    : 1=0.1%, 2=0.2%, 4=9.9%, 8=89.7%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=2.6%, 4=0.8%, 10=3.6%, 20=12.4%, 50=26.5%, 100=29.1%
     lat (msec): 250=21.0%, 500=3.3%, 750=0.4%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,314KiB/s, minb=4,771KiB/s, maxb=4,929KiB/s, mint=21272msec, maxt=21976msec
  WRITE: io=96,212KiB, aggrb=5,743KiB/s, minb=1,700KiB/s, maxb=2,402KiB/s, mint=21272msec, maxt=21976msec

Disk stats (read/write):
  sda: ios=4647/1560, merge=1482/410, ticks=352468/156800, in_queue=509268, util=99.38%
2.85user 0.39system 0:22.25elapsed 14%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2374minor)pagefaults 0swaps