fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [15.8% done] [ 22236/  4732 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [20.0% done] [ 11488/ 12516 kb/s] [eta 00m:16s]
Threads: 3: [mmm] [25.0% done] [  9388/ 12164 kb/s] [eta 00m:15s]
Threads: 3: [mmm] [30.0% done] [ 12252/  8940 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [33.3% done] [ 13720/  7080 kb/s] [eta 00m:14s]
Threads: 3: [mmm] [38.1% done] [  8099/ 10962 kb/s] [eta 00m:13s]
Threads: 3: [mmm] [42.9% done] [ 14060/  5348 kb/s] [eta 00m:12s]
Threads: 3: [mmm] [47.6% done] [ 11544/  5240 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [50.0% done] [ 13000/  2116 kb/s] [eta 00m:11s]
Threads: 3: [mmm] [54.5% done] [ 15252/     0 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [56.5% done] [  8068/  5348 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [58.3% done] [  6888/  4744 kb/s] [eta 00m:10s]
Threads: 3: [mmm] [62.5% done] [  7536/  3860 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [64.0% done] [  8216/  2428 kb/s] [eta 00m:09s]
Threads: 3: [mmm] [68.0% done] [  6852/  2640 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [72.0% done] [ 20432/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [76.0% done] [ 20892/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [80.0% done] [ 20216/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.0% done] [ 20324/     0 kb/s] [eta 00m:04s]
fio: (groupid=0): err= 0: pid=1592
  read : io=100MiB, bw=4,814KiB/s, runt= 21778msec
    slat (msec): min=    0, max= 4268, avg=560.45, stdev=1129.51
    clat (msec): min=    1, max=  814, avg=77.34, stdev=73.49
    bw (KiB/s) : min=    3, max=11921, per=34.06%, avg=4883.24, stdev=3167.61
  write: io=33,780KiB, bw=2,001KiB/s, runt= 17285msec
    slat (msec): min=    0, max=    2, avg= 0.06, stdev= 0.27
    clat (msec): min=    0, max=  815, avg=95.59, stdev=131.76
    bw (KiB/s) : min=    0, max= 7931, per=63.16%, avg=3453.00, stdev=2870.58
  cpu          : usr=4.00%, sys=0.50%, ctx=1773
  IO depths    : 1=0.1%, 2=0.2%, 4=11.7%, 8=88.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=2.1%, 4=0.8%, 10=4.3%, 20=13.9%, 50=24.5%, 100=27.6%
     lat (msec): 250=23.1%, 500=2.9%, 750=0.5%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1593
  read : io=100MiB, bw=4,802KiB/s, runt= 21832msec
    slat (msec): min=    0, max= 6022, avg=999.44, stdev=1782.27
    clat (msec): min=    1, max=  567, avg=74.18, stdev=69.36
    bw (KiB/s) : min=   24, max=11103, per=37.42%, avg=5364.76, stdev=2983.67
  write: io=30,312KiB, bw=1,949KiB/s, runt= 15923msec
    slat (msec): min=    0, max=    4, avg= 0.07, stdev= 0.35
    clat (msec): min=    0, max=  580, avg=88.53, stdev=89.82
    bw (KiB/s) : min=    0, max= 8595, per=67.90%, avg=3711.93, stdev=3107.02
  cpu          : usr=3.94%, sys=0.27%, ctx=1745
  IO depths    : 1=0.1%, 2=0.3%, 4=11.9%, 8=87.6%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.3%, 4=0.5%, 10=2.8%, 20=11.6%, 50=30.4%, 100=30.1%
     lat (msec): 250=20.6%, 500=3.2%, 750=0.3%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1594
  read : io=100MiB, bw=4,779KiB/s, runt= 21941msec
    slat (msec): min=    0, max= 5263, avg=1072.94, stdev=1684.90
    clat (msec): min=    1, max=  556, avg=75.37, stdev=71.46
    bw (KiB/s) : min=   64, max=13179, per=36.98%, avg=5301.85, stdev=3237.73
  write: io=28,196KiB, bw=1,729KiB/s, runt= 16694msec
    slat (msec): min=    0, max=    2, avg= 0.03, stdev= 0.20
    clat (msec): min=    0, max=  780, avg=72.55, stdev=77.02
    bw (KiB/s) : min=    0, max= 7817, per=59.29%, avg=3241.40, stdev=2739.35
  cpu          : usr=3.96%, sys=0.33%, ctx=1806
  IO depths    : 1=0.1%, 2=0.2%, 4=14.5%, 8=85.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=0.7%, 4=0.4%, 10=6.0%, 20=13.6%, 50=27.8%, 100=26.6%
     lat (msec): 250=21.6%, 500=3.0%, 750=0.1%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,337KiB/s, minb=4,779KiB/s, maxb=4,814KiB/s, mint=21778msec, maxt=21941msec
  WRITE: io=92,288KiB, aggrb=5,467KiB/s, minb=1,729KiB/s, maxb=2,001KiB/s, mint=21778msec, maxt=21941msec

Disk stats (read/write):
  sda: ios=4624/1453, merge=1293/212, ticks=364900/160940, in_queue=525836, util=99.32%
2.64user 0.26system 0:22.19elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2380minor)pagefaults 0swaps