fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [11.5% done] [  8280/ 11952 kb/s] [eta 00m:23s]
Threads: 3: [mmm] [17.4% done] [  6792/ 13740 kb/s] [eta 00m:19s]
Threads: 3: [mmm] [19.2% done] [  7224/ 11120 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [22.2% done] [ 13692/  5516 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [25.0% done] [ 12352/  2452 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [28.6% done] [ 13380/  3896 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [31.0% done] [ 12596/  4240 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [32.3% done] [ 11208/  5548 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [35.5% done] [  9528/  6288 kb/s] [eta 00m:20s]
Threads: 3: [mmm] [36.4% done] [  4712/  8948 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [38.2% done] [ 14108/   140 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [40.0% done] [  6248/  5152 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [41.7% done] [ 12136/   240 kb/s] [eta 00m:21s]
Threads: 3: [mmm] [42.1% done] [ 10324/  2084 kb/s] [eta 00m:22s]
Threads: 3: [mmm] [44.7% done] [  7068/  3348 kb/s] [eta 00m:21s]
Threads: 3: [mVV] [45.0% done] [ 18016/   224 kb/s] [eta 00m:22s]
Threads: 3: [mVV] [46.3% done] [ 16068/   940 kb/s] [eta 00m:22s]
Threads: 2: [m_V] [46.5% done] [ 16312/   600 kb/s] [eta 00m:23s]
Threads: 1: [m_E] [48.8% done] [ 16424/   556 kb/s] [eta 00m:22s]
Threads: 1: [m__] [57.9% done] [ 13256/     0 kb/s] [eta 00m:16s]
Threads: 1: [m__] [65.7% done] [ 11680/     0 kb/s] [eta 00m:12s]
Threads: 1: [V__] [75.0% done] [ 14172/     0 kb/s] [eta 00m:08s]
fio: (groupid=0): err= 0: pid=2483
  read : io=100MiB, bw=4,169KiB/s, runt= 25148msec
    slat (msec): min=    0, max= 1263, avg=115.36, stdev=290.17
    clat (msec): min=    1, max= 1368, avg=89.49, stdev=174.60
    bw (KiB/s) : min=  162, max=22085, per=37.71%, avg=4717.13, stdev=5331.71
  write: io=25,692KiB, bw=1,100KiB/s, runt= 23911msec
    slat (msec): min=    0, max=    1, avg= 0.02, stdev= 0.13
    clat (msec): min=    0, max= 1245, avg=151.58, stdev=246.10
    bw (KiB/s) : min=    0, max= 9031, per=59.64%, avg=2275.22, stdev=2846.02
  cpu          : usr=3.36%, sys=0.24%, ctx=1931
  IO depths    : 1=0.1%, 2=0.2%, 4=1.2%, 8=98.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=4.9%, 4=2.7%, 10=17.2%, 20=21.2%, 50=23.0%, 100=9.4%
     lat (msec): 250=9.2%, 500=5.8%, 750=3.4%, 1000=2.8%, >=2000=0.2%
fio: (groupid=0): err= 0: pid=2484
  read : io=100MiB, bw=5,223KiB/s, runt= 20073msec
    slat (msec): min=    0, max= 3666, avg=479.61, stdev=949.41
    clat (msec): min=    1, max=  822, avg=74.85, stdev=96.47
    bw (KiB/s) : min=   57, max=13165, per=47.83%, avg=5982.79, stdev=3332.18
  write: io=18,212KiB, bw=1,068KiB/s, runt= 17459msec
    slat (msec): min=    0, max=  723, avg= 1.95, stdev=37.54
    clat (msec): min=    0, max= 1432, avg=94.40, stdev=208.67
    bw (KiB/s) : min=    0, max= 7999, per=70.89%, avg=2704.50, stdev=2959.55
  cpu          : usr=3.99%, sys=0.34%, ctx=1875
  IO depths    : 1=0.2%, 2=0.3%, 4=2.7%, 8=96.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=6.6%, 4=1.6%, 10=7.9%, 20=17.4%, 50=25.8%, 100=16.4%
     lat (msec): 250=18.1%, 500=4.3%, 750=1.1%, 1000=0.6%, >=2000=0.2%
fio: (groupid=0): err= 0: pid=2485
  read : io=100MiB, bw=4,935KiB/s, runt= 21246msec
    slat (msec): min=    0, max= 4082, avg=911.66, stdev=1331.79
    clat (msec): min=    0, max=  843, avg=67.77, stdev=96.33
    bw (KiB/s) : min=  116, max=19779, per=44.44%, avg=5558.94, stdev=4480.33
  write: io=45,180KiB, bw=2,674KiB/s, runt= 17301msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1061, avg=84.33, stdev=161.61
    bw (KiB/s) : min=    0, max= 9868, per=119.64%, avg=4564.21, stdev=3721.95
  cpu          : usr=4.24%, sys=0.36%, ctx=2136
  IO depths    : 1=0.1%, 2=0.3%, 4=3.0%, 8=96.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=10.6%, 4=1.6%, 10=9.1%, 20=17.9%, 50=23.5%, 100=16.6%
     lat (msec): 250=14.3%, 500=4.5%, 750=1.1%, 1000=0.6%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,508KiB/s, minb=4,169KiB/s, maxb=5,223KiB/s, mint=20073msec, maxt=25148msec
  WRITE: io=89,084KiB, aggrb=3,815KiB/s, minb=1,068KiB/s, maxb=2,674KiB/s, mint=20073msec, maxt=25148msec

Disk stats (read/write):
  sda: ios=5459/1656, merge=1063/217, ticks=412804/141300, in_queue=554088, util=98.82%
2.60user 0.29system 0:25.55elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2375minor)pagefaults 0swaps