fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [33.3% done] [  9292/ 52676 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [44.4% done] [   776/ 79800 kb/s] [eta 00m:05s]
Threads: 3: [FmF] [55.6% done] [   940/ 14762 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [     0/ 19928 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.2% done] [  9336/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [67.9% done] [ 30312/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.0% done] [ 30120/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [75.0% done] [ 28152/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [81.5% done] [ 29688/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.2% done] [ 24748/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [96.0% done] [ 35632/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 36548/     0 kb/s] [eta 00m:00s]
Threads: 1: [V__] [100.0% done] [ 30660/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=7733
  read : io=100MiB, bw=3,870KiB/s, runt= 27091msec
    slat (msec): min=  133, max=23932, avg=20473.34, stdev=5130.62
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=30699, per=72.59%, avg=8428.76, stdev=8029.53
  write: io=95,060KiB, bw=5,595KiB/s, runt= 17395msec
    slat (msec): min=    0, max=  144, avg= 2.13, stdev= 6.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=86553, per=176.74%, avg=28917.67, stdev=49913.76
  cpu          : usr=4.34%, sys=1.40%, ctx=983
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=7734
  read : io=100MiB, bw=4,083KiB/s, runt= 25677msec
    slat (msec): min=   95, max=20515, avg=15150.89, stdev=4901.42
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=18656, per=69.32%, avg=8049.14, stdev=5813.78
  write: io=91,684KiB, bw=5,397KiB/s, runt= 17395msec
    slat (msec): min=    0, max=   11, avg= 1.70, stdev= 1.93
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=15915, per=48.63%, avg=7957.50, stdev=11253.60
  cpu          : usr=4.58%, sys=1.37%, ctx=1072
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=7735
  read : io=100MiB, bw=3,981KiB/s, runt= 26337msec
    slat (msec): min=   93, max=22907, avg=17976.56, stdev=4886.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=18436, per=73.60%, avg=8545.67, stdev=5139.73
  write: io=91,332KiB, bw=5,374KiB/s, runt= 17403msec
    slat (msec): min=    0, max=   10, avg= 1.53, stdev= 1.68
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=116932, per=357.33%, avg=58466.00, stdev=82683.41
  cpu          : usr=4.57%, sys=1.34%, ctx=1049
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,611KiB/s, minb=3,870KiB/s, maxb=4,083KiB/s, mint=25677msec, maxt=27091msec
  WRITE: io=272MiB, aggrb=16,362KiB/s, minb=5,374KiB/s, maxb=5,595KiB/s, mint=25677msec, maxt=27091msec

Disk stats (read/write):
  sda: ios=3416/2308, merge=1205/67188, ticks=101840/2023732, in_queue=2125576, util=98.85%
3.62user 1.10system 0:27.44elapsed 17%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2433minor)pagefaults 0swaps