fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [16.7% done] [  9310/ 80010 kb/s] [eta 00m:15s]
Threads: 3: [mFm] [19.0% done] [  5412/ 62520 kb/s] [eta 00m:17s]
Threads: 3: [mFF] [19.2% done] [  1181/ 39478 kb/s] [eta 00m:21s]
Threads: 3: [mFF] [24.0% done] [   848/  5528 kb/s] [eta 00m:19s]
Threads: 3: [mFF] [36.8% done] [   872/ 17840 kb/s] [eta 00m:12s]
Threads: 3: [mFF] [36.4% done] [  1080/     0 kb/s] [eta 00m:14s]
Threads: 3: [mFF] [37.5% done] [   956/   396 kb/s] [eta 00m:15s]
Threads: 3: [mFF] [38.5% done] [   964/     0 kb/s] [eta 00m:16s]
Threads: 3: [mFF] [39.3% done] [  1268/     0 kb/s] [eta 00m:17s]
Threads: 3: [mFF] [40.0% done] [   744/     0 kb/s] [eta 00m:18s]
Threads: 3: [FFF] [100.0% done] [   584/ 41904 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [69.2% done] [   716/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [67.9% done] [ 21576/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [69.0% done] [ 35312/     0 kb/s] [eta 00m:09s]
Threads: 3: [VVV] [72.4% done] [ 30860/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [73.3% done] [ 28952/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [79.3% done] [ 32279/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [82.8% done] [ 25272/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [89.3% done] [ 31712/     0 kb/s] [eta 00m:03s]
Threads: 1: [V__] [100.0% done] [ 35076/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4780
  read : io=100MiB, bw=3,798KiB/s, runt= 27603msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1166, avg=93.84, stdev=191.95
    bw (KiB/s) : min=    0, max=32399, per=40.82%, avg=4651.90, stdev=7623.20
  write: io=78,972KiB, bw=4,446KiB/s, runt= 18188msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max= 1031, avg= 9.30, stdev=64.78
    bw (KiB/s) : min=    0, max=47710, per=57.75%, avg=8775.17, stdev=19133.64
  cpu          : usr=2.32%, sys=1.48%, ctx=7606
  IO depths    : 1=1.0%, 2=51.2%, 4=30.3%, 8=17.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.4%, 4=0.9%, 10=19.0%, 20=15.9%, 50=5.0%, 100=2.0%
     lat (msec): 250=4.3%, 500=3.5%, 750=2.7%, 1000=0.9%, >=2000=0.3%
fio: (groupid=0): err= 0: pid=4781
  read : io=100MiB, bw=4,010KiB/s, runt= 26146msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  918, avg=47.18, stdev=100.54
    bw (KiB/s) : min=    6, max=22032, per=79.34%, avg=9041.95, stdev=6621.71
  write: io=96,092KiB, bw=5,410KiB/s, runt= 18188msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  335, avg= 2.48, stdev=15.44
    bw (KiB/s) : min=    0, max=53755, per=143.35%, avg=21781.00, stdev=28289.98
  cpu          : usr=3.38%, sys=1.35%, ctx=7147
  IO depths    : 1=2.2%, 2=51.3%, 4=34.4%, 8=12.1%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=44.0%, 4=0.7%, 10=23.0%, 20=19.1%, 50=4.4%, 100=0.7%
     lat (msec): 250=6.2%, 500=1.4%, 750=0.2%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4782
  read : io=100MiB, bw=3,970KiB/s, runt= 26405msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  839, avg=53.94, stdev=105.13
    bw (KiB/s) : min=    1, max=22732, per=75.21%, avg=8570.71, stdev=6749.71
  write: io=94,816KiB, bw=5,339KiB/s, runt= 18184msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  423, avg= 2.49, stdev=25.35
    bw (KiB/s) : min=    0, max=87818, per=209.10%, avg=31771.33, stdev=48682.33
  cpu          : usr=3.51%, sys=1.65%, ctx=7469
  IO depths    : 1=0.9%, 2=53.3%, 4=32.3%, 8=13.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=45.7%, 4=3.0%, 10=18.6%, 20=18.2%, 50=3.8%, 100=0.4%
     lat (msec): 250=7.4%, 500=2.1%, 750=0.5%, 1000=0.2%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,396KiB/s, minb=3,798KiB/s, maxb=4,010KiB/s, mint=26146msec, maxt=27603msec
  WRITE: io=264MiB, aggrb=15,194KiB/s, minb=4,446KiB/s, maxb=5,410KiB/s, mint=26146msec, maxt=27603msec

Disk stats (read/write):
  sda: ios=3506/2416, merge=1302/64874, ticks=96264/2047348, in_queue=2146708, util=98.29%
2.51user 1.27system 0:28.02elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2486minor)pagefaults 0swaps