fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=posixaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [10.3% done] [  7064/ 43908 kb/s] [eta 00m:26s]
Threads: 3: [FFm] [12.5% done] [  5448/ 45196 kb/s] [eta 00m:28s]
Threads: 3: [FFm] [25.0% done] [  2692/ 16568 kb/s] [eta 00m:15s]
Threads: 3: [FFm] [26.1% done] [  1524/     0 kb/s] [eta 00m:17s]
Threads: 3: [FFF] [100.0% done] [   504/ 61976 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  8720/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [72.7% done] [ 27176/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.3% done] [ 28132/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [85.7% done] [ 24844/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.0% done] [ 31712/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 32580/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 36588/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 26568/     0 kb/s] [eta 00m:00s]
Threads: 2: [VVE] [100.0% done] [ 30024/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=14170
  read : io=100MiB, bw=4,328KiB/s, runt= 24226msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  764, avg=60.61, stdev=100.42
    bw (KiB/s) : min=    0, max=16440, per=59.47%, avg=7719.60, stdev=4864.14
  write: io=89,104KiB, bw=6,195KiB/s, runt= 14728msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  166, avg= 0.83, stdev= 8.40
    bw (KiB/s) : min=    0, max=30742, per=82.36%, avg=15371.00, stdev=21737.88
  cpu          : usr=2.77%, sys=1.57%, ctx=5339
  IO depths    : 1=1.6%, 2=53.7%, 4=30.8%, 8=13.8%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=48.5%, 4=0.2%, 10=20.2%, 20=12.4%, 50=5.0%, 100=1.1%
     lat (msec): 250=9.8%, 500=2.5%, 750=0.2%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14171
  read : io=100MiB, bw=4,348KiB/s, runt= 24098msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  711, avg=46.94, stdev=93.01
    bw (KiB/s) : min=   15, max=16777, per=66.65%, avg=8652.44, stdev=5967.60
  write: io=98MiB, bw=7,008KiB/s, runt= 14724msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  191, avg= 0.61, stdev= 7.81
    bw (KiB/s) : min=    0, max=54457, per=145.90%, avg=27228.50, stdev=38506.91
  cpu          : usr=3.24%, sys=1.71%, ctx=5261
  IO depths    : 1=1.5%, 2=56.1%, 4=31.5%, 8=10.9%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=50.0%, 4=0.5%, 10=20.1%, 20=15.1%, 50=5.4%, 100=1.5%
     lat (msec): 250=4.2%, 500=2.8%, 750=0.3%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=14172
  read : io=100MiB, bw=4,447KiB/s, runt= 23575msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  535, avg=67.68, stdev=103.34
    bw (KiB/s) : min=   23, max=14490, per=49.57%, avg=6434.18, stdev=4475.50
  write: io=78,544KiB, bw=5,462KiB/s, runt= 14724msec
    slat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    clat (msec): min=    0, max=  411, avg= 2.02, stdev=22.40
    bw (KiB/s) : min=    0, max=10657, per=28.55%, avg=5328.50, stdev=7535.64
  cpu          : usr=2.75%, sys=1.70%, ctx=5385
  IO depths    : 1=1.0%, 2=52.5%, 4=29.9%, 8=16.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=46.9%, 4=0.1%, 10=17.2%, 20=14.9%, 50=5.3%, 100=1.7%
     lat (msec): 250=9.6%, 500=4.1%, 750=0.1%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,981KiB/s, minb=4,328KiB/s, maxb=4,447KiB/s, mint=23575msec, maxt=24226msec
  WRITE: io=262MiB, aggrb=18,663KiB/s, minb=5,462KiB/s, maxb=7,008KiB/s, mint=23575msec, maxt=24226msec

Disk stats (read/write):
  sda: ios=3498/1836, merge=1272/65259, ticks=96952/1962192, in_queue=2059148, util=99.15%
2.14user 1.25system 0:24.51elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2469minor)pagefaults 0swaps