fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [75.0% done] [   572/     0 kb/s] [eta 00m:01s]
Threads: 3: [FFF] [100.0% done] [   532/  5068 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [71.4% done] [  4284/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFF] [84.6% done] [ 16000/     0 kb/s] [eta 00m:02s]
Threads: 3: [VFV] [66.7% done] [  7324/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [68.4% done] [ 35412/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [70.0% done] [ 43132/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.9% done] [ 46400/     0 kb/s] [eta 00m:04s]
Threads: 2: [_VV] [94.1% done] [ 47316/     0 kb/s] [eta 00m:01s]
Threads: 2: [_VV] [100.0% done] [ 45736/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [100.0% done] [ 43859/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=28637
  read : io=100MiB, bw=6,744KiB/s, runt= 15546msec
    clat (msec): min=    0, max=  235, avg= 3.23, stdev=14.68
    bw (KiB/s) : min=    0, max=28541, per=81.07%, avg=13849.08, stdev=9139.58
  write: io=96,532KiB, bw=10,453KiB/s, runt=  9456msec
    clat (msec): min=    0, max=   40, avg= 0.21, stdev= 2.05
    bw (KiB/s) : min=    0, max=114802, per=180.82%, avg=42787.67, stdev=62733.75
  cpu          : usr=7.95%, sys=2.32%, ctx=805
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=87.0%, 4=4.0%, 10=5.5%, 20=1.6%, 50=1.1%, 100=0.5%
     lat (msec): 250=0.3%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28638
  read : io=100MiB, bw=5,694KiB/s, runt= 18415msec
    clat (msec): min=    0, max=  216, avg= 4.75, stdev=20.41
    bw (KiB/s) : min=   20, max=35299, per=65.47%, avg=11184.12, stdev=12094.12
  write: io=97,740KiB, bw=7,850KiB/s, runt= 12749msec
    clat (msec): min=    0, max=   31, avg= 0.07, stdev= 1.10
    bw (KiB/s) : min=    0, max=81068, per=142.63%, avg=33751.33, stdev=42202.12
  cpu          : usr=7.04%, sys=1.74%, ctx=796
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=87.1%, 4=3.9%, 10=6.0%, 20=0.6%, 50=0.8%, 100=0.7%
     lat (msec): 250=0.9%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=28639
  read : io=100MiB, bw=5,843KiB/s, runt= 17945msec
    clat (msec): min=    0, max=  216, avg= 3.31, stdev=17.85
    bw (KiB/s) : min=   11, max=28345, per=81.55%, avg=13930.69, stdev=9859.61
  write: io=98MiB, bw=8,483KiB/s, runt= 12111msec
    clat (msec): min=    0, max=   78, avg= 0.19, stdev= 2.36
    bw (KiB/s) : min=    0, max=55853, per=147.60%, avg=34926.00, stdev=30444.51
  cpu          : usr=7.11%, sys=1.85%, ctx=1092
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=87.8%, 4=3.9%, 10=6.8%, 20=0.4%, 50=0.0%, 100=0.1%
     lat (msec): 250=0.9%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=17,082KiB/s, minb=5,694KiB/s, maxb=6,744KiB/s, mint=15546msec, maxt=18415msec
  WRITE: io=288MiB, aggrb=23,663KiB/s, minb=7,850KiB/s, maxb=10,453KiB/s, mint=15546msec, maxt=18415msec

Disk stats (read/write):
  sda: ios=2727/1526, merge=1559/71916, ticks=30200/1415396, in_queue=1498808, util=98.74%
3.81user 1.02system 0:18.78elapsed 25%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (3major+1062minor)pagefaults 0swaps