fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [27.3% done] [  2223/ 55315 kb/s] [eta 00m:08s]
Threads: 3: [mFF] [26.7% done] [  1408/     0 kb/s] [eta 00m:11s]
Threads: 3: [mFF] [27.8% done] [  1145/     0 kb/s] [eta 00m:13s]
Threads: 3: [mFF] [28.6% done] [  1280/     0 kb/s] [eta 00m:15s]
Threads: 3: [mFF] [29.2% done] [   936/     0 kb/s] [eta 00m:17s]
Threads: 3: [mFF] [29.6% done] [  1220/     0 kb/s] [eta 00m:19s]
Threads: 3: [mFF] [50.0% done] [   749/ 29727 kb/s] [eta 00m:09s]
Threads: 3: [FFF] [100.0% done] [     0/ 26432 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFV] [68.4% done] [  1543/     0 kb/s] [eta 00m:06s]
Threads: 3: [FFV] [73.7% done] [  4340/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [68.2% done] [ 18116/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 29676/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 31235/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 29841/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [79.2% done] [ 30755/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.0% done] [ 32236/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [91.3% done] [ 30259/     0 kb/s] [eta 00m:02s]
Threads: 1: [V__] [100.0% done] [ 37620/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=25002
  read : io=100MiB, bw=4,445KiB/s, runt= 23589msec
    clat (msec): min=    0, max=  262, avg= 9.47, stdev=32.38
    bw (KiB/s) : min=   11, max=34807, per=48.07%, avg=6409.60, stdev=9232.26
  write: io=88,612KiB, bw=5,937KiB/s, runt= 15283msec
    clat (msec): min=    0, max=  129, avg= 0.51, stdev= 5.39
    bw (KiB/s) : min=    0, max= 5657, per=16.29%, avg=3080.00, stdev=2861.85
  cpu          : usr=4.97%, sys=1.41%, ctx=907
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=82.6%, 4=4.0%, 10=6.6%, 20=2.1%, 50=1.6%, 100=1.1%
     lat (msec): 250=1.9%, 500=0.1%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25003
  read : io=100MiB, bw=4,651KiB/s, runt= 22541msec
    clat (msec): min=    0, max=  262, avg= 4.83, stdev=21.90
    bw (KiB/s) : min=    2, max=21569, per=75.57%, avg=10077.28, stdev=6360.50
  write: io=99,052KiB, bw=6,990KiB/s, runt= 14509msec
    clat (msec): min=    0, max=   34, avg= 0.10, stdev= 1.44
    bw (KiB/s) : min=    0, max=77938, per=233.73%, avg=44205.00, stdev=40010.37
  cpu          : usr=5.11%, sys=1.46%, ctx=856
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=86.0%, 4=4.5%, 10=6.3%, 20=0.8%, 50=1.1%, 100=0.3%
     lat (msec): 250=0.9%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=25004
  read : io=100MiB, bw=4,771KiB/s, runt= 21976msec
    clat (msec): min=    0, max=  412, avg= 6.17, stdev=25.35
    bw (KiB/s) : min=   17, max=19963, per=67.01%, avg=8936.05, stdev=6156.03
  write: io=94,616KiB, bw=7,889KiB/s, runt= 12280msec
    clat (msec): min=    0, max=   21, avg= 0.05, stdev= 0.97
    bw (KiB/s) : min=    0, max=45989, per=121.58%, avg=22994.50, stdev=32519.13
  cpu          : usr=5.57%, sys=1.58%, ctx=866
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=83.9%, 4=5.3%, 10=6.3%, 20=1.4%, 50=1.5%, 100=0.5%
     lat (msec): 250=1.1%, 500=0.1%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,335KiB/s, minb=4,445KiB/s, maxb=4,771KiB/s, mint=21976msec, maxt=23589msec
  WRITE: io=276MiB, aggrb=18,913KiB/s, minb=5,937KiB/s, maxb=7,889KiB/s, mint=21976msec, maxt=23589msec

Disk stats (read/write):
  sda: ios=3368/1788, merge=1358/68787, ticks=84688/1782508, in_queue=1871340, util=98.97%
3.55user 1.00system 0:23.96elapsed 19%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (3major+1084minor)pagefaults 0swaps