fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFm] [12.0% done] [  6536/ 93664 kb/s] [eta 00m:22s]
Threads: 3: [FFF] [100.0% done] [  2386/ 39047 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.2% done] [  2587/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [69.6% done] [ 20318/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [73.9% done] [ 26387/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [78.3% done] [ 26076/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 26844/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [95.2% done] [ 35465/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 35910/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31633/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30495/     0 kb/s] [eta 00m:00s]
Threads: 2: [VEV] [100.0% done] [ 33197/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=18926
  read : io=100MiB, bw=4,269KiB/s, runt= 24560msec
    clat (msec): min=    0, max=  342, avg= 7.38, stdev=29.84
    bw (KiB/s) : min=    0, max=18783, per=57.06%, avg=7307.62, stdev=5792.06
  write: io=91,208KiB, bw=6,353KiB/s, runt= 14699msec
    clat (msec): min=    0, max=  117, avg= 0.30, stdev= 4.74
    bw (KiB/s) : min=    0, max=29106, per=53.04%, avg=10273.00, stdev=13758.30
  cpu          : usr=4.89%, sys=1.40%, ctx=918
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=83.5%, 4=4.5%, 10=6.7%, 20=1.7%, 50=1.6%, 100=0.7%
     lat (msec): 250=1.2%, 500=0.1%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=18927
  read : io=100MiB, bw=4,372KiB/s, runt= 23980msec
    clat (msec): min=    0, max=  342, avg= 5.66, stdev=26.91
    bw (KiB/s) : min=   15, max=19251, per=74.52%, avg=9544.40, stdev=6200.37
  write: io=97,352KiB, bw=6,781KiB/s, runt= 14699msec
    clat (msec): min=    0, max=   47, avg= 0.20, stdev= 2.13
    bw (KiB/s) : min=    0, max=117981, per=226.11%, avg=43793.67, stdev=64596.52
  cpu          : usr=5.14%, sys=1.52%, ctx=847
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=85.2%, 4=4.5%, 10=6.2%, 20=1.4%, 50=1.4%, 100=0.2%
     lat (msec): 250=0.8%, 500=0.1%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=18928
  read : io=100MiB, bw=4,290KiB/s, runt= 24438msec
    clat (msec): min=    0, max=  324, avg= 7.30, stdev=28.30
    bw (KiB/s) : min=    1, max=16906, per=54.09%, avg=6928.08, stdev=4803.84
  write: io=89,460KiB, bw=6,233KiB/s, runt= 14695msec
    clat (msec): min=    0, max=   57, avg= 0.27, stdev= 2.66
    bw (KiB/s) : min=    0, max=39409, per=72.71%, avg=14082.33, stdev=21979.39
  cpu          : usr=4.99%, sys=1.26%, ctx=991
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=81.5%, 4=4.9%, 10=7.5%, 20=2.0%, 50=2.2%, 100=0.8%
     lat (msec): 250=1.0%, 500=0.1%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,808KiB/s, minb=4,269KiB/s, maxb=4,372KiB/s, mint=23980msec, maxt=24560msec
  WRITE: io=272MiB, aggrb=19,368KiB/s, minb=6,233KiB/s, maxb=6,781KiB/s, mint=23980msec, maxt=24560msec

Disk stats (read/write):
  sda: ios=3492/1841, merge=1253/67665, ticks=88560/2062780, in_queue=2151764, util=89.84%
3.66user 1.02system 0:27.57elapsed 16%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (3major+1061minor)pagefaults 0swaps