fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [5.0% done] [   215/  1987 kb/s] [eta 00m:57s]
Threads: 3: [mmm] [6.7% done] [   995/   203 kb/s] [eta 00m:56s]
Threads: 3: [mmm] [8.3% done] [ 13186/     0 kb/s] [eta 00m:55s]
Threads: 3: [mmm] [10.0% done] [ 10979/ 50732 kb/s] [eta 00m:54s]
Threads: 3: [mmF] [13.5% done] [  5396/ 92822 kb/s] [eta 00m:45s]
Threads: 3: [mmF] [42.1% done] [   105/ 44726 kb/s] [eta 00m:11s]
Threads: 3: [mmF] [40.9% done] [   134/ 15668 kb/s] [eta 00m:13s]
Threads: 3: [FFF] [100.0% done] [   264/ 63778 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [67.6% done] [  2308/     0 kb/s] [eta 00m:11s]
Threads: 3: [VVV] [70.6% done] [ 23083/     0 kb/s] [eta 00m:10s]
Threads: 3: [VVV] [75.8% done] [ 27631/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [78.8% done] [ 21825/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [84.4% done] [ 31191/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [87.5% done] [ 26900/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [87.9% done] [ 25685/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [88.2% done] [ 24112/     0 kb/s] [eta 00m:04s]
Threads: 2: [VV_] [88.6% done] [ 19833/     0 kb/s] [eta 00m:04s]
Threads: 2: [VV_] [88.9% done] [ 19285/     0 kb/s] [eta 00m:04s]
Threads: 1: [_V_] [100.0% done] [ 17915/     0 kb/s] [eta 00m:00s]
Threads: 1: [_V_] [100.0% done] [ 17822/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=3523
  read : io=100MiB, bw=3,229KiB/s, runt= 32473msec
    clat (msec): min=    0, max=  932, avg= 9.11, stdev=52.89
    bw (KiB/s) : min=    0, max=21089, per=79.02%, avg=7035.15, stdev=6264.40
  write: io=94,220KiB, bw=4,146KiB/s, runt= 23269msec
    clat (msec): min=    0, max=  895, avg= 1.38, stdev=31.05
    bw (KiB/s) : min=    1, max=13803, per=29.38%, avg=3512.00, stdev=5854.81
  cpu          : usr=3.94%, sys=1.24%, ctx=403
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=90.9%, 4=0.3%, 10=1.8%, 20=2.3%, 50=2.2%, 100=1.5%
     lat (msec): 250=0.5%, 500=0.2%, 750=0.0%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3524
  read : io=100MiB, bw=2,967KiB/s, runt= 35330msec
    clat (msec): min=    0, max=  873, avg=10.66, stdev=53.14
    bw (KiB/s) : min=    2, max=20928, per=67.82%, avg=6038.45, stdev=6484.99
  write: io=82,960KiB, bw=3,650KiB/s, runt= 23269msec
    clat (msec): min=    0, max=  924, avg= 1.86, stdev=40.76
    bw (KiB/s) : min=    1, max=90103, per=127.12%, avg=15197.00, stdev=36697.55
  cpu          : usr=3.56%, sys=1.15%, ctx=979
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=86.6%, 4=0.6%, 10=2.9%, 20=4.0%, 50=3.4%, 100=1.1%
     lat (msec): 250=0.8%, 500=0.2%, 750=0.0%, 1000=0.2%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=3525
  read : io=100MiB, bw=3,375KiB/s, runt= 31061msec
    clat (msec): min=    0, max= 1752, avg= 7.62, stdev=54.91
    bw (KiB/s) : min=    4, max=23275, per=99.26%, avg=8837.18, stdev=6608.04
  write: io=94,496KiB, bw=4,231KiB/s, runt= 22866msec
    clat (msec): min=    0, max=  861, avg= 0.57, stdev=21.91
    bw (KiB/s) : min=    1, max=104999, per=220.14%, avg=26318.25, stdev=52453.94
  cpu          : usr=4.25%, sys=0.98%, ctx=357
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=91.4%, 4=0.2%, 10=1.3%, 20=3.3%, 50=1.8%, 100=1.0%
     lat (msec): 250=0.7%, 500=0.1%, 750=0.0%, 1000=0.1%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=8,903KiB/s, minb=2,967KiB/s, maxb=3,375KiB/s, mint=31061msec, maxt=35330msec
  WRITE: io=265MiB, aggrb=11,955KiB/s, minb=3,650KiB/s, maxb=4,231KiB/s, mint=31061msec, maxt=35330msec

Disk stats (read/write):
  sda: ios=2459/5596, merge=38/66657, ticks=128304/2771528, in_queue=2900888, util=99.43%
3.86user 1.11system 0:35.78elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (2major+1123minor)pagefaults 0swaps