fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [42.9% done] [  4240/112688 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [  3176/ 52816 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.4% done] [ 11008/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [77.8% done] [ 43196/     0 kb/s] [eta 00m:04s]
Threads: 3: [VVV] [83.3% done] [ 43264/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [94.1% done] [ 44272/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 42584/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 44084/     0 kb/s] [eta 00m:00s]
Threads: 2: [VVE] [100.0% done] [ 40024/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1567
  read : io=100MiB, bw=5,354KiB/s, runt= 19583msec
    clat (msec): min=    0, max=  247, avg= 5.05, stdev=24.36
    bw (KiB/s) : min=    8, max=21307, per=59.24%, avg=9512.06, stdev=6385.58
  write: io=92,736KiB, bw=7,422KiB/s, runt= 12794msec
    clat (msec): min=    0, max=   25, avg= 0.09, stdev= 1.15
    bw (KiB/s) : min=    0, max=69771, per=110.50%, avg=24695.75, stdev=32974.00
  cpu          : usr=7.17%, sys=1.67%, ctx=876
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=85.4%, 4=4.2%, 10=6.2%, 20=1.9%, 50=1.2%, 100=0.2%
     lat (msec): 250=0.7%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1568
  read : io=100MiB, bw=5,352KiB/s, runt= 19591msec
    clat (msec): min=    0, max=  253, avg= 5.05, stdev=24.50
    bw (KiB/s) : min=   20, max=23389, per=55.38%, avg=8892.11, stdev=6518.26
  write: io=87,792KiB, bw=7,012KiB/s, runt= 12820msec
    clat (msec): min=    0, max=   46, avg= 0.23, stdev= 2.23
    bw (KiB/s) : min=    0, max=21537, per=44.78%, avg=10008.33, stdev=10848.69
  cpu          : usr=7.33%, sys=1.80%, ctx=928
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=83.8%, 4=4.5%, 10=7.3%, 20=2.2%, 50=1.1%, 100=0.2%
     lat (msec): 250=0.7%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1569
  read : io=100MiB, bw=5,440KiB/s, runt= 19275msec
    clat (msec): min=    0, max=  330, avg= 4.22, stdev=24.20
    bw (KiB/s) : min=    7, max=20578, per=77.19%, avg=12394.92, stdev=6718.50
  write: io=99,276KiB, bw=8,034KiB/s, runt= 12652msec
    clat (msec): min=    0, max=   54, avg= 0.25, stdev= 2.70
    bw (KiB/s) : min=    0, max=32841, per=95.35%, avg=21309.67, stdev=18475.52
  cpu          : usr=7.12%, sys=1.74%, ctx=1554
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=86.7%, 4=4.2%, 10=6.6%, 20=0.5%, 50=1.0%, 100=0.1%
     lat (msec): 250=0.6%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=16,057KiB/s, minb=5,352KiB/s, maxb=5,440KiB/s, mint=19275msec, maxt=19591msec
  WRITE: io=273MiB, aggrb=22,349KiB/s, minb=7,012KiB/s, maxb=8,034KiB/s, mint=19275msec, maxt=19591msec

Disk stats (read/write):
  sda: ios=3010/1821, merge=1626/67975, ticks=33532/1422968, in_queue=1462704, util=98.11%
4.22user 1.07system 0:19.89elapsed 26%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (3major+1063minor)pagefaults 0swaps