fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=mmap, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=mmap, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [5.0% done] [ 20499/  9243 kb/s] [eta 00m:57s]
Threads: 3: [mmm] [7.7% done] [ 14564/ 10460 kb/s] [eta 00m:48s]
Threads: 3: [mFm] [8.8% done] [  1264/  1925 kb/s] [eta 00m:52s]
Threads: 3: [mFm] [10.2% done] [  3375/   842 kb/s] [eta 00m:53s]
Threads: 3: [mFm] [11.7% done] [  1766/  2668 kb/s] [eta 00m:53s]
Threads: 2: [m_m] [13.8% done] [ 35840/   196 kb/s] [eta 00m:50s]
Threads: 2: [m_m] [15.3% done] [  3899/  1496 kb/s] [eta 00m:50s]
Threads: 2: [m_m] [20.8% done] [  6663/  8853 kb/s] [eta 00m:38s]
Threads: 2: [m_m] [25.0% done] [ 13052/  3005 kb/s] [eta 00m:33s]
Threads: 2: [m_m] [28.6% done] [  8408/  3068 kb/s] [eta 00m:30s]
Threads: 2: [m_m] [33.3% done] [  9373/  4749 kb/s] [eta 00m:26s]
Threads: 2: [m_m] [37.8% done] [  7758/  6845 kb/s] [eta 00m:23s]
Threads: 2: [m_m] [44.1% done] [ 14950/     0 kb/s] [eta 00m:19s]
Threads: 2: [m_m] [47.1% done] [  7061/     0 kb/s] [eta 00m:18s]
Threads: 2: [m_m] [48.6% done] [  3883/  1358 kb/s] [eta 00m:18s]
Threads: 2: [m_m] [50.0% done] [  3229/  1205 kb/s] [eta 00m:18s]
Threads: 2: [m_m] [51.4% done] [  3591/  2233 kb/s] [eta 00m:18s]
Threads: 2: [m_m] [52.6% done] [  5056/     0 kb/s] [eta 00m:18s]
Threads: 2: [m_m] [56.8% done] [  3710/  3402 kb/s] [eta 00m:16s]
Threads: 2: [m_m] [57.9% done] [  3020/  2812 kb/s] [eta 00m:16s]
Threads: 2: [m_m] [59.0% done] [  3757/  2607 kb/s] [eta 00m:16s]
Threads: 2: [m_m] [61.5% done] [  2300/  3973 kb/s] [eta 00m:15s]
Threads: 2: [m_m] [64.1% done] [  4324/  2414 kb/s] [eta 00m:14s]
Threads: 2: [F_m] [65.9% done] [  2225/  2512 kb/s] [eta 00m:14s]
Threads: 2: [F_m] [66.7% done] [  2095/     0 kb/s] [eta 00m:14s]
Threads: 1: [E_F] [100.0% done] [ 31074/  1488 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=1514
  read : io=100MiB, bw=3,616KiB/s, runt= 28994msec
    clat (msec): min=    0, max=  563, avg=11.18, stdev=30.62
    bw (KiB/s) : min=    1, max= 8103, per=28.62%, avg=2945.14, stdev=2318.28
  write: io=31,548KiB, bw=1,121KiB/s, runt= 28809msec
    clat (msec): min=    0, max=  374, avg=14.27, stdev=41.89
    bw (KiB/s) : min=    0, max=11398, per=56.83%, avg=1881.64, stdev=2652.77
  cpu          : usr=3.20%, sys=1.24%, ctx=8861
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=65.5%, 4=1.4%, 10=6.6%, 20=9.3%, 50=11.3%, 100=3.7%
     lat (msec): 250=1.7%, 500=0.3%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1515
  read : io=100MiB, bw=13,422KiB/s, runt=  7812msec
    clat (msec): min=    0, max=  115, avg= 1.14, stdev= 6.17
    bw (KiB/s) : min=    8, max=40951, per=156.93%, avg=16149.56, stdev=16331.87
  write: io=30,524KiB, bw=4,099KiB/s, runt=  7625msec
    clat (msec): min=    0, max=  111, avg= 2.21, stdev= 8.42
    bw (KiB/s) : min=    0, max=31004, per=308.32%, avg=10208.60, stdev=14481.84
  cpu          : usr=12.39%, sys=2.10%, ctx=1535
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=90.8%, 4=1.0%, 10=2.9%, 20=3.2%, 50=1.5%, 100=0.3%
     lat (msec): 250=0.1%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=1516
  read : io=100MiB, bw=3,430KiB/s, runt= 30566msec
    clat (msec): min=    0, max=  465, avg=10.55, stdev=33.37
    bw (KiB/s) : min=    5, max= 9743, per=28.97%, avg=2981.35, stdev=2677.67
  write: io=36,108KiB, bw=1,217KiB/s, runt= 30357msec
    clat (msec): min=    0, max=  601, avg=14.92, stdev=38.39
    bw (KiB/s) : min=    0, max= 8435, per=71.69%, avg=2373.81, stdev=2354.59
  cpu          : usr=3.26%, sys=0.71%, ctx=8075
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=69.5%, 4=0.9%, 10=4.6%, 20=9.1%, 50=9.3%, 100=4.3%
     lat (msec): 250=1.9%, 500=0.3%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=10,291KiB/s, minb=3,430KiB/s, maxb=13,422KiB/s, mint=7812msec, maxt=30566msec
  WRITE: io=98,180KiB, aggrb=3,311KiB/s, minb=1,121KiB/s, maxb=4,099KiB/s, mint=7812msec, maxt=30566msec

Disk stats (read/write):
  sda: ios=18344/1205, merge=0/23433, ticks=55756/965152, in_queue=1020896, util=98.34%
2.89user 0.75system 0:30.97elapsed 11%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+102386minor)pagefaults 0swaps