fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmF] [17.6% done] [ 12780/ 78792 kb/s] [eta 00m:14s]
Threads: 3: [mmF] [36.4% done] [  2172/ 62432 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [62.5% done] [   696/ 50060 kb/s] [eta 00m:03s]
Threads: 3: [FFF] [100.0% done] [     0/  7080 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [70.6% done] [  3264/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [72.2% done] [ 35632/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [82.4% done] [ 41252/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [93.8% done] [ 42536/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 42660/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 41560/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 41108/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=19491
  read : io=100MiB, bw=5,752KiB/s, runt= 18229msec
    clat (msec): min=    0, max=  236, avg= 5.15, stdev=23.68
    bw (KiB/s) : min=    3, max=23744, per=60.68%, avg=10131.82, stdev=6462.31
  write: io=89,260KiB, bw=7,657KiB/s, runt= 11936msec
    clat (msec): min=    0, max=   48, avg= 0.10, stdev= 2.06
    bw (KiB/s) : min=    0, max=22374, per=48.54%, avg=11187.00, stdev=15820.81
  cpu          : usr=6.54%, sys=1.91%, ctx=887
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=84.9%, 4=4.2%, 10=6.8%, 20=1.5%, 50=1.4%, 100=0.4%
     lat (msec): 250=0.7%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=19492
  read : io=100MiB, bw=5,584KiB/s, runt= 18778msec
    clat (msec): min=    0, max=  231, avg= 5.68, stdev=24.43
    bw (KiB/s) : min=   22, max=21839, per=54.81%, avg=9152.16, stdev=6091.34
  write: io=85,052KiB, bw=7,263KiB/s, runt= 11991msec
    clat (msec): min=    0, max=  280, avg= 0.46, stdev= 7.82
    bw (KiB/s) : min=    0, max=19989, per=33.55%, avg=7733.67, stdev=10734.25
  cpu          : usr=6.39%, sys=1.66%, ctx=894
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=83.3%, 4=3.7%, 10=7.8%, 20=2.3%, 50=1.6%, 100=0.3%
     lat (msec): 250=0.9%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=19493
  read : io=100MiB, bw=5,565KiB/s, runt= 18839msec
    clat (msec): min=    0, max=  262, avg= 4.55, stdev=23.81
    bw (KiB/s) : min=    8, max=25296, per=67.79%, avg=11319.33, stdev=6973.15
  write: io=95,592KiB, bw=8,163KiB/s, runt= 11991msec
    clat (msec): min=    0, max=   33, avg= 0.03, stdev= 0.84
    bw (KiB/s) : min=    0, max=103686, per=224.93%, avg=51843.00, stdev=73317.07
  cpu          : usr=6.31%, sys=1.91%, ctx=762
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=87.5%, 4=4.3%, 10=5.5%, 20=0.6%, 50=0.8%, 100=0.4%
     lat (msec): 250=0.6%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=16,697KiB/s, minb=5,565KiB/s, maxb=5,752KiB/s, mint=18229msec, maxt=18839msec
  WRITE: io=264MiB, aggrb=23,049KiB/s, minb=7,263KiB/s, maxb=8,163KiB/s, mint=18229msec, maxt=18839msec

Disk stats (read/write):
  sda: ios=3059/1388, merge=1438/66110, ticks=36864/1266164, in_queue=1303028, util=98.89%
3.58user 1.09system 0:19.12elapsed 24%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (3major+1070minor)pagefaults 0swaps