fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=sync, iodepth=1
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [7.9% done] [ 10585/  5164 kb/s] [eta 00m:35s]
Threads: 3: [mmm] [10.3% done] [  9679/  4912 kb/s] [eta 00m:35s]
Threads: 3: [mmm] [12.2% done] [  9236/  5619 kb/s] [eta 00m:36s]
Threads: 3: [mmm] [14.6% done] [ 10227/  3900 kb/s] [eta 00m:35s]
Threads: 3: [mmm] [16.7% done] [ 10081/  2921 kb/s] [eta 00m:35s]
Threads: 3: [mmm] [19.5% done] [  8769/  4221 kb/s] [eta 00m:33s]
Threads: 3: [mmm] [22.0% done] [  3770/  7736 kb/s] [eta 00m:32s]
Threads: 3: [mmm] [24.4% done] [ 10447/   808 kb/s] [eta 00m:31s]
Threads: 3: [mmm] [26.2% done] [ 10252/     0 kb/s] [eta 00m:31s]
Threads: 3: [mmm] [27.9% done] [ 10337/   377 kb/s] [eta 00m:31s]
Threads: 3: [mmm] [29.5% done] [  5550/  3860 kb/s] [eta 00m:31s]
Threads: 3: [mmm] [31.8% done] [  6196/  4908 kb/s] [eta 00m:30s]
Threads: 3: [mmm] [34.9% done] [  5453/  5953 kb/s] [eta 00m:28s]
Threads: 3: [mmm] [37.2% done] [  1905/  8781 kb/s] [eta 00m:27s]
Threads: 3: [mmm] [39.5% done] [  6513/  3657 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [40.9% done] [  7768/  1578 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [42.2% done] [  7797/   902 kb/s] [eta 00m:26s]
Threads: 3: [mmm] [42.6% done] [  8009/    60 kb/s] [eta 00m:27s]
Threads: 3: [mmm] [42.9% done] [   475/  8066 kb/s] [eta 00m:28s]
Threads: 3: [Vmm] [43.1% done] [ 11828/  1113 kb/s] [eta 00m:29s]
Threads: 3: [Vmm] [43.4% done] [ 12734/   325 kb/s] [eta 00m:30s]
Threads: 2: [_mm] [45.3% done] [ 11633/   633 kb/s] [eta 00m:29s]
Threads: 2: [_mm] [49.0% done] [  4827/  6213 kb/s] [eta 00m:26s]
Threads: 2: [_mm] [51.0% done] [  5282/  2405 kb/s] [eta 00m:25s]
Threads: 2: [_mm] [54.0% done] [  5466/  2459 kb/s] [eta 00m:23s]
Threads: 2: [_mm] [56.0% done] [  2584/  4036 kb/s] [eta 00m:22s]
Threads: 2: [_mm] [58.0% done] [  2576/  4124 kb/s] [eta 00m:21s]
Threads: 2: [_mm] [58.8% done] [  3484/  3048 kb/s] [eta 00m:21s]
Threads: 2: [_Vm] [58.5% done] [ 12592/     0 kb/s] [eta 00m:22s]
Threads: 2: [_Vm] [59.3% done] [ 14760/     0 kb/s] [eta 00m:22s]
Threads: 1: [__m] [60.0% done] [ 14488/     0 kb/s] [eta 00m:22s]
Threads: 1: [__m] [65.4% done] [  3328/  4712 kb/s] [eta 00m:18s]
Threads: 1: [__V] [74.5% done] [ 13792/     0 kb/s] [eta 00m:12s]
Threads: 1: [__V] [85.7% done] [ 18012/     0 kb/s] [eta 00m:06s]
fio: (groupid=0): err= 0: pid=5054
  read : io=100MiB, bw=4,446KiB/s, runt= 23582msec
    clat (msec): min=    0, max=  129, avg=10.01, stdev=12.36
    bw (KiB/s) : min=    3, max=14147, per=59.62%, avg=5064.49, stdev=3613.22
  write: io=30,700KiB, bw=1,494KiB/s, runt= 21030msec
    clat (msec): min=    0, max=  115, avg= 8.58, stdev=12.77
    bw (KiB/s) : min=    0, max= 7531, per=100.24%, avg=3262.87, stdev=2813.88
  cpu          : usr=3.73%, sys=0.36%, ctx=2262
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=31.7%, 4=8.6%, 10=25.3%, 20=15.1%, 50=18.2%, 100=0.7%
     lat (msec): 250=0.3%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5055
  read : io=100MiB, bw=3,163KiB/s, runt= 33146msec
    clat (msec): min=    0, max=  152, avg=13.02, stdev=20.24
    bw (KiB/s) : min=   12, max=16887, per=40.99%, avg=3481.84, stdev=3874.07
  write: io=37,232KiB, bw=1,250KiB/s, runt= 30482msec
    clat (msec): min=    0, max=  136, avg=13.93, stdev=19.41
    bw (KiB/s) : min=    0, max= 5888, per=66.98%, avg=2180.12, stdev=2083.31
  cpu          : usr=2.57%, sys=0.16%, ctx=2345
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=27.7%, 4=6.8%, 10=20.2%, 20=24.0%, 50=17.3%, 100=1.9%
     lat (msec): 250=2.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=5056
  read : io=100MiB, bw=2,831KiB/s, runt= 37034msec
    clat (msec): min=    0, max=  180, avg=14.08, stdev=23.21
    bw (KiB/s) : min=   10, max=21449, per=39.31%, avg=3339.37, stdev=4487.39
  write: io=42,196KiB, bw=1,247KiB/s, runt= 34645msec
    clat (msec): min=    0, max=  136, avg=17.47, stdev=24.85
    bw (KiB/s) : min=    1, max= 9299, per=70.58%, avg=2297.29, stdev=2338.34
  cpu          : usr=2.74%, sys=0.22%, ctx=2336
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=28.0%, 4=5.8%, 10=20.1%, 20=22.7%, 50=17.6%, 100=2.0%
     lat (msec): 250=3.7%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=8,494KiB/s, minb=2,831KiB/s, maxb=4,446KiB/s, mint=23582msec, maxt=37034msec
  WRITE: io=108MiB, aggrb=3,255KiB/s, minb=1,247KiB/s, maxb=1,494KiB/s, mint=23582msec, maxt=37034msec

Disk stats (read/write):
  sda: ios=5383/2097, merge=827/281, ticks=77068/30940, in_queue=108008, util=98.33%
2.75user 0.42system 0:37.43elapsed 8%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+1076minor)pagefaults 0swaps