fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mmm] [42.9% done] [  9898/ 55645 kb/s] [eta 00m:04s]
Threads: 3: [Fmm] [50.0% done] [  6635/ 40809 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [  1536/ 66633 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [68.8% done] [   609/     0 kb/s] [eta 00m:05s]
Threads: 3: [VFF] [75.0% done] [ 10447/     0 kb/s] [eta 00m:04s]
Threads: 3: [VFF] [81.2% done] [ 11146/     0 kb/s] [eta 00m:03s]
Threads: 3: [VFF] [93.3% done] [ 17164/     0 kb/s] [eta 00m:01s]
Threads: 3: [VFF] [100.0% done] [ 10817/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [  6830/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [  4701/     0 kb/s] [eta 00m:00s]
Threads: 3: [VFF] [100.0% done] [ 27058/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [67.9% done] [ 16225/     0 kb/s] [eta 00m:09s]
Threads: 2: [_VV] [76.9% done] [ 30419/     0 kb/s] [eta 00m:06s]
Threads: 2: [_VV] [87.5% done] [ 26481/     0 kb/s] [eta 00m:03s]
Threads: 2: [_VV] [91.7% done] [ 28919/     0 kb/s] [eta 00m:02s]
Threads: 2: [_VV] [100.0% done] [ 33093/     0 kb/s] [eta 00m:00s]
Threads: 2: [_VV] [100.0% done] [ 22580/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=30779
  read : io=100MiB, bw=5,750KiB/s, runt= 18235msec
    slat (msec): min=   68, max=14960, avg=11315.78, stdev=3504.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    2, max=30630, per=79.41%, avg=10071.17, stdev=8643.45
  write: io=93,692KiB, bw=9,225KiB/s, runt= 10400msec
    slat (msec): min=    0, max=  256, avg= 1.99, stdev= 6.70
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=72855, per=160.46%, avg=24311.00, stdev=42040.36
  cpu          : usr=6.65%, sys=2.15%, ctx=973
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30780
  read : io=100MiB, bw=4,227KiB/s, runt= 24804msec
    slat (msec): min=   70, max=20543, avg=15822.26, stdev=6114.84
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   12, max=25377, per=73.46%, avg=9316.53, stdev=7687.44
  write: io=88,316KiB, bw=4,970KiB/s, runt= 18193msec
    slat (msec): min=    0, max=   11, avg= 1.90, stdev= 2.09
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=14282, per=47.13%, avg=7141.00, stdev=10098.90
  cpu          : usr=4.58%, sys=1.56%, ctx=1085
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=30781
  read : io=100MiB, bw=4,296KiB/s, runt= 24407msec
    slat (msec): min=   16, max=19535, avg=15096.66, stdev=5284.50
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   17, max=27816, per=79.74%, avg=10112.39, stdev=8914.59
  write: io=87,304KiB, bw=4,911KiB/s, runt= 18201msec
    slat (msec): min=    0, max=   21, avg= 1.88, stdev= 2.17
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=109321, per=241.11%, avg=36531.00, stdev=63038.14
  cpu          : usr=4.95%, sys=1.43%, ctx=1091
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=12,682KiB/s, minb=4,227KiB/s, maxb=5,750KiB/s, mint=18235msec, maxt=24804msec
  WRITE: io=263MiB, aggrb=15,151KiB/s, minb=4,911KiB/s, maxb=9,225KiB/s, mint=18235msec, maxt=24804msec

Disk stats (read/write):
  sda: ios=3688/1840, merge=1226/65485, ticks=64824/1984928, in_queue=2049756, util=99.35%
3.60user 1.14system 0:25.02elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2421minor)pagefaults 0swaps