fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FmF] [42.9% done] [  1292/     0 kb/s] [eta 00m:04s]
Threads: 3: [FmF] [40.0% done] [   588/     0 kb/s] [eta 00m:06s]
Threads: 3: [FmF] [41.7% done] [  1212/     0 kb/s] [eta 00m:07s]
Threads: 3: [FmF] [42.9% done] [  1420/  2000 kb/s] [eta 00m:08s]
Threads: 3: [FFF] [100.0% done] [     0/ 37428 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [66.7% done] [  6064/     0 kb/s] [eta 00m:08s]
Threads: 3: [VVV] [70.8% done] [ 18444/     0 kb/s] [eta 00m:07s]
Threads: 3: [VVV] [78.3% done] [ 31748/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [86.4% done] [ 31192/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [90.9% done] [ 25280/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [95.5% done] [ 30908/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVV] [100.0% done] [ 31424/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 32372/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 26244/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 31492/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=4398
  read : io=100MiB, bw=4,006KiB/s, runt= 26174msec
    slat (msec): min=   13, max=24620, avg=19218.87, stdev=4354.61
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=14886, per=72.11%, avg=8614.47, stdev=4046.92
  write: io=98,236KiB, bw=6,418KiB/s, runt= 15672msec
    slat (msec): min=    0, max=   18, avg= 1.96, stdev= 2.29
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=105918, per=187.16%, avg=35727.00, stdev=60790.47
  cpu          : usr=4.74%, sys=1.60%, ctx=357
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4399
  read : io=100MiB, bw=3,982KiB/s, runt= 26330msec
    slat (msec): min=   47, max=19989, avg=14290.18, stdev=5021.16
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    4, max=14363, per=50.76%, avg=6063.92, stdev=4287.24
  write: io=91,524KiB, bw=5,980KiB/s, runt= 15672msec
    slat (msec): min=    0, max=  284, avg= 2.25, stdev=10.55
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=69487, per=121.45%, avg=23182.67, stdev=40100.74
  cpu          : usr=4.71%, sys=1.53%, ctx=457
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=4400
  read : io=100MiB, bw=4,032KiB/s, runt= 26003msec
    slat (msec): min=15419, max=25053, avg=20932.24, stdev=2665.74
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   15, max=13255, per=82.06%, avg=9803.73, stdev=4032.03
  write: io=100MiB, bw=6,692KiB/s, runt= 15668msec
    slat (msec): min=    0, max=   15, avg= 1.85, stdev= 1.91
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=111658, per=292.47%, avg=55829.00, stdev=78954.13
  cpu          : usr=5.05%, sys=1.38%, ctx=334
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=11,947KiB/s, minb=3,982KiB/s, maxb=4,032KiB/s, mint=26003msec, maxt=26330msec
  WRITE: io=285MiB, aggrb=19,089KiB/s, minb=5,980KiB/s, maxb=6,692KiB/s, mint=26003msec, maxt=26330msec

Disk stats (read/write):
  sda: ios=1378/2402, merge=5573/70511, ticks=261780/2069724, in_queue=2332692, util=98.80%
3.84user 1.19system 0:26.57elapsed 18%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2431minor)pagefaults 0swaps