fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [mFF] [42.9% done] [  1158/ 56567 kb/s] [eta 00m:04s]
Threads: 3: [FFF] [100.0% done] [   605/ 37522 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [68.4% done] [  6078/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [70.0% done] [ 18651/     0 kb/s] [eta 00m:06s]
Threads: 3: [VVV] [75.0% done] [ 27891/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVV] [84.2% done] [ 29964/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVV] [89.5% done] [ 31406/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVV] [100.0% done] [ 38217/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 37221/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 30785/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVV] [100.0% done] [ 35307/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_V] [100.0% done] [ 34852/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=22272
  read : io=100MiB, bw=4,705KiB/s, runt= 22282msec
    slat (msec): min=   63, max=18517, avg=13885.22, stdev=3780.99
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=17512, per=61.41%, avg=8669.00, stdev=5203.75
  write: io=92,620KiB, bw=7,530KiB/s, runt= 12594msec
    slat (msec): min=    0, max=  335, avg= 3.00, stdev=20.74
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=68889, per=137.02%, avg=32258.00, stdev=34652.07
  cpu          : usr=5.67%, sys=1.74%, ctx=912
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22273
  read : io=100MiB, bw=4,825KiB/s, runt= 21732msec
    slat (msec): min=11769, max=20769, avg=16645.69, stdev=2894.38
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    5, max=18344, per=74.96%, avg=10582.73, stdev=5172.08
  write: io=100MiB, bw=8,348KiB/s, runt= 12560msec
    slat (msec): min=    0, max=   19, avg= 1.92, stdev= 2.13
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114172, per=242.49%, avg=57086.00, stdev=80731.80
  cpu          : usr=5.74%, sys=1.82%, ctx=762
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=22274
  read : io=100MiB, bw=4,709KiB/s, runt= 22267msec
    slat (msec): min=  134, max=20779, avg=16715.49, stdev=3118.12
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=17412, per=70.96%, avg=10017.47, stdev=5178.05
  write: io=98,980KiB, bw=7,925KiB/s, runt= 12788msec
    slat (msec): min=    0, max=   12, avg= 1.87, stdev= 2.03
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=113623, per=241.32%, avg=56811.50, stdev=80343.59
  cpu          : usr=5.32%, sys=2.08%, ctx=808
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=14,117KiB/s, minb=4,705KiB/s, maxb=4,825KiB/s, mint=21732msec, maxt=22282msec
  WRITE: io=287MiB, aggrb=23,542KiB/s, minb=7,530KiB/s, maxb=8,348KiB/s, mint=21732msec, maxt=22282msec

Disk stats (read/write):
  sda: ios=3023/1923, merge=1209/71403, ticks=74496/1641324, in_queue=1717444, util=98.54%
3.71user 1.26system 0:22.55elapsed 22%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2418minor)pagefaults 0swaps