fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
...
fio: (g=0): rw=randrw, bs=4K-256K/4K-256K, ioengine=libaio, iodepth=8
Starting 3 threads
Threads: 3
Threads: 3
Threads: 3: [FFm] [27.3% done] [  2218/ 76534 kb/s] [eta 00m:08s]
Threads: 3: [FFm] [66.7% done] [   880/ 56736 kb/s] [eta 00m:02s]
Threads: 3: [FFF] [100.0% done] [   440/  5908 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [FFF] [100.0% done] [     0/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [70.6% done] [ 12904/     0 kb/s] [eta 00m:05s]
Threads: 3: [VVF] [81.2% done] [ 25924/     0 kb/s] [eta 00m:03s]
Threads: 3: [VVF] [87.5% done] [ 21820/     0 kb/s] [eta 00m:02s]
Threads: 3: [VVF] [93.8% done] [ 22960/     0 kb/s] [eta 00m:01s]
Threads: 3: [VVF] [100.0% done] [ 30080/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [100.0% done] [ 30364/     0 kb/s] [eta 00m:00s]
Threads: 3: [VVF] [100.0% done] [ 23164/     0 kb/s] [eta 00m:00s]
Threads: 2: [V_F] [100.0% done] [ 21204/     0 kb/s] [eta 00m:00s]
Threads: 1: [__F] [100.0% done] [  2380/     0 kb/s] [eta 00m:00s]
Threads: 1: [__V] [72.4% done] [  8224/     0 kb/s] [eta 00m:08s]
Threads: 1: [__V] [95.7% done] [ 35188/     0 kb/s] [eta 00m:01s]
Threads: 1: [__V] [100.0% done] [ 38332/     0 kb/s] [eta 00m:00s]
fio: (groupid=0): err= 0: pid=15427
  read : io=100MiB, bw=5,397KiB/s, runt= 19428msec
    slat (msec): min=   68, max=16849, avg=12389.67, stdev=3548.71
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    8, max=22757, per=78.46%, avg=10361.28, stdev=4896.44
  write: io=91,156KiB, bw=8,391KiB/s, runt= 11124msec
    slat (msec): min=    0, max=   14, avg= 1.91, stdev= 2.06
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=114368, per=407.87%, avg=57184.00, stdev=80870.39
  cpu          : usr=6.53%, sys=2.06%, ctx=880
  IO depths    : 1=12.6%, 2=25.1%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15428
  read : io=100MiB, bw=5,568KiB/s, runt= 18829msec
    slat (msec): min=   35, max=16434, avg=12627.84, stdev=3454.45
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=   25, max=30405, per=86.57%, avg=11431.94, stdev=8116.20
  write: io=99,644KiB, bw=9,031KiB/s, runt= 11298msec
    slat (msec): min=    0, max=   71, avg= 3.13, stdev= 5.15
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=98587, per=291.78%, avg=40907.75, stdev=49058.48
  cpu          : usr=7.95%, sys=2.55%, ctx=897
  IO depths    : 1=12.6%, 2=25.0%, 4=49.9%, 8=12.5%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%
fio: (groupid=0): err= 0: pid=15429
  read : io=100MiB, bw=4,401KiB/s, runt= 23821msec
    slat (msec): min=   46, max=19069, avg=16682.51, stdev=4382.87
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    3, max=39302, per=105.24%, avg=13897.54, stdev=16288.81
  write: io=93,452KiB, bw=4,609KiB/s, runt= 20760msec
    slat (msec): min=    0, max=  538, avg= 2.90, stdev=14.36
    clat (msec): min=    0, max=    0, avg= 0.00, stdev= 0.00
    bw (KiB/s) : min=    0, max=58144, per=163.55%, avg=22929.20, stdev=31343.15
  cpu          : usr=5.94%, sys=1.61%, ctx=920
  IO depths    : 1=12.6%, 2=25.0%, 4=50.0%, 8=12.4%, 16=0.0%, 32=0.0%, >=64=0.0%
     lat (msec): 2=99.9%, 4=0.0%, 10=0.0%, 20=0.0%, 50=0.0%, 100=0.0%
     lat (msec): 250=0.0%, 500=0.0%, 750=0.0%, 1000=0.0%, >=2000=0.0%

Run status group 0 (all jobs):
   READ: io=300MiB, aggrb=13,205KiB/s, minb=4,401KiB/s, maxb=5,568KiB/s, mint=18829msec, maxt=23821msec
  WRITE: io=278MiB, aggrb=14,020KiB/s, minb=4,609KiB/s, maxb=9,031KiB/s, mint=18829msec, maxt=23821msec

Disk stats (read/write):
  sda: ios=3327/2089, merge=1393/68788, ticks=65812/2551836, in_queue=2617832, util=98.26%
4.23user 1.32system 0:24.15elapsed 22%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2416minor)pagefaults 0swaps