nvme0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32 ... fio-3.25 Starting 16 processes nvme0: (groupid=0, jobs=16): err= 0: pid=7354: Sat Mar 25 02:39:08 2023 read: IOPS=143k, BW=558MiB/s (585MB/s)(16.3GiB/30002msec) slat (usec): min=2, max=494, avg=107.63, stdev=38.76 clat (usec): min=3, max=5129, avg=3474.62, stdev=718.16 lat (usec): min=89, max=5239, avg=3582.75, stdev=740.04 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 3195], 10.00th=[ 3326], 20.00th=[ 3425], | 30.00th=[ 3490], 40.00th=[ 3556], 50.00th=[ 3589], 60.00th=[ 3654], | 70.00th=[ 3720], 80.00th=[ 3785], 90.00th=[ 3884], 95.00th=[ 3949], | 99.00th=[ 4146], 99.50th=[ 4228], 99.90th=[ 4359], 99.95th=[ 4424], | 99.99th=[ 4555] bw ( KiB/s): min=537617, max=1295837, per=100.00%, avg=572538.79, stdev=30952.47, samples=945 iops : min=134400, max=323956, avg=143130.77, stdev=7738.13, samples=945 lat (usec) : 4=0.01%, 10=0.01%, 20=0.01%, 100=0.01%, 250=4.15% lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% lat (msec) : 2=0.01%, 4=92.29%, 10=3.57% cpu : usr=5.04%, sys=14.48%, ctx=4107578, majf=0, minf=932 IO depths : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0% issued rwts: total=4284741,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=32 Run status group 0 (all jobs): READ: bw=558MiB/s (585MB/s), 558MiB/s-558MiB/s (585MB/s-585MB/s), io=16.3GiB (17.6GB), run=30002-30002msec Disk stats (read/write): nvme0n1: ios=4661495/0, merge=0/0, ticks=444782/0, in_queue=444782, util=99.84%