nvme0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32 ... fio-3.25 Starting 16 processes nvme0: (groupid=0, jobs=16): err= 0: pid=7271: Sat Mar 25 02:36:41 2023 read: IOPS=135k, BW=528MiB/s (554MB/s)(15.5GiB/30001msec) slat (usec): min=2, max=668, avg=113.97, stdev=48.67 clat (usec): min=4, max=10041, avg=3670.72, stdev=868.33 lat (usec): min=90, max=10163, avg=3785.19, stdev=892.89 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 3294], 10.00th=[ 3425], 20.00th=[ 3523], | 30.00th=[ 3621], 40.00th=[ 3654], 50.00th=[ 3720], 60.00th=[ 3785], | 70.00th=[ 3851], 80.00th=[ 3982], 90.00th=[ 4178], 95.00th=[ 4555], | 99.00th=[ 5669], 99.50th=[ 6325], 99.90th=[ 7767], 99.95th=[ 8455], | 99.99th=[ 9372] bw ( KiB/s): min=490230, max=1224562, per=100.00%, avg=541736.83, stdev=28522.06, samples=944 iops : min=122554, max=306131, avg=135429.10, stdev=7130.52, samples=944 lat (usec) : 10=0.01%, 100=0.01%, 250=4.39%, 500=0.01%, 750=0.01% lat (usec) : 1000=0.01% lat (msec) : 2=0.01%, 4=77.74%, 10=17.87%, 20=0.01% cpu : usr=4.63%, sys=15.84%, ctx=3878084, majf=0, minf=935 IO depths : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0% issued rwts: total=4055689,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=32 Run status group 0 (all jobs): READ: bw=528MiB/s (554MB/s), 528MiB/s-528MiB/s (554MB/s-554MB/s), io=15.5GiB (16.6GB), run=30001-30001msec Disk stats (read/write): nvme0n1: ios=4409225/0, merge=0/0, ticks=443138/0, in_queue=443138, util=99.84%