测试环境：

三节点，每节点：

2x e5-2680v4

8x 4r4 2133Mhz DDR4 DIMMs

3x Dapustor r5101 3.84t

1x CX5621A Connect-4 Lx 25G Dual Port

Prepare:

禁用 cpupower idle-info 中耗时的模式（如C6）。

设置为性能模式

apt install linux-cpupower -y
cpupower frequency-set -g performance

内网互ping：

root@2288HV3-1-CEPH-1:~$ ping x.x.x.x
PING x.x.x.x (x.x.x.x) 56(84) bytes of data.
64 bytes from x.x.x.x: icmp_seq=1 ttl=64 time=0.037 ms
64 bytes from x.x.x.x: icmp_seq=2 ttl=64 time=0.024 ms
64 bytes from x.x.x.x: icmp_seq=3 ttl=64 time=0.021 ms
64 bytes from x.x.x.x: icmp_seq=4 ttl=64 time=0.024 ms
64 bytes from x.x.x.x: icmp_seq=5 ttl=64 time=0.022 ms
64 bytes from x.x.x.x: icmp_seq=6 ttl=64 time=0.021 ms
64 bytes from x.x.x.x: icmp_seq=7 ttl=64 time=0.026 ms
64 bytes from x.x.x.x: icmp_seq=8 ttl=64 time=0.025 ms
64 bytes from x.x.x.x: icmp_seq=9 ttl=64 time=0.025 ms
64 bytes from x.x.x.x: icmp_seq=10 ttl=64 time=0.022 ms
^C
--- x.x.x.x ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 9193ms
rtt min/avg/max/mdev = 0.021/0.024/0.037/0.004 ms

单盘理论测试：

[global]
ioengine=libaio
direct=1
bs=4k
runtime=60
time_based=1
group_reporting=1
filename=/dev/nvme0n1
# 请根据实际情况修改设备路径，如 /tmp/fio-test 用于文件测试

# ===========================================
# 1MB Sequential Tests (Q1T1)
# ===========================================

[1m-seq-read]
stonewall
rw=read
bs=1m
iodepth=1
numjobs=1

[1m-seq-write]
stonewall
rw=write
bs=1m
iodepth=1
numjobs=1

[1m-seq-mixed-70-30]
stonewall
rw=rw
rwmixread=70
bs=1m
iodepth=1
numjobs=1

# ===========================================
# 4K Random Tests (Q1T1)
# ===========================================

[4k-rand-read-q1t1]
stonewall
rw=randread
bs=4k
iodepth=1
numjobs=1

[4k-rand-write-q1t1]
stonewall
rw=randwrite
bs=4k
iodepth=1
numjobs=1

[4k-rand-mixed-70-30-q1t1]
stonewall
rw=randrw
rwmixread=70
bs=4k
iodepth=1
numjobs=1

# ===========================================
# 4K Random Tests (T32Q32)
# ===========================================

[4k-rand-read-t32q32]
stonewall
rw=randread
bs=4k
iodepth=32
numjobs=32

[4k-rand-write-t32q32]
stonewall
rw=randwrite
bs=4k
iodepth=32
numjobs=32

[4k-rand-mixed-30-70-t32q32]
stonewall
rw=randrw
rwmixread=30
bs=4k
iodepth=32
numjobs=32