|
更新
分别测试了
nvme为P4610
总结 zfs下 nvme也只能当高性能hdd使用
metadata存在的情况下hddpool有提升
还是加内存最实在
就先暂时这么用了 感谢J叔
下面是测试结果
nvme 四盘 raid10 async=enable
- ------------------------------------------------------------------------------
- CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
- Crystal Dew World: https://crystalmark.info/
- ------------------------------------------------------------------------------
- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
- * KB = 1000 bytes, KiB = 1024 bytes
- [Read]
- SEQ 1MiB (Q= 8, T= 1): 1686.849 MB/s [ 1608.7 IOPS] < 4968.19 us>
- SEQ 128KiB (Q= 8, T= 8): 3018.896 MB/s [ 23032.3 IOPS] < 2776.73 us>
- RND 4KiB (Q= 32, T=16): 88.801 MB/s [ 21679.9 IOPS] < 23531.17 us>
- RND 4KiB (Q= 1, T= 1): 41.255 MB/s [ 10072.0 IOPS] < 99.16 us>
- [Write]
- SEQ 1MiB (Q= 8, T= 1): 1990.050 MB/s [ 1897.9 IOPS] < 4203.53 us>
- SEQ 128KiB (Q= 8, T= 8): 1922.005 MB/s [ 14663.7 IOPS] < 4358.53 us>
- RND 4KiB (Q= 32, T=16): 186.869 MB/s [ 45622.3 IOPS] < 11179.27 us>
- RND 4KiB (Q= 1, T= 1): 33.005 MB/s [ 8057.9 IOPS] < 123.96 us>
- Profile: Default
- Test: 1 GiB (x5) [Z: 0% (0/5824GiB)]
- Mode: [Admin]
- Time: Measure 5 sec / Interval 5 sec
- Date: 2022/05/13 15:03:10
- OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
- Comment: raid10
复制代码
nvme 单盘 raid0 async=enable
- ------------------------------------------------------------------------------
- CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
- Crystal Dew World: https://crystalmark.info/
- ------------------------------------------------------------------------------
- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
- * KB = 1000 bytes, KiB = 1024 bytes
- [Read]
- SEQ 1MiB (Q= 8, T= 1): 1694.023 MB/s [ 1615.5 IOPS] < 4695.85 us>
- SEQ 128KiB (Q= 8, T= 8): 3052.036 MB/s [ 23285.2 IOPS] < 2746.63 us>
- RND 4KiB (Q= 32, T=16): 83.695 MB/s [ 20433.3 IOPS] < 24969.69 us>
- RND 4KiB (Q= 1, T= 1): 41.492 MB/s [ 10129.9 IOPS] < 98.59 us>
- [Write]
- SEQ 1MiB (Q= 8, T= 1): 2166.966 MB/s [ 2066.6 IOPS] < 3861.83 us>
- SEQ 128KiB (Q= 8, T= 8): 1957.021 MB/s [ 14930.9 IOPS] < 4280.45 us>
- RND 4KiB (Q= 32, T=16): 200.099 MB/s [ 48852.3 IOPS] < 10451.03 us>
- RND 4KiB (Q= 1, T= 1): 33.939 MB/s [ 8285.9 IOPS] < 120.55 us>
- Profile: Default
- Test: 1 GiB (x5) [Z: 0% (0/2883GiB)]
- Mode: [Admin]
- Time: Measure 5 sec / Interval 5 sec
- Date: 2022/05/13 15:12:11
- OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
- Comment: 单盘raid0
复制代码
nvme 双盘 raid1 async=enable
- ------------------------------------------------------------------------------
- CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
- Crystal Dew World: https://crystalmark.info/
- ------------------------------------------------------------------------------
- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
- * KB = 1000 bytes, KiB = 1024 bytes
- [Read]
- SEQ 1MiB (Q= 8, T= 1): 1612.973 MB/s [ 1538.3 IOPS] < 5194.27 us>
- SEQ 128KiB (Q= 8, T= 8): 2544.942 MB/s [ 19416.4 IOPS] < 3293.54 us>
- RND 4KiB (Q= 32, T=16): 81.891 MB/s [ 19992.9 IOPS] < 25522.74 us>
- RND 4KiB (Q= 1, T= 1): 40.776 MB/s [ 9955.1 IOPS] < 100.33 us>
- [Write]
- SEQ 1MiB (Q= 8, T= 1): 842.614 MB/s [ 803.6 IOPS] < 9921.00 us>
- SEQ 128KiB (Q= 8, T= 8): 494.060 MB/s [ 3769.4 IOPS] < 16923.66 us>
- RND 4KiB (Q= 32, T=16): 32.846 MB/s [ 8019.0 IOPS] < 63052.89 us>
- RND 4KiB (Q= 1, T= 1): 16.429 MB/s [ 4011.0 IOPS] < 249.08 us>
- Profile: Default
- Test: 1 GiB (x5) [Z: 0% (0/2883GiB)]
- Mode: [Admin]
- Time: Measure 5 sec / Interval 5 sec
- Date: 2022/05/13 15:28:05
- OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
- Comment: raid0-1 async=disable
复制代码
hdd raidz2*2 async=enable
- ------------------------------------------------------------------------------
- CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
- Crystal Dew World: https://crystalmark.info/
- ------------------------------------------------------------------------------
- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
- * KB = 1000 bytes, KiB = 1024 bytes
- [Read]
- SEQ 1MiB (Q= 8, T= 1): 1583.659 MB/s [ 1510.3 IOPS] < 5291.27 us>
- SEQ 128KiB (Q= 8, T= 8): 2655.567 MB/s [ 20260.4 IOPS] < 3154.99 us>
- RND 4KiB (Q= 32, T=16): 86.604 MB/s [ 21143.6 IOPS] < 24109.44 us>
- RND 4KiB (Q= 1, T= 1): 44.226 MB/s [ 10797.4 IOPS] < 92.49 us>
- [Write]
- SEQ 1MiB (Q= 8, T= 1): 759.449 MB/s [ 724.3 IOPS] < 11013.37 us>
- SEQ 128KiB (Q= 8, T= 8): 545.840 MB/s [ 4164.4 IOPS] < 15318.42 us>
- RND 4KiB (Q= 32, T=16): 30.022 MB/s [ 7329.6 IOPS] < 69128.94 us>
- RND 4KiB (Q= 1, T= 1): 16.713 MB/s [ 4080.3 IOPS] < 244.83 us>
- Profile: Default
- Test: 1 GiB (x5) [Y: 84% (422/500GiB)]
- Mode: [Admin]
- Time: Measure 5 sec / Interval 5 sec
- Date: 2022/05/13 15:33:11
- OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
- Comment: hdd async=disable
复制代码
nvme 单盘 raid0 async=disable
- ------------------------------------------------------------------------------
- CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
- Crystal Dew World: https://crystalmark.info/
- ------------------------------------------------------------------------------
- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
- * KB = 1000 bytes, KiB = 1024 bytes
- [Read]
- SEQ 1MiB (Q= 8, T= 1): 1612.973 MB/s [ 1538.3 IOPS] < 5194.27 us>
- SEQ 128KiB (Q= 8, T= 8): 2544.942 MB/s [ 19416.4 IOPS] < 3293.54 us>
- RND 4KiB (Q= 32, T=16): 81.891 MB/s [ 19992.9 IOPS] < 25522.74 us>
- RND 4KiB (Q= 1, T= 1): 40.776 MB/s [ 9955.1 IOPS] < 100.33 us>
- [Write]
- SEQ 1MiB (Q= 8, T= 1): 842.614 MB/s [ 803.6 IOPS] < 9921.00 us>
- SEQ 128KiB (Q= 8, T= 8): 494.060 MB/s [ 3769.4 IOPS] < 16923.66 us>
- RND 4KiB (Q= 32, T=16): 32.846 MB/s [ 8019.0 IOPS] < 63052.89 us>
- RND 4KiB (Q= 1, T= 1): 16.429 MB/s [ 4011.0 IOPS] < 249.08 us>
- Profile: Default
- Test: 1 GiB (x5) [Z: 0% (0/2883GiB)]
- Mode: [Admin]
- Time: Measure 5 sec / Interval 5 sec
- Date: 2022/05/13 15:28:05
- OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
- Comment: raid0-1 async=disable
复制代码
nvme 四盘 raid10 async=disable
------------------------------------------------------------------------------
CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
Crystal Dew World: https://crystalmark.info/
------------------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes
[Read]
SEQ 1MiB (Q= 8, T= 1): 1657.061 MB/s [ 1580.3 IOPS] < 5056.80 us>
SEQ 128KiB (Q= 8, T= 8): 2558.193 MB/s [ 19517.5 IOPS] < 3276.84 us>
RND 4KiB (Q= 32, T=16): 88.048 MB/s [ 21496.1 IOPS] < 23748.98 us>
RND 4KiB (Q= 1, T= 1): 41.601 MB/s [ 10156.5 IOPS] < 98.34 us>
[Write]
SEQ 1MiB (Q= 8, T= 1): 844.880 MB/s [ 805.7 IOPS] < 9895.56 us>
SEQ 128KiB (Q= 8, T= 8): 490.464 MB/s [ 3741.9 IOPS] < 17042.09 us>
RND 4KiB (Q= 32, T=16): 30.180 MB/s [ 7368.2 IOPS] < 68891.20 us>
RND 4KiB (Q= 1, T= 1): 16.441 MB/s [ 4013.9 IOPS] < 248.89 us>
Profile: Default
Test: 1 GiB (x5) [Z: 0% (0/5824GiB)]
Mode: [Admin]
Time: Measure 5 sec / Interval 5 sec
Date: 2022/05/13 15:40:51
OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
Comment: raid10 async=disable
nvme 四盘 raid5 async=disable
- ------------------------------------------------------------------------------
- CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
- Crystal Dew World: https://crystalmark.info/
- ------------------------------------------------------------------------------
- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
- * KB = 1000 bytes, KiB = 1024 bytes
- [Read]
- SEQ 1MiB (Q= 8, T= 1): 1589.352 MB/s [ 1515.7 IOPS] < 5272.98 us>
- SEQ 128KiB (Q= 8, T= 8): 2492.544 MB/s [ 19016.6 IOPS] < 3363.04 us>
- RND 4KiB (Q= 32, T=16): 87.415 MB/s [ 21341.6 IOPS] < 23907.39 us>
- RND 4KiB (Q= 1, T= 1): 41.116 MB/s [ 10038.1 IOPS] < 99.49 us>
- [Write]
- SEQ 1MiB (Q= 8, T= 1): 824.193 MB/s [ 786.0 IOPS] < 10146.50 us>
- SEQ 128KiB (Q= 8, T= 8): 456.695 MB/s [ 3484.3 IOPS] < 18280.85 us>
- RND 4KiB (Q= 32, T=16): 25.271 MB/s [ 6169.7 IOPS] < 81901.40 us>
- RND 4KiB (Q= 1, T= 1): 16.021 MB/s [ 3911.4 IOPS] < 255.43 us>
- Profile: Default
- Test: 1 GiB (x5) [Z: 0% (0/8521GiB)]
- Mode: [Admin]
- Time: Measure 5 sec / Interval 5 sec
- Date: 2022/05/13 15:47:43
- OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
- Comment: raid5 asyan=disable
复制代码
hddpool metadata:nvme *4 raidz2*2 async=disable
- ------------------------------------------------------------------------------
- CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
- Crystal Dew World: https://crystalmark.info/
- ------------------------------------------------------------------------------
- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
- * KB = 1000 bytes, KiB = 1024 bytes
- [Read]
- SEQ 1MiB (Q= 8, T= 1): 1658.722 MB/s [ 1581.9 IOPS] < 5053.01 us>
- SEQ 128KiB (Q= 8, T= 8): 2994.636 MB/s [ 22847.3 IOPS] < 2793.26 us>
- RND 4KiB (Q= 32, T=16): 72.305 MB/s [ 17652.6 IOPS] < 28894.42 us>
- RND 4KiB (Q= 1, T= 1): 37.200 MB/s [ 9082.0 IOPS] < 109.98 us>
- [Write]
- SEQ 1MiB (Q= 8, T= 1): 769.940 MB/s [ 734.3 IOPS] < 10863.25 us>
- SEQ 128KiB (Q= 8, T= 8): 531.076 MB/s [ 4051.8 IOPS] < 15750.09 us>
- RND 4KiB (Q= 32, T=16): 28.165 MB/s [ 6876.2 IOPS] < 73729.07 us>
- RND 4KiB (Q= 1, T= 1): 16.830 MB/s [ 4108.9 IOPS] < 243.16 us>
- Profile: Default
- Test: 64 GiB (x5) [Z: 84% (422/500GiB)]
- Mode: [Admin]
- Time: Measure 5 sec / Interval 5 sec
- Date: 2022/05/13 16:46:37
- OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
- Comment: hddpool async=diskable
复制代码
hddpool metadata:nvme *4 raidz2*2 async=enable
- ------------------------------------------------------------------------------
- CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo
- Crystal Dew World: https://crystalmark.info/
- ------------------------------------------------------------------------------
- * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
- * KB = 1000 bytes, KiB = 1024 bytes
- [Read]
- SEQ 1MiB (Q= 8, T= 1): 1667.111 MB/s [ 1589.9 IOPS] < 5026.17 us>
- SEQ 128KiB (Q= 8, T= 8): 2612.037 MB/s [ 19928.3 IOPS] < 3208.86 us>
- RND 4KiB (Q= 32, T=16): 73.526 MB/s [ 17950.7 IOPS] < 28417.48 us>
- RND 4KiB (Q= 1, T= 1): 38.491 MB/s [ 9397.2 IOPS] < 106.29 us>
- [Write]
- SEQ 1MiB (Q= 8, T= 1): 806.107 MB/s [ 768.8 IOPS] < 10375.40 us>
- SEQ 128KiB (Q= 8, T= 8): 1982.620 MB/s [ 15126.2 IOPS] < 4222.37 us>
- RND 4KiB (Q= 32, T=16): 27.606 MB/s [ 6739.7 IOPS] < 75252.18 us>
- RND 4KiB (Q= 1, T= 1): 28.798 MB/s [ 7030.8 IOPS] < 142.05 us>
- Profile: Default
- Test: 64 GiB (x5) [Z: 84% (422/500GiB)]
- Mode: [Admin]
- Time: Measure 5 sec / Interval 5 sec
- Date: 2022/05/13 16:55:41
- OS: Windows Server 2019 Datacenter (Full installation) [10.0 Build 20348] (x64)
- Comment: hddpool async=enable
复制代码
最后附一张单盘nvme raid0 两个挂载 同时跑4k结果
|
-
-
|