Commit graph

134 commits

Author SHA1 Message Date
Andrea Mazzoleni
f3c3265116 Document dummy register clobbers in raid_sse_end and raid_neon_end 2026-08-18 23:33:56 +02:00
Andrea Mazzoleni
47b321d97c Support dynamic runtime selection of RAID AES mode 2026-08-18 23:33:56 +02:00
Andrea Mazzoleni
49d5e685c9 Avoid a folding VLA warning in clang 2026-08-18 23:33:55 +02:00
Andrea Mazzoleni
8e2b9c03b5 Use uniform ending on files for parity implementation 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
1a3099d7f5 Fix building on x86 for missing AVX512 support 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
fd2dc7810f Run the speed test with and without displacement 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
2dbb25acbd Allow to specify the wrap size in allocation 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
e43964523f Refactor and reorganize parity generation functions using inline templates 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
22495abe9e Add AArch64 NEON parity generation and recovery functions 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
807f2f6690 Use vpternlogq in raid_gen3-6_avx512bw to fuse sequential vpxorq instructions into single 3-way XORs 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
9e1652673d Gate AVX-512BW gen1/gen2 behind slow_avx512() to avoid double-pumped shuffle penalties 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
76998613da Remove the unused number of data disks from the vector allocation
The same addressing rules are applied to the parity disks because
they are used as data disks during recovery operations.
2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
7a7dacc6db Inject variable page-offset noise to disk buffer displacement to mitigate prefetcher contention 2026-08-18 23:33:54 +02:00
Andrea Mazzoleni
5795b9706e Use the optimal displacement depending on the number of disks 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
1e63403bf2 Change RAID AVX512/GFNI functions to use forward iterations 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
6cb3d86f66 Remove the special case of a single data disk when not strictly required 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
810851da37 Remove unused level 0 from the pshufb table 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
f8abcd666f Change the AVX512BW generation to use pshufb also for Q parity 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
dd8e3bfcb0 Extend the pshufb table to include the Q parity coefficients 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
04df1f7b26 New displacement benchmarks 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
f1bc02f52a Simplify GFNI implementations 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
abfa6fde28 Always build RAID test with USE_RAID_AES 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
108915254e Assume the assembler supports all x86 SSE/AVX instructions 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
44d23c16ff Extend the RAID regression test to detect unset parity 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
c08a571d88 Add support for AVX2 GFNI 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
557dcda9cd Disable AVX512 on CPUs with narrow shuffle ports or double-pumped 256-bit datapath 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
1b8bf8dfd0 Revise the RAID library Makefile 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
599a4fbb42 Be more clear when GFNI is really used 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
d67cdd8b9d Optimize AVX512 gen1 parity with the vpternlogq instruction 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
9005af10ad Add tables for the AES Polynomial 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
9b8e4a8845 Comment about the RAID optimizations 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
e381e74ee6 Use a simpler approach in the new AVX512 generation functions 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
639167efba Preliminary support for AVX512GFNI 2026-08-18 23:33:53 +02:00
Andrea Mazzoleni
d735eb7736 Change commenting style 2026-08-18 23:33:52 +02:00
Andrea Mazzoleni
03a8927571 Add detection of AVX2GFNI 2026-08-18 23:33:52 +02:00
Andrea Mazzoleni
bba98c3e63 Add more AVX512 functions for parity 2026-08-18 23:33:52 +02:00
Andrea Mazzoleni
d0fb6d2ac3 Preliminary support for ADVX512 2026-08-18 23:33:52 +02:00
Christoph Hellwig
cf515b82b2 Make all RAID forwarders static and local using a new registration interface
Co-authored-by: Andrea Mazzoleni <amadvance@gmail.com>
2026-08-18 23:33:52 +02:00
Andrea Mazzoleni
562d59d9c8 Avoid a folding VLA warning in clang 2026-07-06 15:57:49 +02:00
Andrea Mazzoleni
ae9b472898 Add detection of AVX512BW and AVX512GFNI 2026-04-16 00:13:51 +02:00
Andrea Mazzoleni
b709371d2d Fix typos in the comment of the raid library
Some checks are pending
Build / build-mac (push) Waiting to run
Build / build-linux (push) Waiting to run
Build / build-win (push) Waiting to run
CodeQL Advanced / Analyze (c-cpp) (push) Waiting to run
CodeQL Advanced / Analyze (actions) (push) Waiting to run
2026-04-15 10:53:25 +02:00
Andrea Mazzoleni
0d0431a907 Simpler Copyright string 2026-04-09 17:56:49 +02:00
Christoph Hellwig
60269a1236 Use SPDX (https://spdx.dev/) tags to identify the license used for each
file, and a COPYING file explaining the licensing scheme, with the actual
licenses listed in the LICENSES/ directory.
2026-04-02 16:01:37 +02:00
Andrea Mazzoleni
e80734fc4c Fix typos 2026-01-22 16:13:25 +01:00
Andrea Mazzoleni
f7798b2357 Update performance test of raid.c
Some checks failed
Build / build-mac (push) Has been cancelled
Build / build-linux (push) Has been cancelled
Build / build-win (push) Has been cancelled
CodeQL / Analyze (push) Has been cancelled
2025-10-14 23:26:34 +02:00
Andrea Mazzoleni
13a4872e69 Revise the top comment of raid.c
Some checks failed
Build / build-mac (push) Has been cancelled
Build / build-linux (push) Has been cancelled
Build / build-win (push) Has been cancelled
CodeQL / Analyze (push) Has been cancelled
2025-10-13 17:32:55 +02:00
Andrea Mazzoleni
56c4076e23 Avoid a warning about function pointer conversion. No functional changes 2025-01-23 15:51:59 +01:00
Andrea Mazzoleni
607564c5fe Fix some typos 2023-12-09 10:45:26 +01:00
Jens Kühnel
6b3ac2a6cb Update address of FSF in GPLv2 2023-08-09 14:44:48 +02:00
Andrea Gelmini
2dacb15516 Fix typos
Signed-off-by: Andrea Gelmini <andrea.gelmini@gelma.net>
2022-07-21 14:48:48 +02:00