Commit graph

947 commits

Author SHA1 Message Date
Andrea Mazzoleni
84d274bd2e Add AArch64 NEON parity generation and recovery functions 2026-07-30 16:26:38 +02:00
Andrea Mazzoleni
03f5458e90 Further conversions from 32 to 64 bits 2026-07-30 16:26:38 +02:00
Andrea Mazzoleni
df0139493b Migrate block_off_t to 64-bit with updated CLI parsing, VLQ serialization, and format specifiers 2026-07-30 16:26:38 +02:00
Andrea Mazzoleni
e8b3059511 Remove the unused number of data disks from the vector allocation
The same addressing rules are applied to the parity disks because
they are used as data disks during recovery operations.
2026-07-30 16:26:38 +02:00
Andrea Mazzoleni
12e843b06e Use the optimal displacement depending on the number of disks 2026-07-30 16:26:38 +02:00
Andrea Mazzoleni
d5fe6f14f6 Assume the assembler supports all x86 SSE/AVX instructions 2026-07-30 16:26:38 +02:00
Andrea Mazzoleni
aaaf175a80 Add support for AVX2 GFNI 2026-07-30 16:26:38 +02:00
Andrea Mazzoleni
cec3efb058 Disable AVX512 on CPUs with narrow shuffle ports or double-pumped 256-bit datapath 2026-07-30 16:26:38 +02:00
Andrea Mazzoleni
cfb9ac0224 Extend io_init() to support arbitrary combinations of data and parity operations 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
613b88da83 Do not expose Windows threads keys 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
71157c79ee Validate GUIDs before passing them to PowerShell 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
f359b8c431 Take into account that btrfs devices can be not contiguous 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
598dc13918 Portability 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
4f53e6bb61 Secure the popen use 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
b04ae73eef Delete snapshot links in Windows 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
b2b2b6d391 Report issues in github 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
3cc18a1168 Automatically exclude the snapshot .snapraid directory and content files 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
f7524d39a0 Preliminary support for AVX512GFNI 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
db98fb0e68 Allow to configure path of external tools 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
72cbf932d9 Secure external tools execution 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
afefcffa7c Add Windows VirtualShadowCopy support for snapshots 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
8d19590829 Add Windows support for symlink of directories 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
ff3806c185 In Windows readlink now convert \ to / to match symlink behaviour 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
b0504f4f1a Always use PATH_MAX instead of MAX_PATH (limited to 260) 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
f9a935f051 Sanitize shell execution 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
ea70143695 Add ZFS support 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
6354ec9236 Rework snapshot interface 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
7ff591a5c3 Add Bcachefs support 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
078cdc4ee6 Change the BLOCK_HASH_SIZE type to avoid potential overflow 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
179ad68dd2 Target Windows 7 instead of Windows Vista 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
426f7a4387 Modernize configure.ac 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
4a6a446ea6 More coverage support 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
9042f6e36e Add regression check for Btrfs
It requires root privileges as it has to create Btrfs filesystems.
2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
36ac09529d Remove the requirement to snapshot content files
The new content file format now includes metadata for previous versions
of files. This allows the fix command to access historical file data from
snapshots as needed, ensuring recovery even if the live filesystem has
changed or the file was deleted during a sync.
2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
e20c54eeb9 Track deallocated files in the content file for parity recovery
Add a new 'dealloc' list per disk to record files that were removed
or modified during a scan. This list is saved in the content file
(new format version SNAPCNT4) so that past parity contributions of
those files can be imported from previous snapshots.
2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
9538d76673 Change commenting style 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
d57c1a986d Sync no longer requires clearing the past hash
It no longer assumes past hashes are valid if even a single unsynced
block exists, which indicates a previous sync was interrupted.

While this makes syncing slower after an interruption, it preserves the
past hash in the content file, enabling a more reliable fix if a
disk fails following an incomplete sync.

This ensures the --import option remains functional even after an
interrupted sync.
2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
5dbe1feb14 Add detection of AVX2GFNI 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
8247bd6d06 Integrate new AVX512 functions in the speed test 2026-07-30 16:26:37 +02:00
Andrea Mazzoleni
0f3f1f8b97 Add Btrfs snapshot support for atomic sync and recovery consistency 2026-07-30 16:26:35 +02:00
Andrea Mazzoleni
d2bd5c8934 New Btrfs support using IOCTLs to get UUID and low level devices 2026-07-30 16:26:11 +02:00
Andrea Mazzoleni
19bcf0df9a Get the UUID from the imported file or directory 2026-07-30 16:26:11 +02:00
Christoph Hellwig
34966bc137 Make all RAID forwarders static and local using a new registration interface
Co-authored-by: Andrea Mazzoleni <amadvance@gmail.com>
2026-07-30 16:26:11 +02:00
Andrea Mazzoleni
e886a9a0dd Drop the test-run option from the official binary 2026-07-30 16:26:11 +02:00
Andrea Mazzoleni
c4dea55d31 Log using log_error all errors that are not resulting in an early termination 2026-07-30 16:26:10 +02:00
Andrea Mazzoleni
91ac39398f Reduce permission to avoid to spin up disks in Windows 2026-07-30 16:26:10 +02:00
Andrea Mazzoleni
c54741d81c More informational error level messages
Some checks failed
Build / build-mac (push) Has been cancelled
Build / build-linux (push) Has been cancelled
Build / build-win (push) Has been cancelled
CodeQL Advanced / Analyze (c-cpp) (push) Has been cancelled
CodeQL Advanced / Analyze (actions) (push) Has been cancelled
2026-07-30 16:25:49 +02:00
Andrea Mazzoleni
8ad44159fd Add a new informational error level for messages
Some checks are pending
Build / build-mac (push) Waiting to run
Build / build-linux (push) Waiting to run
Build / build-win (push) Waiting to run
CodeQL Advanced / Analyze (c-cpp) (push) Waiting to run
CodeQL Advanced / Analyze (actions) (push) Waiting to run
2026-07-29 16:44:10 +02:00
Andrea Mazzoleni
5342ffc05f Enable lock file support on Windows using CreateFileW with exclusive share mode 2026-07-29 16:25:43 +02:00
Andrea Mazzoleni
3f280486bd Fix regression with both touch and threshold active at the same time 2026-07-19 17:55:29 +02:00