Commit graph

933 commits

Author SHA1 Message Date
Andrea Mazzoleni
21739d1d53 Add AArch64 NEON parity generation and recovery functions 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
06cec83196 Further conversions from 32 to 64 bits 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
59a7cd97d7 Migrate block_off_t to 64-bit with updated CLI parsing, VLQ serialization, and format specifiers 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
1f95857e80 Remove the unused number of data disks from the vector allocation
The same addressing rules are applied to the parity disks because
they are used as data disks during recovery operations.
2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
cf3ef337a7 Use the optimal displacement depending on the number of disks 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
45141b51a5 Add build option to allow hardlink tools 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
0c1580767e Assume the assembler supports all x86 SSE/AVX instructions 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
d8beca84c5 Add support for AVX2 GFNI 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
96005850dd Disable AVX512 on CPUs with narrow shuffle ports or double-pumped 256-bit datapath 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
f45420df7b Extend io_init() to support arbitrary combinations of data and parity operations 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
e6214cec1d Do not expose Windows threads keys 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
1dac98bcc1 Validate GUIDs before passing them to PowerShell 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
0922827651 Take into account that btrfs devices can be not contiguous 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
9a84c0390f Portability 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
4c72fb4b49 Secure the popen use 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
2f5ffc3e90 Add new build option to allow symlinks 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
dccba9fd8c Delete snapshot links in Windows 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
f8724cb8bb Report issues in github 2026-06-10 15:28:54 +02:00
Andrea Mazzoleni
a8210b3350 Automatically exclude the snapshot .snapraid directory and content files 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
9eca9623b3 Preliminary support for AVX512GFNI 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
ebd9ece35c Allow to configure path of external tools 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
c5e48ea558 Secure external tools execution 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
f63963e72e Add Windows VirtualShadowCopy support for snapshots 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
63d76e177d Add Windows support for symlink of directories 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
8431f4ba65 In Windows readlink now convert \ to / to match symlink behaviour 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
d10da126d0 Always use PATH_MAX instead of MAX_PATH (limited to 260) 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
538aec2021 Sanitize shell execution 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
fc81e3509f Add ZFS support 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
000a1a1a46 Rework snapshot interface 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
1057e66843 Add Bcachefs support 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
28121dbf17 Change the BLOCK_HASH_SIZE type to avoid potential overflow 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
9f17fd3828 Target Windows 7 instead of Windows Vista 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
be74644823 Modernize configure.ac 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
22c33a5ba7 More coverage support 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
b96cae90a2 Add regression check for Btrfs
It requires root privileges as it has to create Btrfs filesystems.
2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
cbb4ac831a Remove the requirement to snapshot content files
The new content file format now includes metadata for previous versions
of files. This allows the fix command to access historical file data from
snapshots as needed, ensuring recovery even if the live filesystem has
changed or the file was deleted during a sync.
2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
786804ba41 Track deallocated files in the content file for parity recovery
Add a new 'dealloc' list per disk to record files that were removed
or modified during a scan. This list is saved in the content file
(new format version SNAPCNT4) so that past parity contributions of
those files can be imported from previous snapshots.
2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
1c416ddb52 Change commenting style 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
ce35b5f98e Sync no longer requires clearing the past hash
It no longer assumes past hashes are valid if even a single unsynced
block exists, which indicates a previous sync was interrupted.

While this makes syncing slower after an interruption, it preserves the
past hash in the content file, enabling a more reliable fix if a
disk fails following an incomplete sync.

This ensures the --import option remains functional even after an
interrupted sync.
2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
825f02d45a Add detection of AVX2GFNI 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
cf1781c37e Integrate new AVX512 functions in the speed test 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
4f4075eef3 Add Btrfs snapshot support for atomic sync and recovery consistency 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
1b45752f90 New Btrfs support using IOCTLs to get UUID and low level devices 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
b3cdb01de6 Get the UUID from the imported file or directory 2026-06-10 15:28:53 +02:00
Christoph Hellwig
9135379dab Make all RAID forwarders static and local using a new registration interface
Co-authored-by: Andrea Mazzoleni <amadvance@gmail.com>
2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
d8bf8abe42 Drop the test-run option from the official binary 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
8d2a257208 Log using log_error all errors that are not resulting in an early termination 2026-06-10 15:28:53 +02:00
Andrea Mazzoleni
bf2657b76a Avoid saving the content file in touch if nothing changed 2026-06-10 14:49:47 +02:00
Andrea Mazzoleni
e4aa186b1a Fix touching of files that in Windows have the read-only attribute set 2026-06-10 10:41:11 +02:00
Andrea Mazzoleni
5cfebba19e Remove unnecessary log argument 2026-06-03 20:57:08 +02:00