gbletr42

6 ms·

1.
by gbletr42 3y ago
I've updated the benchmarks to include those flags. I've also specified the versions of all software involved. It seems par2 is significantly faster with those options set than without, as in by an order of magnitude, it seems par
2.
by gbletr42 3y ago
haha! Everything in the source code is prefixed with bef_ to avoid any possible symbol collisions when linking, so it'd be a pain to unlearn prefixing it.
3.
by gbletr42 3y ago
>and even 10000 and it still worked!!!! pretty awesome Mind you, bursts greater than a certain size, around 8000 bytes for the defaults, are a game of probability in what damage they will do. In most cases it'll work like you did fo
4.
by gbletr42 3y ago
Got it, I'll add par2cmdline-turbo (I didn't know it existed) to the list along with those key details. Likewise, I'll also go and describe the benefits and downsides of each tool in more detail. I'll get around to it wh
5.
by gbletr42 3y ago
>Is that because, as you increase the interleave, it increases the amount of the stream you need to read in order to repair any corruption? Yes, as you need to read the entire set of interleaved blocks to get each respective block, so to
6.
by gbletr42 3y ago
> i bef'ed the Makefile, removed a character, tried to 'deconstruct' it, the output is zero bytes I can't reproduce this. These are the commands I used, with it freshly compiled on a ubuntu docker container, both the
7.
by gbletr42 3y ago
the parity fragments are by default just stored at the end, interleaved like every other fragment. It doesn't actually matter whether a parity or a data fragment get corrupted, as long as there are at least some determinate number of t
8.
by gbletr42 3y ago
Sadly my tool currently doesn't account for that type of corruption, as it doesn't know what is good data or bad data when reading. So if bad data is inserted between symbols/fragments, rather than corrupting the symbols&#x2F
9.
by gbletr42 3y ago
Currently there is just one set of defaults, but I could very well add multiple different defaults dedicated to certain use cases such as the ones you have. I imagine it'd be something like this bef -c --default share -i input -o outpu
10.
by gbletr42 3y ago
I was not, as I am a english speaker with no knowledge of Dutch. I find it a funny coincidence, but if I change the name bef now it'll mess with my muscle memory.
11.
by gbletr42 3y ago
Done! Thank you, for it never occurred to me someone might stumble upon my software without already knowing (a dumb lapse of mind, I know).
12.
by gbletr42 3y ago
I'm not familiar with zbackup, but from a google search appears to be a tool to deduplicate and encrypt data. The process envisioned while making this was to use a series of pipes unix style to make the backup, e.g. tar c dir | zstd |
13.
by gbletr42 3y ago
Sure, erasure coding is a form of error correcting codes that can be applied to data such that you can lose some n number of codes before you can successfully reconstruct the input data. For example, take k input symbols, and put it into an
14.
by gbletr42 3y ago
Hello Hacker News! I'm been developing this piece of software for about a week now, to serve as a fast and easy to use replacement for par2cmdline and zfec. Now that it is in good and presentable state, I'm releasing it to the wor
15.
Show HN: bef – a tool that encodes/decodes interleaved erasure coded streams(github.com)
59 points by gbletr42 3y ago|44 comments