With the right code, NTFS is not much slower than ext4, for example. Nearly 3% for tar.gz and more than 30% for a heavily multi-threaded use like Pack. https://forum.lazarus.freepascal.org/index.php/topic,66281.m...
SQLite can be faster than FileSystem for small files. For big files, it can do more than 1 GB/s. On Pack [1], I benchmarked these speeds, and you can go very fast. It can be even 2X faster than tar [2]. In my opinion,…
Thank you for the notes. I am well aware of the levels and Pack uses custom configuration to match its inner design. Maybe more level come, or maybe not. But to be clear, Pack supports any valid Zstandard content, and…
Then `--press=hard` would be the choice for you.
Sane choice, albeit delayed, as Zstandard has been the leading standard algorithm in the field for quite some time. I tested most of them for developing Pack [1] and Zstandard looked like the best alternative to the…
Readers may find Pack interesting: https://news.ycombinator.com/item?id=39793805
Thank you for the new numbers. Sure, it can be different on different machines, especially full systems. For me on Linux and ext4, Pack finishes the Linux code base at just 0.96 s. Anyway, I do not expect an order of…
Easy to build using this document: https://pack.ac/source Each binary has its own build script that you can use for yourself. Binaries are used for static builds and to ease future needs.…
Yes, I am. Pack can hold millions of files with no problem. One field in which it shines is that, aside from being fast at processing large amounts of data, it can process many small files much faster than similar tools…
It makes me happy. It looks clean and pseudocode-like. It helps readers from around the world with different languages understand.
You got a point. Although with that that option comes a great cost: We will lose portability, speed and even reliability. Portability: Receiver (or future you) needs to know what you used, and what version even. Speed:…
What are the parameters you gave to the CLI program? This issue seems interesting, as these files on Windows 11 were tested countless times. To be clear, you can run Pack as: `pack.exe ./linux-master/`
You can do that with Pack: `pack -i ./test.pack --include=/a/file.txt` or a couple files and folders at once: `pack -i ./test.pack --include=/a/file.txt --include=/a/folder/` Use `--list` to get a list of all files:…
Pack binary? Can you tell what machine and what steps? Build.sh can be used for Windows too, using MSYS2 UCRT64.
It is not disabled, as you think. It is secured by the internal code in Pack. Almost all parts of Pack are multithreaded.
Thank you! Exposure comes from enthusiasts like you. I did not want to focus the point on speed, or say, "Look, others are bad". They are great; my point was, "Look what we can do if we update our design and code". Pack…
I am happy to hear that, and I really appreciate your interest. Did you compile it for yourself? Any problem or steps you used, I will be happy to hear, o at pack.ac or GitHub, as it is hard to follow the building here.…
Did you compile it for yourself? Any problem or steps you used, I will be happy to hear, o at pack.ac or GitHub, as it is hard to follow the building here. I should prepare more documents on how to build it. I suspect…
You are one of the bravest. And you know that, using SQLite as the base storage, rules out many of the security problems we can face. Anyone needing to reimplement Pack, can do it, very easily, if not easier than…
I answered this question here: https://news.ycombinator.com/item?id=39801083 If that is not enough, let me know. 7-Zip with the ZSTD patch is good too, but Pack is much faster at handling many files. Testing packing the…
Thank you very much! I guess you are friend with colors ;)
Indeed. Benchmarking Pack as a file system was fun. It is near 10X faster to let you iterate all the files compared to what I get from NTFS (warm with all caching on for both solutions). Someday, it can be used as a…
I answered this question here: https://news.ycombinator.com/item?id=39801083 If that is not enough, let me know.
You may like to read https://pack.ac/note/pack and test it for yourself.
Hello, and thank you for the notes. Unfortunately, your points seem to be mostly wrong, so let me clarify them a little. Do not worry; many people misunderstand SQLite and its abilities. - Single implementation: Sure.…
With the right code, NTFS is not much slower than ext4, for example. Nearly 3% for tar.gz and more than 30% for a heavily multi-threaded use like Pack. https://forum.lazarus.freepascal.org/index.php/topic,66281.m...
SQLite can be faster than FileSystem for small files. For big files, it can do more than 1 GB/s. On Pack [1], I benchmarked these speeds, and you can go very fast. It can be even 2X faster than tar [2]. In my opinion,…
Thank you for the notes. I am well aware of the levels and Pack uses custom configuration to match its inner design. Maybe more level come, or maybe not. But to be clear, Pack supports any valid Zstandard content, and…
Then `--press=hard` would be the choice for you.
Sane choice, albeit delayed, as Zstandard has been the leading standard algorithm in the field for quite some time. I tested most of them for developing Pack [1] and Zstandard looked like the best alternative to the…
Readers may find Pack interesting: https://news.ycombinator.com/item?id=39793805
Thank you for the new numbers. Sure, it can be different on different machines, especially full systems. For me on Linux and ext4, Pack finishes the Linux code base at just 0.96 s. Anyway, I do not expect an order of…
Easy to build using this document: https://pack.ac/source Each binary has its own build script that you can use for yourself. Binaries are used for static builds and to ease future needs.…
Yes, I am. Pack can hold millions of files with no problem. One field in which it shines is that, aside from being fast at processing large amounts of data, it can process many small files much faster than similar tools…
It makes me happy. It looks clean and pseudocode-like. It helps readers from around the world with different languages understand.
You got a point. Although with that that option comes a great cost: We will lose portability, speed and even reliability. Portability: Receiver (or future you) needs to know what you used, and what version even. Speed:…
What are the parameters you gave to the CLI program? This issue seems interesting, as these files on Windows 11 were tested countless times. To be clear, you can run Pack as: `pack.exe ./linux-master/`
You can do that with Pack: `pack -i ./test.pack --include=/a/file.txt` or a couple files and folders at once: `pack -i ./test.pack --include=/a/file.txt --include=/a/folder/` Use `--list` to get a list of all files:…
Pack binary? Can you tell what machine and what steps? Build.sh can be used for Windows too, using MSYS2 UCRT64.
It is not disabled, as you think. It is secured by the internal code in Pack. Almost all parts of Pack are multithreaded.
Thank you! Exposure comes from enthusiasts like you. I did not want to focus the point on speed, or say, "Look, others are bad". They are great; my point was, "Look what we can do if we update our design and code". Pack…
I am happy to hear that, and I really appreciate your interest. Did you compile it for yourself? Any problem or steps you used, I will be happy to hear, o at pack.ac or GitHub, as it is hard to follow the building here.…
Did you compile it for yourself? Any problem or steps you used, I will be happy to hear, o at pack.ac or GitHub, as it is hard to follow the building here. I should prepare more documents on how to build it. I suspect…
You are one of the bravest. And you know that, using SQLite as the base storage, rules out many of the security problems we can face. Anyone needing to reimplement Pack, can do it, very easily, if not easier than…
I answered this question here: https://news.ycombinator.com/item?id=39801083 If that is not enough, let me know. 7-Zip with the ZSTD patch is good too, but Pack is much faster at handling many files. Testing packing the…
Thank you very much! I guess you are friend with colors ;)
Indeed. Benchmarking Pack as a file system was fun. It is near 10X faster to let you iterate all the files compared to what I get from NTFS (warm with all caching on for both solutions). Someday, it can be used as a…
I answered this question here: https://news.ycombinator.com/item?id=39801083 If that is not enough, let me know.
You may like to read https://pack.ac/note/pack and test it for yourself.
Hello, and thank you for the notes. Unfortunately, your points seem to be mostly wrong, so let me clarify them a little. Do not worry; many people misunderstand SQLite and its abilities. - Single implementation: Sure.…