[–] themerone 1y ago ↗ This works by text substitution, I imagine that you could get similar or better gains using zstd custom dictionaries. [–] seccode 1y ago ↗ This is a direct comparison to zstd with a dictionary actually [–] seccode 1y ago ↗ Methodology for comparison: train zstd dictionary on enwik9. Then build my dictionary as most common words in enwik9. Mine does 13% better because of the way I discovered how you can generate dictionary replacement symbols
[–] seccode 1y ago ↗ This is a direct comparison to zstd with a dictionary actually [–] seccode 1y ago ↗ Methodology for comparison: train zstd dictionary on enwik9. Then build my dictionary as most common words in enwik9. Mine does 13% better because of the way I discovered how you can generate dictionary replacement symbols
[–] seccode 1y ago ↗ Methodology for comparison: train zstd dictionary on enwik9. Then build my dictionary as most common words in enwik9. Mine does 13% better because of the way I discovered how you can generate dictionary replacement symbols
3 comments
[ 2.5 ms ] story [ 20.0 ms ] thread