[–] zX41ZdbW 3y ago ↗ You can also use this tool to amplify the data volume for tests.For example, based on a dataset of 100 million records from ClickBench, I created a dataset of 100 billion records. Here is a description of how to generate this dataset:https://github.com/ClickHouse/ClickBench/tree/main/clickhous...Basically, you train a model on the existing dataset, then run the generator multiple times in parallel with different seeds.
[–] znaimon 3y ago ↗ This is so cool! Laughed at using the Wolfenstein 3D 'fizzlefade' animation to illustrate pseudo-random permutations
2 comments
[ 3.1 ms ] story [ 12.0 ms ] threadFor example, based on a dataset of 100 million records from ClickBench, I created a dataset of 100 billion records. Here is a description of how to generate this dataset:
https://github.com/ClickHouse/ClickBench/tree/main/clickhous...
Basically, you train a model on the existing dataset, then run the generator multiple times in parallel with different seeds.