Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism (github.com)

2 points by garkotipankaj ↗ HN
Hi HN!

Disclaimer: I submitted another post about ChainFactory a few days ago.

Here's what has changed since:

- Added hash based caching of auto-generated prompts and masks.

- Did some internal restructuring and cleanup.

- Updated the order in which README doc introduces concepts and terminology.

Posting this again because honestly, I am kinda puzzled about what to add/fix/change due to having 0 users and no genuine feedback.

By genuine feedback, I mean feedback from strangers who do not have a social pressure to be polite and pull punches.

Please take a look if you find this interesting and leave a comment. If you think it's an deranged or stupid idea not worth your time, please at least leave a 'no' - I'd still be delighted as it's an honest opinion.

Thanks a lot!

PS: Is it okay to post updates and changes at regular intervals?

1 comment

[ 3.0 ms ] story [ 11.2 ms ] thread
Ah. Just read the rules. Version updates are not ok unless it's a major overhaul.

Will this be removed? I still desperately need feedback :(