Show HN: Exploring the tree of LLM generations [video] (youtube.com)

5 points by msoloviev ↗ HN
This is a simple text editor, made using gtkmm 3 and llama.cpp, that allows you to explore the possible continuations (ranked by descending probability) that an LLM would output after each token. I was quite surprised that there didn't seem to be a tool like that out there yet, so I decided to make my own. Source is on Github (https://github.com/blackhole89/autopen), though the code is still in a very rough shape.

0 comments

[ 2.0 ms ] story [ 8.1 ms ] thread

No comments yet.