Token Optimisation with LLMs

1 points by xoptions ↗ HN
I understand prompt caching is an effective way for optimising for input tokens. What are other options for optimising input tokens? My input tokens maximise in using an xml file.

I have avoided using TOONs [1] because it works only with uniform arrays, not nested objects nor non-uniform structures.

[1]https://github.com/toon-format/toon

0 comments

[ 2.7 ms ] story [ 13.6 ms ] thread

No comments yet.