Ask HN: How are you improving your use of LLMs in production?

I asked this about two years ago and got some interesting answers: https://news.ycombinator.com/item?id=36787924

Now that the LLMs space has evolved a ton with better models, lots of tools, and a lot more folks shipping LLMs into production, how are y'all doing this today?