btwillard
- Karma
- 92
- Created
- August 9, 2019 (6y ago)
- Submissions
- 0
https://brandonwillard.github.io/
- How fast can grammar-structured LLM generation be? (blog.dottxt.co)
- Show HN: VLLM with JSON Guided Generation (outlines-dev.github.io)
Our project, Outlines, now offers guided/constrained generation (e.g. according to a JSON schema) via the VLLM library. My colleague, Rémi, created some patches that allow one to pass vLLM a JSON schema along with the…
- Show HN: An open-source alternative to OpenAI function calling (outlines-dev.github.io)