richardliaw
- Karma
- 193
- Created
- August 13, 2014 (11y ago)
- Submissions
- 0
- LLM Inference Endpoint Performance Benchmarking Tool (github.com)
- Continuous batching enables 23x throughput in LLM inference (anyscale.com)
- Anyscale's Aviary is a dashboard for evaluating Open Source LLMs (aviary.anyscale.com)
- Numbers every LLM developer should know (github.com)
- How to build a LLM search engine using a self-hosted LLM (anyscale.com)
- Ray is the next generation ML framework (orenleung.super.site)
- Anyscale raises $40M Series B to revolutionize serverless computing (techcrunch.com)
- Cloud Computing in Python for all major clouds (medium.com)
- Large Scale Training at Berkeley AI Research (bair.berkeley.edu)
- Ray (from UC Berkeley), for the Curious (medium.com)
- Ray for the Curious (medium.com)