roh26it
- Karma
- 0
- Created
- ()
- Submissions
- 0
- Why do you need an MCP Gateway? (portkey.ai)
- Everything we know about Claude Code Limits (portkey.ai)
-
Hi HN! I'm Rohit, co-founder and CEO of Portkey. After building our open-source AI gateway that now handles billions of tokens daily, we kept seeing the same problem: prompt engineering is still a dark art. Today we're…
-
I love playing around with these tools for quick prototyping and learning about some stuff, but don't see myself using these for serious apps. Any tips on what I could do?
- We analysed 4B requests on our AI Gateway (portkey.ai)
- Come down a rabbit hole with OpenAI o1 system card (portkey.ai)
-
Hi HN, I've been developing Portkey Gateway, an open-source AI gateway that's now processing billions of tokens daily across 200+ LLMs. Today, we're launching a significant update: integrated Guardrails at the gateway…
- I added context data to the TruthfulQA dataset (huggingface.co)
- Implementing FrugalGPT in Production (portkey.ai)
- Streaming LLM requests need this Nginx config (serverfault.com)
- Caching stream responses across LLMs is hard (twitter.com)
- My Journey with AI-Driven Development (portkey.ai)
-
We are Rohit & Ayush, we created Portkey this year March to help tackle some challenges we had seen while building apps based on GPT3, 3.5, 4, and the DevOps principles we brought to the scene to help tackle them. We…
- Show HN: Anyscale Inference and Portkey Ops (portkey.ai)
- OpenAI DevDay's Implications for LLM Apps in Prod (portkey.ai)
- Portkey launches LLM analytics suite for AI builders (portkey.ai)
- Decoding OpenAI Evals Framework (portkey.ai)
- Comparing LLM Outputs Using Elo Ratings (twitter.com)
- SLAs for LLMs (shreyar.github.io)
- 'Thank you' detection in customer support replies (freshdesk.com)