HN Explorer

Show HN: Agentpanel – Universal LLM API Written in Rust (github.com)

9 points by hackintoshrao ↗ HN
Agentpanel is an observability platform for optimizing the control flow, performance, token usage, and correctness of LLM/AI agents!

Built-in @rustlang, the first release of Agent Panel currently features an AI gateway that provides seamless access to 100+ LLMs across 20+ platforms, including OpenAI GPT-4o, Gemini 1.5 Pro latest, AnthropicAI Claude 3.5, MistralAI, Cohere, Groq,Perplexity AI, and more.

4 comments

[ 3.8 ms ] story [ 19.6 ms ] thread
hamasho
Interesting! And it looks much sane compared to LangChain.

Question: do almost all LLM APIs have the same roles "user", "assistant", and "system"?

hackintoshrao
Thank you. Yes, almost all LLM APIs have the same roles. Let me know your thoughts once you try the project.
mathnmusic
Gemini models don't have "system" roles.