HN Explorer

projectstarter

↗ HN profile [ 194 ms ] full profile
Karma
3
Created
February 6, 2024 (2y ago)
Submissions
0
  1. Show HN: Model Gateway – bridging your apps with LLM inference endpoints (github.com)

    - Automatic failover and redundancy in case of AI service outages. - Handling of AI service provider token and request limiting. - High-performance load balancing - Seamless integration with various LLM inference…

    2 points 0
  2. Show HN: Get up to 15x faster response from OpenAI GPT API with Model Gateway (modelgw.com)

    I was so desperate after creating an AI agent that used GPT-4 API. It worked great but was very slow. It was so slow that it was almost unusable. Then I found out that speed of the GPT API can be radically better.

    3 points 0