Just checked out the repo — looks good. Only thing I'd suggest is maybe plug in LiteLLM for a more generalized inference setup. Could make things more flexible
Yes, I was talking specifically about the log analysis part. Yes it is a good idea and will be a useful service. Especially where we need to configure servers on cloud, it can be implemented that it can decide the…
Hello, Given that the majority of businesses have private subnets, I believe the primary question for which everyone is searching for a solution is how to access any LLM in a private subnet. Your suggestion can be put…
Just checked out the repo — looks good. Only thing I'd suggest is maybe plug in LiteLLM for a more generalized inference setup. Could make things more flexible
Yes, I was talking specifically about the log analysis part. Yes it is a good idea and will be a useful service. Especially where we need to configure servers on cloud, it can be implemented that it can decide the…
Hello, Given that the majority of businesses have private subnets, I believe the primary question for which everyone is searching for a solution is how to access any LLM in a private subnet. Your suggestion can be put…