timedude

↗ HN profile [ 74.5 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. Inference on AWS Bedrock for OpenAI models has been very slow and glitchy the last few days with today being the worst. Very long latency of over 5 minutes to first token. What's going on?