Blue_Cosma

↗ HN profile [ 418 ms ] full profile

No user record in our sample, but Blue_Cosma has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.

  1. After three years working on private LLM infrastructure, I still can't pin down who and how big the market is. The ecosystem has matured: DGX Spark, high-end Mac Studios, AMD Strix Halo, upcoming DGX Station. Models are…

  2. Hi HN, I've recently spoken with two companies that mentioned the high costs of creating embeddings on their datasets for RAG applications. A PE firm shared that generating embeddings for new data rooms could cost up to…

  3. Hey HN, If you tried running open-source models like Llama 3.1 70B or 405B, you might have noticed that it gets very expensive. The reason looks obvious enough that you might have stopped even before trying it! - GPUs…

  4. Hey HN, If you tried running open-source models like Llama 3.1 70B or 405B, you might have noticed that it gets very expensive. The reason looks obvious enough that you might have stopped even before trying it! - GPUs…

  5. Hey HN, If you've tried running open-source models like Llama 3.1 70B or 405B, you might have noticed that it gets very expensive. The reasons look obvious enough that you might have stopped even before trying it! -…