I’ve spent years manually tuning CUDA kernels, and it’s exhausting. Recently, I experimented with real-time profiling to see bottlenecks instantly. The results were surprising—small tweaks yielded huge performance gains.

This got me thinking: we spend so much time iterating manually when profiling could guide optimizations automatically. Curious if others have tried this approach, or if there are better ways to tackle kernel tuning at scale.