> Yeah so MoE doesn't really come into play for production serving -- once you are batching your requests you hit every expert at a large enough batch size In their V3 paper DeepSeek talk about having redundant copies…
It has to do with how correlated conditions are in your 100 places. Conditions on one square inch of your floor are very highly correlated with conditions on another square inch of your floor, so they wouldn't be able…
> Yeah so MoE doesn't really come into play for production serving -- once you are batching your requests you hit every expert at a large enough batch size In their V3 paper DeepSeek talk about having redundant copies…
It has to do with how correlated conditions are in your 100 places. Conditions on one square inch of your floor are very highly correlated with conditions on another square inch of your floor, so they wouldn't be able…