sasjaws
No user record in our sample, but sasjaws has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
No user record in our sample, but sasjaws has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
The idea i tried to express was purely the loss function thing you mentioned, and how both tasks (1 vs 2 vs n) lead to identical training runs. At least with nanogpt. I dont know if that extrapolates well to current llm…
No blog post, my llm expert friend told me this was kinda obvious when i shared it with him so i didnt think it was worth it. I can tell you how i got there, i did nanogpt, then tried to be smart and train a model with…
This is about reasoning tokens right? I didnt mean that, nanogpt doesnt do that. Nanogpt inference just outputs letters directly, no intermediate tokens.
Thats actually an interesting way to look at it. However i just posted that because i often see articles expressing amazement at how training an llm at next token prediction can take it so far. Seemingly ontrasting the…
Thats the one, lots of fun and a great entrypoint for experimentation.
A while ago i did the nanogpt tutorial, i went through some math with pen and paper and noticed the loss function for 'predict the next token' and 'predict the next 2 tokens' (or n tokens) is identical. That was a bit…
Personalized audio streams for language learners. Ideal for during driving or while doing chores. https://listen.longyan.io/ At the intermediate level lots of learners struggle to find suitable content that matches…
I've added support for Lithuanian and created a stream about version control for you to try it out. Just 'select language' -> Lithuanian -> Play If you find it useful, you can register for free and create new streams on…
I'm building a service that generates audio streams about subjects and vocab of your choosing, currently notebookLM based. If you have intermediate listening skills its pretty useful for deepening regular vocab and…
Thanks for having a look, I actually started out from traditional characters, but once I realized >90% of the students only do simplified I switched. I also tend to believe to just convert between them is not the best…
I'm building a reader app that tries to solve this exact problem by providing a range of gradually simplified versions of each article to match your proficiency. So you can stay in the sweet spot, or work your way up…