HN Explorer

rasbt

↗ HN profile [ 1136 ms ] full profile
Karma
1,717
Created
June 6, 2014 (12y ago)
Submissions
0
AI researcher and statistics professor
  1. Show HN: New LLM Pre-Training and Post-Training Paradigms (sebastianraschka.com)
    2 points 0
  2. 1 points 0
  3. 1 points 0
  4. Developing an LLM: Building, Training, Finetuning (A 1h Video Explainer) (youtube.com)
    43 points 13
  5. Evaluating LLMs locally, on a laptop, with Llama 3 and Ollama (github.com)
    2 points 0
  6. Understanding the LLM Development Cycle: Building, Training, Finetuning (magazine.sebastianraschka.com)
    3 points 0
  7. The latest major open LLM releases: Mixtral, Llama 3, Phi-3, and OpenELM (magazine.sebastianraschka.com)
    5 points 1
  8. Finetuning an LLM-Based Spam Classifier with LoRA from Scratch (github.com)
    14 points 1
  9. Finetune a GPT Model for Spam Detection on Your Laptop in Just 5 Minutes (github.com)
    3 points 0
  10. Insights from Finetuning LLMs for Classification Tasks (github.com)
    2 points 0
  11. Tips for LLM Pretraining and Evaluating Reward Models (sebastianraschka.com)
    2 points 0
  12. Comparing 5 ways to implement Multihead Attention in PyTorch (github.com)
    3 points 0
  13. AI Research in Feb 2024 – LoRA Successor, "Small" LLMs, Transparent LLM Research (sebastianraschka.com)
    3 points 0
  14. Understanding, using, and finetuning Gemma (lightning.ai)
    118 points 51
  15. Implementing Weight-Decomposed Low-Rank Adaptation (DoRA) from Scratch (magazine.sebastianraschka.com)
    96 points 10
  16. AI Research Papers in Jan 2024: Model Merging, Mixtures of Experts, Smaller LLMs (magazine.sebastianraschka.com)
    20 points 0
  17. Implementing a ChatGPT-like LLM from scratch, step by step (github.com)
    739 points 105
  18. LoRA from scratch: implementation for LLM finetuning (lightning.ai)
    339 points 86
  19. Coding Self-Attention, Multi-Head Attention, Cross-Attention, Causal-Attention (magazine.sebastianraschka.com)
    142 points 13
  20. Noteworthy AI Research Papers of 2023 (magazine.sebastianraschka.com)
    3 points 0
  21. AI Research Papers in November 2023: hallucinations and reasoning capabilities (magazine.sebastianraschka.com)
    5 points 0
  22. Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation) (magazine.sebastianraschka.com)
    342 points 28
  23. AI Research Papers (October 2023) (magazine.sebastianraschka.com)
    5 points 0
  24. AI and Open Source in 2023: A Review of the Year's Highs and Lows (magazine.sebastianraschka.com)
    2 points 0
  25. Takeaways from hundreds of LLM finetuning experiments with LoRA (lightning.ai)
    258 points 39