NM_Ricky
- Karma
- 174
- Created
- April 19, 2022 (4y ago)
- Submissions
- 0
- Show HN: Running LLMs on CPUs (huggingface.co)
- 8x Acceleration for LLM Inference on CPUs (arxiv.org)
- Achieving 1,000X CPU Performance Boost with Sparse Models in MLPerf (neuralmagic.com)
- ChatGPT Cheat Sheet (drive.google.com)
-
Link: https://colab.research.google.com/drive/1I5ez6ZpdT0K-yo7l9AXrrJ7tIFoEP8Jv Hi all, Wanted to share a colab notebook for making a dense transformer sparse using the SparseML library. This notebook allows you to take…