Run Qwen2.5-14B Locally – An OpenAI API Alternative for Chatbots and Embeddings (secondstate.io) 1 points by 3Sophons 1y ago ↗ HN
[–] 3Sophons 1y ago ↗ Tutorial to run the Qwen2.5-14B-Instruct model locally on your device using LlamaEdge and WasmEdge – no complex toolchains required!It supports edge devices, offers long context lengths (up to 128K tokens), and can be a drop-in replacement for OpenAI APIs.
1 comment
[ 3.6 ms ] story [ 22.4 ms ] threadIt supports edge devices, offers long context lengths (up to 128K tokens), and can be a drop-in replacement for OpenAI APIs.