Nice project! Would be nice to have an option without a Rapsberry Pi 5 though - I think a decent fraction of your audience already has one and maybe doesn’t want to pay for another
If you're using litert-lm on a Mac with Apple Silicon - DO NOT forget to use "--backend gpu"! On my M1 Pro laptop this single setting resulted in 10x prefill performance and 2x decode performance. To anyone who knows…
Are any of these illegal in the US or Canada?
Great project! If I may ask - how do you guys compare with React Flow? BTW - licensing looks fair, hope the effort that has been put into this project pays off!
Nice project! Would be nice to have an option without a Rapsberry Pi 5 though - I think a decent fraction of your audience already has one and maybe doesn’t want to pay for another
If you're using litert-lm on a Mac with Apple Silicon - DO NOT forget to use "--backend gpu"! On my M1 Pro laptop this single setting resulted in 10x prefill performance and 2x decode performance. To anyone who knows…
Are any of these illegal in the US or Canada?
Great project! If I may ask - how do you guys compare with React Flow? BTW - licensing looks fair, hope the effort that has been put into this project pays off!