I really like the approach with WASM and the browser sandbox. That alone makes this very usable. iam also working on an agent harnes in the browser sandbox called "hermit" using a local inference endpoint. It runs…
I was using it in an air gapped environment vs a local inference engine running a qwen-coder-next. Installtion of harnesses on the machine and other things were ruled out because of security constraints. There i used it…
right now i am experimenting on an agent in a browser as a single.html file running a virtual filesystem and using python in WASM to do the heavy lifting. its really useful and funny to watch how it works. it is quite…
Yeah, I found a bug during model load occurring with Firefox and low VRAM machines. It is fixed now, thanks! The 1060 is unusually slow. The Mac mini sounds about right. Have fun playing around and sharing. With the…
Thank you for testing. i just checked it works with Chrome. FireFox seems broken in the current Version i.e. i can reproduce the bug. Working on it. Which browser do you use?
I did a WebGPU-based HTML Single-File Chat Application even for larger models. It just depends on your machine. It is cool to show people what can be done on their machines without installing anything. It also works in…
This is very hard in Germany or not possible at all (beside maybe FAANG). I have a PhD in Machine Learning (including Papers at SIGKDD / ECML / ACL etc.) as well as relevant working experiences and it is just not…
I am in similar position. I recently turned 40 and I’m a Development Manager but the role is moving me away from all the technical stuff I really like. I work in a classical industry position so no interesting FAANG…
I really like the approach with WASM and the browser sandbox. That alone makes this very usable. iam also working on an agent harnes in the browser sandbox called "hermit" using a local inference endpoint. It runs…
I was using it in an air gapped environment vs a local inference engine running a qwen-coder-next. Installtion of harnesses on the machine and other things were ruled out because of security constraints. There i used it…
right now i am experimenting on an agent in a browser as a single.html file running a virtual filesystem and using python in WASM to do the heavy lifting. its really useful and funny to watch how it works. it is quite…
Yeah, I found a bug during model load occurring with Firefox and low VRAM machines. It is fixed now, thanks! The 1060 is unusually slow. The Mac mini sounds about right. Have fun playing around and sharing. With the…
Thank you for testing. i just checked it works with Chrome. FireFox seems broken in the current Version i.e. i can reproduce the bug. Working on it. Which browser do you use?
I did a WebGPU-based HTML Single-File Chat Application even for larger models. It just depends on your machine. It is cool to show people what can be done on their machines without installing anything. It also works in…
This is very hard in Germany or not possible at all (beside maybe FAANG). I have a PhD in Machine Learning (including Papers at SIGKDD / ECML / ACL etc.) as well as relevant working experiences and it is just not…
I am in similar position. I recently turned 40 and I’m a Development Manager but the role is moving me away from all the technical stuff I really like. I work in a classical industry position so no interesting FAANG…