3 comments

[ 0.23 ms ] story [ 23.1 ms ] thread
(comment deleted)
As someone who does a lot of work with non-profits who typically can't afford having a technical person on site/staff I'm really curious what type of self-service IT support services can come from self hosted LLMs.

I'd love to be able to feed all my documentation about a network layout into one and be able to get answers about it.

What's the most approachable hardware that'll run the 65B?

A Mac with 96G of memory will still set you back $6000.