logo

Local LLM for Private Companies

Posted by ahendest |3 hours ago |2 comments

julia-kafarska 3 hours ago[1 more]

I run Qwen 35B on my local machine daily but also over 200B params with flash-moe occasionally. In today's world, with all the open models spending a lot of money make sense if your needs a bigger then couple of people.