News Lightweight AI Chatbot Runs Locally on Phones or Old PCs, No Cloud Required

[Admin]

A brand new open-source project called MLC LLM is lightweight enough to run locally on just about any device, even an iPhone or an old PC laptop with integrated graphics.

Lightweight AI Chatbot Runs Locally on Phones or Old PCs, No Cloud Required : Read more

 

[ralfthedog]

That would possibly be cool for building an LLM swarm. Fine tune a number of models to perform specific tasks, then let the core intelligence ask it's little friends. I wonder if this model works with Langchain.