LM LLM
Local AI user on a popular Linux OS
Local AI user on a popular Linux OS
I have bundled a Linux OS, Linux Mint, with two self contained AI modules, LM Studio and AnythingLLM to create an offline local, teachable, and personal AI. This allows you to run a local AI from models that you can download and teach in a variety of conversations. I call it LMLLM, Linux Mint Language Learning Machine, and this is version 1.
With the Linux Mint installation media, I used the OEM installation mode, created a user and then added the AI modules to the local user account.. I then downloaded/setup/configured three different LLMs in LM Studio for that user, had it run as a service and attached them to three sample conversations that are within the AnythingLLM application interface. The LLM models were acquired through the LM Studio applications LLM library browsing feature which you can browse the hugging face community and all of it's resources.
These LLMs were trained on Natural Farming, Astronomy, and Story Telling from other independent authors/creators/trainers. Once invoked in conversation, they will automatically start the required LLM "brain" in LM Studio as the server service is waiting for a query. You may need to reconfigure the LLMs working parameters within the LM Studio application to fit your individual computer and use the resources it has, for best performance.
OFFICIAL LM Studio recommended requirements
OFFICIAL Linux Mint recommended requirements
You'll need a processor that has a minimum of AVX2 instruction set and at least 16GB RAM, it might be slow. If you have a GPU to use then it will be much better. Let's just say I have this running on a QEMU virtual machine, hosted on a i5-6500 with 23 GB of RAM, yeah weird right. All this still works while running XMRig, but more on that later.
All credit goes to the creators and maintainers of the above mentioned software, I just put them together in an easy package to use. I will be posting some tutorials, but your best advice would come from the creators these fine projects directly.
Nov 2024 - Welcome to version 1
ISO Available on request. (40GB)