I am sure to upset a lot of purists with this, but as a hobby “sysadmin” of my own linux server at home, an AI built into the shell would do wonders to me.
I found bash-ai, but that seems to me like little more than a wrapper for ChatGPT queries.
In an ideal scenario, I’d like to employ a pre-trained, locally run AI that has access to all files, including config files and the list of installed packages, so it can, for example, tell me what specific lines in config files do or if a package I have already installed is good for a task I want to do or what the merge conflict between configs during an upgrade is about.
Is there such a built-in AI?
Not sure if it will handle queries on bash commands. But, this video covers setting up and running a local large language model (LLM). IIRC, he specifically sets up DeepSeek, but it looks like you have a couple options. However, one caveat is that these LLMs run much faster with with a good GPU backing them up. If you don’t have a reasonable gaming GPU, you may be waiting a bit for answers.