Looking for AI solution which can interfere with my OS.
by andrkac from LinuxQuestions.org on (#6NFSQ)
I want to work with AI chatbot in my network. So looking for some advices to find solution meeting my requirements:
completely local - I want it working in my LAN even if I cut internet access
possible to install on linux server, with CLI or/and webgui interface
with access to my OS/network, if possible - constraint to specific non-root user.
my main approach is to send/receive some MQTT messages, which is a base of my homemade smarthome (ok, I've just started, got two devices :)), so MQTT support only may be enough, without full OS access (using MQTT and own custom scripts I can do anything in OS if necessary, so I can extend it.).
multilanguage. Ekhm... Polish lang will be enough
possible integration with piper/whisper - I have both of them working already
I've checked few solutions. Found and run some, for example - oogabooga project runs on my server, but I can't see an idea to use it with MQTT. I see there some STT (whisper, not sure how to run it in this project) and TTS extensions, unfortunately TTS ones look not so promising as piper does in my language.
The best I want to find is a kind of software which can use existing, already trained, language model (llama or sth) with possibility to communicate with OS added.
Is there something magical, which is perfect for me?
completely local - I want it working in my LAN even if I cut internet access
possible to install on linux server, with CLI or/and webgui interface
with access to my OS/network, if possible - constraint to specific non-root user.
my main approach is to send/receive some MQTT messages, which is a base of my homemade smarthome (ok, I've just started, got two devices :)), so MQTT support only may be enough, without full OS access (using MQTT and own custom scripts I can do anything in OS if necessary, so I can extend it.).
multilanguage. Ekhm... Polish lang will be enough
possible integration with piper/whisper - I have both of them working already
I've checked few solutions. Found and run some, for example - oogabooga project runs on my server, but I can't see an idea to use it with MQTT. I see there some STT (whisper, not sure how to run it in this project) and TTS extensions, unfortunately TTS ones look not so promising as piper does in my language.
The best I want to find is a kind of software which can use existing, already trained, language model (llama or sth) with possibility to communicate with OS added.
Is there something magical, which is perfect for me?