Since local LLMs are more a comon thing now, is it possible for you to consider adding them in you existing addon? They also allow web requests so should be pretty straight forward.
LM Studio is free and super easy to install containing all the top free models from meta and the fine tunings like Nvidia ones.
Thanks!
LM Studio integration for AI addon
Re: LM Studio integration for AI addon
Hi,
Ollama is on the to-do list. I'll look into LM Studio.
Ollama is on the to-do list. I'll look into LM Studio.