This hasn’t been asked in a while, and I really loved reading the last discussion so I’m hoping to kick it off again and see what has changed!
What I’d like to know is:
- What specific products do you wish you could host on your own infrastructure, but the product does not offer such a deployment method
- Do you or would you use the product without being able to self-host? I.E. In its current state
- Do you think your employer, if any, holds the same opinions?
Want to selfhost AI assistent with that can work with my desktop OS.
Hwve you lokked at mycroft?
I’ve heard good things about https://github.com/ggerganov/llama.cpp
Check Out r/LocalLLaMA for that.
Would https://fabien.benetou.fr/Content/SelfHostingArtificialIntelligence help?