Nightly can be configured by advanced testers to use custom prompts and any compatible chatbot, such as llamafile, which runs on-device open models, including open-source ones. We are excited for the community to share interesting prompts, chatbots, and models as we make this a better user experience. We are also looking at how we can provide an easy-to-set-up option for a private, fully local chatbot as an alternative to using third-party providers.

I think they could’ve waited until they properly tried implementing a local llm. Anyway glad to know that we have options and gonna try this.

I used to be on pure Arch for 2.5 years, but currently uses cachyOS. And its so much removes the pain points of arch, as well as giving super fast performance.

True. I’m glad that the multiple lemmy releases during past months didn’t make the app unusable.

If you are interested learning more, there was a veritasium video about analog chips where he quite well explained the working of and the usecases .