mariah@feddit.rocks to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · edit-25 months agoIs there a good ai thats run fast on a amd rx 7600?message-squaremessage-square9fedilinkarrow-up111arrow-down12file-text
arrow-up19arrow-down1message-squareIs there a good ai thats run fast on a amd rx 7600?mariah@feddit.rocks to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · edit-25 months agomessage-square9fedilinkfile-text
Ive been playing koboldai horde but the queue annoys me. I want a nsfw ai for playing on tavernai chat
minus-squarerufus@discuss.tchncs.delinkfedilinkEnglisharrow-up2·edit-25 months agohttps://github.com/YellowRoseCx/koboldcpp-rocm That will be optimized for AMD and as far as I know has the same / a very similar user interface. (The 8GB of VRAM on your graphics card will be some limitation. So maybe stick with smaller and quantized models.) And share your success stories on !ChatbotsNSFW@lemmynsfw.com
https://github.com/YellowRoseCx/koboldcpp-rocm
That will be optimized for AMD and as far as I know has the same / a very similar user interface.
(The 8GB of VRAM on your graphics card will be some limitation. So maybe stick with smaller and quantized models.)
And share your success stories on !ChatbotsNSFW@lemmynsfw.com