Also some of the 70B models are good but usually there are no people who run these models and the answers are slow.Ībout sending and recieving pictures from the chatbot, with SillyTavern you can do both. I also can run it native and it's one of the best models for NSFW chat. the model is called Yi-34B-Chat-GGUF if someone is interested to try to run it on their PC, there also different modifications from users on huggingface of this model, but sadly these are even more heavy and I can't run them at all.įrom experience I should say "Xwin-MLewd-13B-v0.2" is a good model and always has a lot of horde workers supporting it. But sadly I can't use it properly to confirm it in a longer conversation. There is a model with 200 000 token limit, but nobody on AI Horde runs that model, the model is very good but sadly it breaks my PC after sometime, because it needs more than 32GBs of memory, I unload some on my GPU, but even then it overflows, because the longer the conversation the more memory and more time it needs to answer, the model is probably on the level or close to ChatGPT. Of course their short term memory will get deleted after about 2000 or 3000 tokens (depending on the character description). SillyTavern also has very good character description and the characters would not forget their initial description. Also sometimes it seems the models are token restricted more than their native restriction, because when I run the model on my PC is gives longer conversations, but other times the models from AI Horde work OK. But if you don't choose a model it would choose at random a model from AI Horde and then you will get inconsistent results, because every time the answer will be from a different model. From my experience SillyTavern is the best.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |