I noticed ai likes to assume ur a boy and ignore if ur not. When i played NovelAI it let me ban words so i would add every boy pronoun. Is it there a FOSS selfhosted way? I currently use koboldai with tavernai
I noticed ai likes to assume ur a boy and ignore if ur not. When i played NovelAI it let me ban words so i would add every boy pronoun. Is it there a FOSS selfhosted way? I currently use koboldai with tavernai
11 Comments
pavnilschanda@lemmy.world · 5 pts · 2y
SillyTavern is a fork of TavernAI that lets you do more things. Perhaps look into that? Also you can just adjust the system prompt to have the LLM assume that you're not a boy.
mariah@feddit.rocks · 1 pts · 2y
I tried SillyTavern but the ui looked terrible. Do i put "i am a girl" in the prompt? How will it know im talking about me not the character
pavnilschanda@lemmy.world · 4 pts · 2y
If you use the persona system, you can put " is a girl", otherwise "Refer to me as a girl throughout the conversation" would be fine
mariah@feddit.rocks · 4 pts · 2y
It worked. Thanks. Another question, how do i stop the random person who says get a room and similar?
pavnilschanda@lemmy.world · 1 pts · 2y
What kind of LLM are you using? Depending on its effectiveness, you can put "this is a chat between you and me" (or whatever you and AI identify as) in the system prompt.
mariah@feddit.rocks · 3 pts · 2y
I am using DavidAU/Psyonic-Cetacean-Ultra-Quality-20b in koboldai horde. I plan to selfhost tho when i get my 3090 installed
pavnilschanda@lemmy.world · 1 pts · 2y
OK, I gave it a look and it said that it's good at following instructions, so the aforementioned advice would still apply
mariah@feddit.rocks · 1 pts · 2y
I actually found the ai koboldcpp/crestfall-mythomax-L2-13b-q5_k_m works perfectly
keepthepace@slrpnk.net · 4 pts · 2y
It would probably be more effective to put an explicit mention in the system prompt. "Your interlocutor is a and will be greatly offended to be refered to as a boy or a man."
projectmoon@lemm.ee · 2 pts · 2y
KoboldCPP has ban tokens that prevent those tokens from being output. Otherwise just put it in the prompt and it should probably work.