I been up at this time to time, mostly doing custom characters (Changing one character slightly), but lately wanted to run local instead of OpenRouter and run into problem of finding information to run custom model if that is even possible. I was trying to run Llama, but only could use the default GPU options, I think I am missing some crucial points or I am just dumb.
Hukkeli
5
Posts
1
Following
A member registered Dec 10, 2022
Recent community posts
THE PERFECT PAIR shall rise! comments · Replied to amanohokosaka in THE PERFECT PAIR shall rise! comments
I've been trying to use openroute, but even with credits and API Key I seem to always get provider does not comply with openrouter API standards, no matter the model or provider. Might just be an issue at my end.
Fixed it by choosing server and then going into to the settings and choosing the models there, had to also go take the models out of the blacklist to make this work, since most of them were there.