Skip to main content

Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
TagsGame Engines
(+1)

I had the exact same issue in my brief kobold testing with the class schedule. It kept refusing to generate unique class IDs for each class, that's why it kept failing for me. I think it's a model intelligence issue unfortunately, I was using a 24b model. 

And yes, koboldcpp is a little weird with context length, the "context size" you set when you open koboldcpp has to be enough to handle both input and output tokens, so the "max_tokens/length" setting in venus must be set to less than that. Basically, context > max_tokens + input tokens. 

Oh, and I wouldn't worry about koboldcpp when it says something like Generating[1/12000] tokens or something, that's just reporting the max content length, usually it ends early before it gets there

(+1)

gotcxha. should i use a different provider to run my llms like llmstudio or something if kobold is the problem

(1 edit) (+1)

and i used a 24b model also and it did the same... wondering if its just kobold not wanting to shake hands lol also conmfy ui for some reason still is not running in my gpu vram, only my regular system memory. is there a way to make it go to gpu first to make the process speed faster?

(1 edit)

That is really weird. It should detect your GPU automatically. I would double check whether this is an issue with the game or with ComfyUI. You can manually run ComfyUI by going to data/services/comfyui/ and click run_nvidia_gpu_bat. It should open a GUI in your browser, drag in the following workflow:
https://github.com/venus-uni-dev/venus-uni-comfyui
And click run. You should be able to run it without having to download any of the models since it'll find the ones you downloaded through the game. The outputs should appear in data/services/comfyui/ComfyUI/output
If it's still not using your GPU there, I'd look up online about your GPU and ComfyUI and see if anyone else is having similar issues

(+1)

i noticed it does run on my graphics card but doesn't show normally. i had to research it alot but im good! i just thought it would be faster to generate stuff lol.

Great! Happy generating