Skip to main content

Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
TagsGame Engines

Hey shehhe, networking is definitely not my strong suit, but I believe people have gotten llama.cpp to work before. When the test connection button is disabled, what is the message at the bottom right, above save changes? 

Two things that could be going wrong are: 1. you may not be using the chat completions endpoint or 2. you haven't selected a model ID. The llama.cpp endpoint should end in /v1/chat/completions. If you have the right endpoint, clicking on the model selection box should show some models.

Here's me using it by a public IP, which is working fine on another RP (i.e SillyTavern)


Huh. Thanks for reporting this, am looking into removing that error gate in the new version. For now, can you try removing the long string and just doing 8015/v1/chat/completions?