I’ve a self hosted (docker) tiledesk instance. While adding the knowledge base it keeps processing.
The docker logs looks like this:
Looking into the files, there’s no KB_ENDPOINT nor OPENAI_ENDPOINT configured. I’ve looked into the env sample it’s not set up.
How to configure these two endpoints such that I could add the knowledge base?
1 Like
Hi @sreeraj ,
I’m running into the same issue. Have you found the solution?
ethan
October 9, 2024, 3:01am
3
The KB endpoints refer to the tiledesk-LLM project you can see it on Github here
FYI. This project is heavy and you’ll need a server with at least 4GB ram and 40GB storage.
Hi
@vi1world
As I could not find a resolution within Tiledesk, created a custom RAG based REST endpoint (KB embeddings were stored in a local vector DB) with gpt3.5-turbo (LLM). Connected this REST API into Tiledesk workflow and the chatbot is deployed.
@ethan Thanks for the reply.
Could you share the settings that make it possible for the server to communicate with the RAG LLM endpoint?
Much appreciated!