Connect a client
Once Talemate is up and running and you are connected, you will see a notification in the corner instructing you to configured a client.
Talemate uses client(s) to connect to local or remote AI text generation APIs like koboldcpp, text-generation-webui or OpenAI.
Add a new client
On the right hand side click the ADD CLIENT button.
No button?
If there is no button, you may need to toggle the client options by clicking this button
The client configuration window will appear. Here you can choose the type of client you want to add.
Choose an API / Client Type
We have support for multiple local and remote APIs. You can choose to use one or more of them.
Local vs remote
A local API runs on your machine, while a remote API runs on a server somewhere else.
Select the API you want to use and click through to follow the instructions to configure a client for it:
Remote APIs
Local APIs
Unofficial OpenAI API implementations
- DeepInfra
- llamacpp with the
api_like_OAI.pywrapper
Assign the client to the agents
Whenever you add your first client, Talemate will automatically assign it to all agents. Once the client is configured and assigned, all agents should have a green dot next to them. (Or grey if the agent is currently disabled)
You can tell the client is assigned to the agent by checking the tag beneath the agent name, which will contain the client name if it is assigned.
Its not assigned!
If for some reason the client is not assigned to the agent, you can manually assign it to all agents by clicking the Assign to all agents button.
