Overview

Talemate uses client(s) to connect to local or remote AI text generation APIs like koboldcpp, text-generation-webui or OpenAI.

The various agents will use these connections to generate content.

Why multiple clients?

Talemate supports and encourages use of multiple clients. We believe it makes sense to give certain tasks to certain models. Some models may be more suited for for management tasks, while others may be better at creative tasks.

It is, however, perfectly fine to just use a single client for all tasks if you prefer.

Client setup instructions

Officially supported APIs

Remote APIs

• OpenAI
• Anthropic
• mistral.ai
• Cohere
• Groq
• Google Gemini

Local APIs

• KoboldCpp
• Text-Generation-WebUI
• LMStudio

APIs functional via OpenAI compatible client

Note

These APIs do not have a talemate client, but the OpenAI compatible client can be used to connect to them.

• DeepInfra
• llamacpp with the api_like_OAI.py wrapper