Inference Configuration
Work in progress
Letting users manipulate the inference parameters for text generation is currently a work in progress and expect changes to this system in the future.
If you wish to alter the inference parameters sent with the generation requests for text-generation you can do in the settings interface.
Navigate to the Presets tab then select the preset you wish to edit.
Warning
Not all clients support all parameters, and generally it is assumed that the client implementation handles the parameters in a sane way, especially if values are passed for all of them. All presets are used and will be selected depending on the action the agent is performing. If you don't know what these mean, it is recommended to leave them as they are.
All presets are used
Its important to understand that all presets are used, depending on which action is performed by an agent.
Work in progress
This is currently transitioning to a better system. Main goal was to expose the parameters to the user, and make it somewhat understandable.
We've tried to categorize them in a sensible way, but there is probably still work that needs to be done in this area. A lot of them can probably be merged into a single category.
Categories
Analytical
Used when the agent is performing some kind of analysis, that requires accurate and truthful information.
Conversation
Used for generating actor responses in a conversation.
Creative
Used for content generation (Generating characters, details etc.) and narration.
Creative instruction
Similar to Creative but will be used when the agent is expected to follow the instruction very closely. This is one of the areas that needs more work and can probably be merged with one of the other categories.
Deterministic
Used when the agent is expected to follow the instruction very closely and we want to ensure that the output is deterministic.
Scene Direction
Used mostly for the director when directing the scene flow. Need to be creative but also follow the instruction closely.
Summarization
Used for summarizing the scene progress into narrative text.