Skip to main content

Installing Witty

Witty is installed in the customer environment and interacts with Witboost and several components (database, LLMs, embedders). Before going through the prerequisites, make sure to read the requirements.

Witty is composed of three microservices:

  • Witty, a supervisor that independently chooses the best AI agents it needs to achieve those goals;
  • Docs Agent, the default specialized agent with in-depth knowledge of Witboost documentation;
  • Autocomplete Agent, a microservice that provides intelligent, context-aware autocomplete suggestions for form fields based on table data.

Witty microservice​

In order to install Witty microservice, your secret store need to have the following variables filled.

LLMENGINE_SERVICE_TOKEN=<llm_token>
EMBEDDERENGINE_SERVICE_TOKEN=<embedder_token>

Additionally, you need to enable and configure the witty module in the Witboost configuration file (values.yaml).

...
witty:
  enabled: true
  configOverride:
    llm:
      endpoint: <llm_endpoint>
      deployment_name: <llm_deployment_name>
      api_version: <llm_api_version>
      model: <llm_model>
      provider: <llm_provider>
    embedder:
      endpoint: <embedder_endpoint>
      deployment_name: <embedder_deployment_name>
      api_version: <embedder_api_version>
      model: <embedder_model>
      provider: <embedder_provider>
    logger:
      level: <DEBUG | INFO | WARNING |  ERROR>
...

Docs agent microservice​

In order to install the Docs Agent microservice, your secret store need to have the following variables filled.

DOCUMENTATION_AGENT_DBNAME=<db_name>
EMBEDDERENGINE_SERVICE_TOKEN=<embedder_token>

Additionally, you need to enable and configure the docs-agent module in the Witboost configuration file (values.yaml).

...
docs-agent:
  enabled: true
  configOverride:
    embedder:
      endpoint: <embedder_endpoint>
      deployment_name: <embedder_deployment_name>
      api_version: <embedder_api_version>
      model: <embedder_model>
      provider: <embedder_provider>
    logger:
      level: <DEBUG | INFO | WARNING |  ERROR>
...

At startup, docs agent will calculate the embeddings of the Witboost documentation. It will take 5-10 minutes. Once done, the server will start.

Autocomplete agent microservice​

In order to install the Autocomplete Agent, you need to enable the autocomplete-agent module in the Witboost configuration file (values.yaml).

...
autocomplete-agent:
  enabled: true
...

The Autocomplete Agent provides intelligent suggestions for form fields based on table data. No precomputation is required at startup; the service is ready to use immediately after deployment.