Chat Settings & Prompt sytem
  • 19 Jul 2024
  • 3 Minutes to read
  • Contributors
  • Dark
    Light
  • PDF

Chat Settings & Prompt sytem

  • Dark
    Light
  • PDF

Article summary

What is a Prompt System?

A prompt system is a feature that allows users to interact with an application or system by providing specific instructions or queries. The system interprets these prompts and responds accordingly. This feature is designed to make the interaction more intuitive and efficient, enabling users to get the information or perform the tasks they need seamlessly.

FAQ: How to Use the Prompt System

The prompt system functionality revolves around four key elements:

  1. Model Prompt
  2. Chat Settings Prompt
  3. User Instructions
  4. User Information

The prompt system impacts both chat sessions and "chat with docs" sessions.

1. Model Prompt from Admin

Info

Each chat is associated with a default model, which itself is linked to a prompt. This ensures that each model has an optimized prompt, enhancing the platform's ability to interact with various models effectively. Different Large Language Models (LLMs) function differently and require optimized prompts for best performance

Super admins can access the model prompt by navigating to the admin section via the dedicated link available in the user profile.
Once in the admin section, go to the "Model" page and select the concerned model.
On the model page, you will find a field called "Start messages template".
This field allows one to define a list of messages that will be added at the start of the discussion with the model. It allows one to customize the interaction with the model and add specific context.

To do so, this field is interpreted as a Jinja template and allows for conditionnal operations as well as the use of variables.

The following variables can be used in the template, and will be replaced before the LLM call by their correct values:

  • {{ date }} the current date
  • {{ company_instructions }}: The instruction field in chat settings (see section 2)
  • {{ user_instructions }} : The User instructions field that can be modified in Settings in paradigm (see section 3)
  • {{ user_first_name }}: The user's first name as defined in profile
  • {{ user_last_name }}: The user's last name as defined in profile

Only those variables are available for use for now. The addition of other {{ var }} will lead to an error when setting the start_messages_template field

Capture d’écran 2024-06-17 à 17.08.59.png

By default, each model integrates the following elements as variables:

  1. The prompt indicated in the chat settings,
  2. User instructions,
  3. User information (name, first name).

2. Chat Settings

Info

Admins can modify the chat settings prompt, impacting all users associated with that chat.

Super admins or company admins should navigate to the admin section and go to the "Chat Settings" page.
Select the concerned chat setting and modify the "Instruction" field.

Capture d’écran 2024-06-17 à 10.41.33

The purpose of this field is to explain how the chat should behave with users and what its objectives are.

Example of an Instruction:
"You are an agent of LightOn, responsible for answering all questions posed by LightOn employees. These questions may relate to company processes, products, or any other inquiries an employee might have within the organization. Provide accurate, helpful, and detailed responses to ensure employees receive the information they need."

3. User Instructions

Info

In the chat page, users can specify their own instructions to customize their interaction with the chat.

In the chat page, click on the "Settings" link located in the left menu at the bottom.

Capture d’écran 2024-06-17 à 10.45.16.png

This opens a dedicated page presenting two things:

  • Company Instruction: This is not editable from this page and corresponds to the prompt indicated in the chat settings. If an admin wants to change this parameter, there is a link redirecting to the admin section.
  • User Instruction: This element is specific to each user, allowing them to communicate the specific behavior they want when interacting with the chat.

4. User Information

Your profile currently includes your name, first name, and company. These details impact the chat's behavior.


Was this article helpful?

What's Next