Test your bot

A knowledge base changes all the time, and an edit that stops the bot finding an answer is silent: nobody notices until a customer gets a worse answer. Test questions catch it the same day.

1. Add a question

Open Chat → Knowledge → Tests and press Add a question. Type it the way a customer would ask it, pick the bot, and say what should happen:

• The article that answers it. The test passes when that article is among the first five the bot reads for the question. This check is free.
• What the answer must say. The bot answers the question for real and the assistant compares its answer with yours. This costs two AI credits, and only runs again when what the bot reads for the question changes.

Use either, or both. Start with the five questions customers ask most.

2. Run them

Press Run tests, or wait: they run by themselves within a few minutes of any change to your articles, quick answers or bots. If a question that passed now fails, owners and admins are told.

3. Before you save an article

When you save an article, Solstral first checks your test questions against the new version. If the change would stop the bot finding the right article for any of them, it names them and asks before saving.

4. When the assistant isn't sure

Some answers are hard to judge. Those appear under Answers for a person to check, with what you expected beside what the bot said. Press It's right or It's wrong. Your decision stands until what the bot reads for that question changes.