How to Inspect and Correct AI-Generated Answers

Introduction

This article details the process of inspecting the quality of an AI-generated answer and providing corrections. The Inspect feature helps you understand why an answer was generated and allows you to discard incorrect information, which helps improve the agent's future performance.

Steps

1. From the list of threads on the Analytics page, click on a query to expand it and view the Generated answer.
2. If you find an answer to be incorrect or insufficient, click the Inspect button located below the answer.
3. The Answer Information panel will appear on the right side of the screen. Here, you can review details such as Confidence, Relevance, and the Justification for the answer provided.
4. To correct the answer, click the Discard button at the top of the panel.
5. Select a Reason for the discard from the dropdown menu (e.g., "Wrong article surfaced").
6. In the Preferred answer text box, you can write the correct information or provide guidance for what the answer should have been.
7. Click the Submit button to save your feedback and help train the agent.

Summary

Regularly inspecting and correcting answers is a crucial step in maintaining the accuracy and reliability of your AI agent. This process not only fixes incorrect responses in the moment but also provides valuable training data to improve the system over time, ensuring better answers for future user queries.