Moderate responses
Moderating responses enables tools to get smarter and more accurate over time. Here’s how.
One of the most important features of Josef Q is what we call human-in-the-loop training.
This involves creators reviewing a record of the questions users have asked and how the tool has responded.
If a creator notices that a particular generated answer was incorrect, or can be improved in some way, they can jump in and edit it for next time.
How to moderate
Creators can moderate tool responses by either:
- Going directly to the tool's Responses tab, or by
- First, viewing the tool, asking it a question, then clicking Moderate to open the Moderate response popup window.
Via Responses tab
To moderate your tool's responses via the Responses tab:
- Log in to Josef Q and select the relevant tool via the Dashboard.
- Select Responses in the left-hand sidebar. A list of questions (and previously generated answers) will be available for you to review.
- To moderate (i.e. edit) the answer to a specific question, click on the three vertical dots to the right of the answer.
- Next, click from the dropdown menu, click Moderate.
- Once clicked, the Moderate response window will pop up.
- Jump to "Moderating responses" to learn more.
Via tool user interface
To moderate your Q&A's responses by first accessing the tool's user interface:
- First, view and interact with your tool,
- Ask a question,
- Then, click Moderate at the bottom of the tool’s response.
- Next, the Moderate response window will pop up. Keep reading to learn more.
Moderating responses
There are a few things creators can do to moderate responses here. They include:
- Moderating answers (i.e. editing the text that comprises an answer),
- Determining whether or not the tool should respond with ‘no answer,’ and
- Selecting what source material forms the basis of the tool's answer.
Here's how to do all three.
1. Moderate answer
In the blue Answer field, creators can moderate (i.e. edit the text of) the answer generated in response to a particular question.
2. Respond with ‘no answer’
Creators can also toggle off/on the Use ‘no answer’ text instead for cases where they’d rather the tool responded something like, “I’m sorry, I don’t have an answer.’
3. Highlight all relevant sources
On the right, creators can also review an answers’ relevant sources. These are extracted from the tool's uploaded document (aka its knowledge base).
To select and deselect a relevant source, highlight the text and click the highlighter button.
4. Approve
Once you have finished moderating the response, click Approve and you’re done!
Next time a user asks this question, the tool’s response will be in line with the moderation completed on this page.
Post-knowledge base update
Once creators have updated their knowledge base with a new document, they’ll need to review and approve their tool’s past moderated answers.
This ensures your tool’s new content interacts with past moderated answers as you’d like it to.
To learn how, visit this page and read the section “Updating your tool."