activelearning | Active Learning for text classification | Machine Learning library

So, as the docs on active learning state, implicit feedback occurs when

when a user question has multiple answers with scores that are very close,

whereas with explicit feedback is the feedback that is received when the

client application asks the user which question is the correct question [and the user's selected question is used as explicit feedback

The feedback is collected from the conversation between user and bot. As of now, feedback is not collected in the Test panel in the qnamaker.ai portal.

When "enough" feedback is collected on a cluster of question and answer pair, you will see the active learning feedback inside the portal at qnamaker.ai > Edit

I'll include here one of my posts from a thread regarding Active Learning below. I would encourage you to read the full thread on active learning that was opened as a Microsoft Docs issue afterwards, however, to see included screenshots.

@Souvik04, follow the link to the Active Learning sample bot in the BotFramework-Samples repo for a example of how you can query the QnA service from your bot with active learning enabled. ___ After conversing with the QnA team (Rohit is included in the conversation), here's a little more light regarding when you would actually see the suggestions inside the portal at qnamaker.ai.

When there is a low confidence score difference between the top answers, we collect weighted implicit and explicit feedback to cluster suggestions for any QnA ID. => When enough feedback is collected for any given suggestion, it will show in the KB.

More specifically, we cluster similar user queries to generate suggestions. When minimum required feedback is collected, only then will the suggestions show in the KB.

The QnA team wants to avoid publicly divulging the exact logic of what exactly is the "minimum required feedback" and how often suggestions are generated (besides, the team is working on improving and optimizing the logic behind active learning as well) --however to see suggestions appear in the qnamaker.ai portal: * not only ensure that you've given the bot enough feedback * but also give the back end "some time" to allow for the suggestions to appear in the portal.

Again, feedback is collected when your user types in a query that returns answers from QnA that have confidence scores that are close together.

It is also good to note that feedback is not collected in the Test panel in the qnamaker.ai portal as of now. You will need to chat with your bot via emulator or a channel to provide feedback to your bot that it can use for active learning.