What is the AI Classifier feedback tool?
What is the AI Classifier feedback tool?
During the AI Classifier build process, the feedback functionality allows reviewers to provide feedback on Classifier results, to assist the builder of the Classifier by providing their domain expertise directly from the PatentSight+ platform.
It allows reviewers of Classifier results to mark patent families as relevant or irrelevant directly in PatentSight, which is then provided as feedback to the Classifier builders.
It allows IP Professionals (reviewers) to collaborate with the domain experts (builders) and use their expertise to feedback and improve the precision of the technology classification.
Handy Hint: Please note that this feedback does not directly influence the build of the Classifier in the first instance. It is provided in an email to the builders of the Classifiers during the Classifier evaluation phase. The relevant or irrelevant feedback is also not saved within the platform itself, so should not be used in place of the 'tagging' feature within the PatentSight platform, for example..
Where can I find it?
The Classifier feedback tool can be found in the Patent Family card view of the Result List:
Reviewers in PatentSight who have the Classifier Feedback feature, can:
- Mark patent families as 'IRRELEVANT' to the Classifier (for example if a patent family is currently included, but should sit outside of the tech scope of the Classifier)
- Mark patent families as 'RELEVANT' to a Classifier (for example, patent family 'A' should be included in the build of the Classifier, and it isn't currently)
How the Classifier feedback function is enabled
The feature is controlled by the Customer Success team. If you'd like to know more, or would like to use this feature, please reach out to your customer success manager, who will be happy to help you, or send us a note at support@lexisnexisip.com.
How to use the Classifier feedback function - Reviewer
You would like to provide feedback to the builder on a Classifier. There are two main use cases for the Classifier feedback function:
Mark patent families as 'Not Relevant' to the Classifier
An example for this use case, is that a patent family is currently included in the results of a classifier, but you want to feedback to the builder that it should not be included as it sits outside of the technology scope of the Classifier. To mark the patent family as 'IRRELEVANT':
- First, run your report applying the classifier (more information on these steps can be found here).
- Then from the 'Analysis Templates' section, click 'Result List' to access the list of patent families currently determined as 'RELEVANT' to the Classifier (during the build process, we refer to these patent families as a positive match to the Classifier).
- In the Results List, select the patent family from the list that you want to mark as 'IRRELEVANT' to the Classifier:
- In the Patent Family card, select 'IRRELEVANT' in the 'Classifiers' section. You can also add a comment if required, that the builder can also review. You'll notice that the Classifier you want to feedback on is already available for feedback, because you've generated a report applying that Classifier.
- Click 'Submit Feedback'. The builder will receive this feedback in an email.
Handy Hint: If there is a Classifier in your account for which you believe this patent family IS relevant, you can easily add the Classifier here to provide positive feedback:
- Select the 'plus +' icon next to 'Classifiers'. Select the Classifier that you want to mark the patent family as 'RELEVANT' for.
- Make your selection, add relevant comments for the builder and select to 'Submit Feedback'.
Mark patent families as 'Relevant' to the Classifier
An example of this use case, is that you have a patent family in your search results which you'd like to feedback to the builder as relevant to a Classifier. To mark the patent family as 'RELEVANT':
- Access the 'Analysis Templates' section of your Workbook, and click 'Result List' to access the list of patent families you want to feedback on.
- In the results list, select the patent family that you want to provide feedback for. Scroll down the patent family card to the 'Classifier' feedback section:
- If the required Classifier for feedback is not shown in the list, select the plus icon next to 'Classifiers' to add it in:
- Select 'Relevant' next to the Classifier, add a comment for the builder if required and select 'Submit Feedback':
How to use the Classifier feedback function - Builder
When the feedback is sent, the users who are classifier owners will receive an email. This email will contain all feedback entries for the respective classifier for the last day.
If the user owns multiple classifiers, there will be a separate email per classifier.
The emails are sent from alerts@patentsight.com.
The respective feedback (Relevant/Irrelevant) is shown with a cross or a tick in the feedback column of the email, and the comment is also displayed if one has been made by the reviewer.
The builder can also access the Classifier directly from this email in order to action any of the feedback received.
Please reach out to your customer success manager, who will be happy to help you, or send us a note at support@lexisnexisip.com if you'd like to learn more.