RankNet | slightly modified ) Keras implementation | Machine Learning library
kandi X-RAY | RankNet Summary
kandi X-RAY | RankNet Summary
My (slightly modified) Keras implementation of RankNet (as described here) and PyTorch implementation of LambdaRank (as described here). See here for a tutorial demonstating how to to train a model that can be used with Solr.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Compute the relevance coefficient .
RankNet Key Features
RankNet Examples and Code Snippets
Community Discussions
Trending Discussions on RankNet
QUESTION
I am setting up a product that utilizes Azure Search, and one of the requirements is that the results of a search conduct multi-stage learning-to-rank where the final stage involves a pairwise query-dependent machine-learned model such as RankNet.
Is there any existing support in Azure Search for this? If not, where in the Azure Search pipeline would you recommend I start?
What I have tried:I had been hoping to find something similar to the ElasticSearch LTR Plugin but have not been able to.
The only option I can currently think of is to set-up a server which forwards the query from the front-end to Azure Search, re-ranks the search results my pairwise LTR methods, reconstructs the re-ranked search results, and sends those to the front-end.
However, I am very apprehensive about the inefficiency of this option and it would be unnecessary if there is an existing way for me to do this.
Language / LibrariesIf relevant: I am coding primarily in C# and would be using CNTK for machine-learning.
...ANSWER
Answered 2019-Mar-23 at 20:00At this time, your suggestion is the way to go. Azure Search does not currently offer a way to inject a custom ranker within the search pipeline. You would need to config your query to return a large amount of results and then re-rank yourself. Sorry we do not have a better answer than this right now. If you have time, it would be great if you could cast your vote for this here as we are hearing this more often lately.
QUESTION
I am currently using the RankLib implementation of the RankNet algorithm (-ranker 4) with a held-out set. I am using the jar file in terminal to run this.
The documentation stipulates:
metric2t (e.g. NDCG, ERR, etc) only applies to list-wise algorithms (AdaRank, Coordinate Ascent and LambdaMART). Point-wise and pair-wise techniques (MART, RankNet, RankBoost), due to their nature, always use their internal RMSE / pair-wise loss as the optimisation criteria.
However, when I set the 'metrics2t' to ERR@10 or NDCG@10, it starts to train and validate on my chosen metric rather that 'RMSE'.
This is part of the table outputted when I run RankNet with ERR@10.
Is there something that I am missing as this seems to be a contradiction to me.
Thanks.
...ANSWER
Answered 2018-Mar-28 at 03:17I am not sure, but, I think even if it prints the result for those metrics, it is not optimizing for them.
The library's developers simply left it there, as for other methods it is common to use one of those metrics for validation. And there is no option to simply turn of the computing off the metrics during training.
Right now I am training a RankNet model, and it seems that ERR@10 for training and validation data is actually increasing, while the "% mis-ordered pairs" is decreasing.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install RankNet
You can use RankNet like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page