Optimizing Base Rankers Using Clicks: A Case Study using BM25

Anne Schuth and Floor Sietsma and Shimon Whiteson and Maarten de Rijke. In Proceedings of ECIR'14, 2014.

Abstract

We study the problem of optimizing an individual base ranker using clicks. Surprisingly, while there has been considerable attention for using clicks to optimize linear combinations of base rankers, the problem of optimizing an individual base ranker using clicks has been ignored. The problem is different from the problem of optimizing linear combinations of base rankers as the scoring function of a base ranker may be highly non-linear. For the sake of concreteness, we focus on the optimization of a specific base ranker, viz. BM25. We start by showing that significant improvements in performance can be obtained when optimizing the parameters of BM25 for individual datasets. We also show that it is possible to optimize these parameters from clicks, i.e., without the use of manually annotated data, reaching or even beating manually tuned parameters.

Links

Optimizing Base Rankers Using Clicks: A Case Study using BM25
https://doi.org/10.1007/978-3-319-06028-6_7

Bib

@inproceedings{schuth2014,
  title = {Optimizing Base Rankers Using Clicks: A Case Study using BM25},
  author = {Anne Schuth and Floor Sietsma and Shimon Whiteson and Maarten de Rijke},
  year = {2014},
  booktitle = {Proceedings of ECIR'14},
  doi = {10.1007/978-3-319-06028-6_7}
}