This paper received the Best Short Paper Award at ECIR 2021.
Publications home
A white box analysis of ColBERT
at
| Thibault Formal, Benjamin Piwowarski, Stéphane Clinchant |
| European Conference on Information Retrieval (ECIR), Lucca, Italy (online event), 28 March-3 April, 2021 |
| Download |
| arXiv |
Abstract
Transformer-based models are nowadays state-of-the-art in adhoc Information Retrieval, but their behavior is far from being understood. Recent work has claimed that BERT does not satisfy the classical IR axioms. However, we propose to dissect the matching process of ColBERT, through the analysis of term importance and exact/soft matching patterns. Even if the traditional axioms are not formally verified, our analysis reveals that ColBERT (i) is able to capture a notion of term importance; (ii) relies on exact matches for important terms.
Related Content
This web site uses cookies for the site search, to display videos and for aggregate site analytics.
Learn more about these cookies in our privacy notice.
Cookie settings
You may choose which kind of cookies you allow when visiting this website. Click on "Save cookie settings" to apply your choice.
This content is currently blocked. To view the content please either 'Accept social media cookies' or 'Accept all cookies'.
For more information on cookies see our privacy notice.