Tutorial Session
π Retrieve, π§ Rerank, π¬ Answer, βοΈ Experiment
Hands-On IR Research with PyTerrier
Outline
01. Platform
- Introduction
- Data Model & Transformers
- Operators
- Evaluation & Experiments
- Platform extras
02. Retrieval Menagerie
- Lexical & Learned Sparse Retrieval
- Dense Retrieval & Multi-Vec Retrieval
- PRF & Re-Ranking
03. Generation Menagerie
- LLM Backends & Vanilla RAG
- Generation Evaluation
- Retrieval-as-a-tool
04. Conclusion
- Patterns & Anti-Patterns
- Wrap-up
Tutorial History
Previous Tutorials
This SIGIR edition builds on earlier PyTerrier tutorials while shifting the emphasis toward PyTerrier 1.0, modern retrieval workflows, RAG pipelines, and hands-on experimentation.
ECIR 2021
IR From Bag-of-words to BERT and Beyond through Practical Experiments.
CIKM 2021
A virtual edition covering practical IR experiments with PyTerrier and neural ranking methods.
BCS IRSG Search Solutions
An in-person practical tutorial at the British Computer Society headquarters.
Code
GitHub Links
The PyTerrier ecosystem includes the core platform and plugins for dense retrieval, late interaction, RAG, reranking, and high-performance retrieval engines.
Reference
Documentation
Start from the official documentation for installation, data models, transformers, operators, experiments, extension packages, and troubleshooting.
PyTerrier Documentation
The documentation covers installation, importing datasets, Terrier indexing, running experiments, learning to rank, artifacts, pipeline operators, debugging, and extension packages.
People
Presenter Profiles
The tutorial is delivered by researchers with long-standing experience in information retrieval, PyTerrier, efficient retrieval systems, neural ranking, and RAG.
Craig Macdonald
University of Glasgow
Professor of Information Retrieval. His research focuses on efficient and effective search and recommendation, and he has extensive tutorial and teaching experience using PyTerrier.
Sean MacAvaney
University of Glasgow
Senior Lecturer whose research focuses on efficient neural models for search, learned sparse retrieval, reranking, and practical IR systems.
Nicola Tonellotto
University of Pisa
Associate Professor at the University of Pisa. His research focuses on efficient large-scale IR pipelines and data processing platforms.
Xiao Wang
University of International Business and Economics
Assistant Professor whose research focuses on efficient and effective neural information retrieval, including dense retrieval and neural pseudo-relevance feedback.
Citation
Retrieve, Rerank, Answer, Experiment: Hands-On IR Research with PyTerrier. Craig Macdonald, Sean MacAvaney, Nicola Tonellotto and Xiao Wang. In Proceedings of ACM SIGIR 2026.