题意：
该项目的目标是实施一些信息检索方法，评估它们并在真实用例的背景下进行比较。设置评估基础结构，包括集合和索引、主题、qrel，实现公共信息检索基线，实现排序融合方法，评估、比较和分析基线和排序融合方法
解析：
在第一部分中，训练 2017 年和 2018 年主题的数据集，对于所有的方法，使用此用于调整检索模型的任何参数的数据，并对 2017 年和 2018 年主题的测试集进行测试（使用从训练集中选择的参数值）。报告每个方法在训练和测试集上，分别放入一个表中。对 2017 和 2018 年的测试结果进行逐个主题的收益 / 损失分析数据集，通过考虑作为基线 BM25，并作为比较每个 TF-IDF，Borda，CombSUM 和 CombMNZ。
涉及知识点：
信息检索，文件处理，数据分析
更多可加微信讨论
微信号：tiamo-0620
pdf
INFS7410 Project – Part 1 – v3
Note: these instructions have been modified on 28/08/2019
Preamble
The due date for this assignment is 29 August 2019 17:00 5 September 2019 17:00, Eastern
Australia Standard Time (extended from 29/08) 19 September 2019 17:00 Eastern Australia
Standard Time, together with part 2.
This project is worth 5% of the overall mark for INFS7410. A detailed marking sheet for this
assignment is provided at the end of this document.
We recommend that you make an early start on this assignment, and proceed by steps. There are
a number of activities you make already tackle, including setting up the pipeline, manipulating
the queries, implement some retrieval functions and perform evaluation and analysis. There are
some activities you do not know yet how to perform, in particular the implementation of the rank
fusion algorithms: this will be the topic of the week 5 lecture and tutorials.
Aim
Project aim: The aim of this project is to implement a number of information retrieval methods,
evaluate them and compare them in the context of a real use-case.
Project Part 1 aim
The aim of part 1 is to:
setup the evaluation infrastructure, including collection and index, topics, qrels
implement common information retrieval baselines
implement ranking fusion methods
evaluate, compare and analyse baseline and ranking fusion methods
The Information Retrieval Task: Ranking of studies for
Systematic Reviews
In this project we will consider the problem of ranking research studies identified as part of a
systematic review. Systematic reviews are a widely used method to provide an overview of the
current scientific consensus, by bringing togeth