From 7e8d101a4b7e0f88a718f15e47eca982dc195de6 Mon Sep 17 00:00:00 2001 From: David Iommi <38066083+davidiommi@users.noreply.github.com> Date: Wed, 19 Feb 2025 16:27:36 +0100 Subject: [PATCH] Update index.html --- index.html | 34 ++++++++++++++++++++-------------- 1 file changed, 20 insertions(+), 14 deletions(-) diff --git a/index.html b/index.html index 45faf77..ce99487 100644 --- a/index.html +++ b/index.html @@ -9,7 +9,7 @@ -
| 12:25 - 12:45 | -Team Galápagos Tortoise at LongEval 2024: Neural Re-Ranking and Rank Fusion for Temporal Stability + | Team Galápagos Tortoise at LongEval 2025: Neural Re-Ranking and Rank Fusion for Temporal Stability
Marlene Gründel, Malte Weber, Johannes Franke and Jan Heinrich Merker |
@@ -91,16 +90,23 @@
In this page we present CLEF 2024 shared task evaluating the temporal persistence of information retrieval (IR) systems and text classifiers. The task is motivated by recent research showing that the performance of these models drops as the test data becomes more distant in time from the training data. LongEval differs from traditional IR and classification shared task with special considerations on evaluating models that mitigate performance drop over time. We envisage that this task will bring more attention from the NLP community to the problem of temporal generalisability of models, what enables or prevents it, potential solutions and limitations.
-The CLEF 2024 LongEval Lab encourages participants to develop temporal information retrieval systems and longitudinal text classifiers that survive through dynamic temporal text changes, introducing time as a new dimension for ranking models performance.
+LongEval at CLEF 2025 is the third edition of the shared task focusing on the temporal persistence of information retrieval (IR) models. The goal is to evaluate how retrieval models perform as the test data evolves over time, emphasizing the challenge of maintaining retrieval quality despite changes in user queries and document relevance.
+ +This year, LongEval introduces two retrieval tasks:
+ +A continuation of the Web retrieval challenge, using evolving datasets from the French search engine Qwant. Participants develop IR models that maintain performance across different temporal lags.
+ +New in 2025, this task evaluates retrieval performance in scientific search using data from the CORE repository, the largest collection of Open Access scholarly documents. Systems are tested on queries and relevance feedback from real users.
Check our 2024 website and 2023 website to find information about previous years.
-For Task 1. LongEval-Retrieval: longeval-ir-task@univ-grenoble-alpes.fr
-For Task 2. LongEval-Classification: Rabab Alkhalifa
+For Task 1. LongEval-WebRetrieval: longeval-ir-task@univ-grenoble-alpes.fr
+For Task 2. LongEval-SciRetrieval: Rabab Alkhalifa
Join our slack channel for any question.