Important Dates (draft)

NTCIR-Lifelog is a core task of the NTCIR-16 conference. This core task aims to advance the state-of-the-art research in lifelogging as an application of information retrieval. The methodology employed for the lifelog task at NTCIR-16 is based on the successfully deployed methodology from NTCIR-12-14.

For this year, we will focus on the most popular task from the previous lifelog tasks. The Lifelog Semantic Access Task (LSAT) is a known-item search task that can be undertaken in an interactive or automatic manner.
In this sub task, the participants have to retrieve a number of specific moments in a lifelogger's life. We define moments as semantic events, or activities that happened throughout the day. The task can best be compared to a known-item search task.

Example search tasks include:

  • Find the moment(s) where I was boarding an A380 on my way to China

  • Find the moment(s) where I am playing with my phone during a dinner date.

  • Find the moment(s) where I am preparing breakfast before heading to the airport to return home.

The LSAT sub task can be undertaken by participants in either an automatic manner or an interactive manner. Automatic runs assume that there was no user involvement in the search process beyond specifying the query. Interactive runs assume that there is a user involved in the search process that generates a query and selects which moments are considered correct for each topic. It is important that the correct task submission type is identified by participants when submitting runs. There will be 24 topics prepared for the task, which will be available from the NTCIR server.


----

Related Links:





Recommended Reading:
  • The following are a list of publications related to the NTCIR-Lifelog Benchmarking Activity
  • [1] Experiments in Lifelog Organisation and Retrieval at NTCIR. Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, Rami Albatal, Graham Healy, Duc-Tien Dang Nguyen. Evaluating Information Retrieval and Access Tasks. 2020. Springer.
  • [2] Overview of the NTCIR-14 lifelog-3 task. Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, V-T Ninh, T-K Le, Rami Albatal, D-T Dang-Nguyen, Graham Healy. In: Proceedings of the 14th NTCIR conference. 14th NTCIR conference (NTCIR-14), 10-13 Jun 2019, Tokyo, Japan. NII , pp. 14-26.
  • [3] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018). Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Andreas Leibetseder, Liting Zhou, Aaron Duane, Duc-Tien Dang-Nguyen, Michael Riegler, Luca Piras, Minh-Triet Tran, Jakub Loko─Ź, Wolfgang Hürst. ITE Transactions on Media Technology and Applications. 7.2 (2019)
Citation:
  • When referring to the NTCIR16-Lifelo4 task, please cite the following publication which will contain details of the collection and the task description, which will be published in June 2022. Please note that these details are likely to be updated closer to the actual publication date.
@Inproceedings{NTCIR16-Lifelog4-Overview
  • author = {Cathal Gurrin and Frank Hopfgartner and Duc-Tien Dang-Nguyen and Hideo Joho and Thanh Binh Nguyen and Liting Zhou and Graham Healy},
  • title = {{Overview of the 4th Lifelog Task at NTCIR-16: Information Retrieval for Lifelogs}},
  • journal = {Proceedings of the 16th NTCIR Conference on Evaluation of Information Access Technologies},
  • year = {2020},
  • }