Important Dates (draft)
NTCIR16-Lifelog4 reuses an existing dataset, the LSC'21 dataset, which is a multimodal dataset that is four months in size, from one active lifelogger. The dataset consists of three files, each of which is password protected and details of how to access these datasets can be sourced from ntcir-lifelog@computing.dcu.ie with the competed agreement forms as descried below. The dataset comprises of:
  • Core Image Dataset (38GB) of wearable camera images, fully redacted and anonymised in 1024 x 768 resolution, captured using OMG Autographer and Narrative Clip devices. These images were collected during periods in 2015, 2016 and 2018. All faces and readable text have been removed, as well as certain scenes and activities manually filtered out to respect local privacy requirements.
  • Metadata for the collection (2.8MB), consisting of textual metadata representing time, physical activities, biometrics, locations, etc… Please note that there are no HR biometrics for the 2015 data.
  • Visual Concepts (79.9MB) extracted from the non-redacted version of the visual dataset. Please note that there are four images in the visual concepts that are not in the Core Image Dataset. This is not a mistake; those four images are no longer in the LSC collection.

The Visual Concepts data file includes detected scenes and concepts for each image (processed over the non-redacted version of the images). The format of the descriptor for each image is as follows: - attribute_top{i} : the attribute of the scene detected automatically from the image. - category_top{i} : the category of the scene detected automatically from the image. - category_top{i}_score : the confidence score of the scene prediction output. - concept_class{i} : the objects detected automatically from the image. We use the object category list of 2014-2017 COCO datasets with 80 labels - concept_score_top{i}: the confidence score of the object detection output. - concept_bbox_top{i}: the bounding box of the detected object in the format of {top_x top_y bottom_x bottom_y}.



Participants are required to sign two forms to access the datasets, an organisational agreement form for your organisation (signed by the research team leader) and an individual agreement form for each member of the research team that will access the data. The organisation agreement form should be sent to the task organisers (ntcir-lifelog@computing.dcu.ie) in PDF format. The individual agreement form must be signed by all researchers who will use the data and kept by the organisation on file. It should not be sent to the organisers, unless requested at a later date. It is of utmost importance that task participants abide by the rules of using the dataset as described in the agreemhttp://ntcir-lifelog.computing.dcu.ie/resources/NTCIR-14-Lifelog-Organisation-Agreement-Form.pdfents.
  1. Organisation Agreement form: to be signed by the organisation to which the participants belong.
  2. Individual Agreement form: to be signed by each individual researcher wishing to use the LSC data collection. This form must be filed by the participating organisation, but it does not need to be sent to the organisers.

Upon completion of this process, the participants will be sent details about how to access the dataset. Please note that the zip file is also password protected.

A suitable reference for the dataset in LSC and subsequent papers is as follows:

@inproceedings{LSC20,
address = {Dublin, Ireland},
author = {Gurrin, Cathal and Le, Tu-Khiem and Ninh, Van-Tu and Dang-Nguyen, Duc-Tien and Jónsson, Björn \THór and Loko─Ź, Jakub and Hurst, Wolfgang and Tran, Minh-Triet and Schoeffmann, Klaus},
booktitle = {ICMR '20, The 2020 International Conference on Multimedia Retrieval},
publisher = {ACM},
title = {{An Introduction to the Third Annual Lifelog Search Challenge, LSC'20}},
year = {2020}
}



The lifelog dataset will be released. 
NTCIR-Lifelog's participants are required to sign two forms to access the datasets, an organisational agreement form for your organisation (signed by the research team leader) and an individual agreement form for each member of the research team that will access the data. The organisation agreement form should be sent to the lifelog task organisers (ntcir-lifelog@computing.dcu.ie) in PDF format. The individual agreement form must be signed by all researchers who will use the data and kept by the organisation on file. It should not be sent to the organisers, unless requested at a later date.
  1. Organisation Agreement form: to be signed by the organisation to which the participants belong. This form must be signed and sent by email to NTCIR-Lifelog organisers (ntcir-lifelog@computing.dcu.ie).
  2. Individual Agreement form: to be signed by each individual researcher wishing to use the NTCIR-Lifelog data collection. This form must be filed by the participating organisation, but it does not need to be sent to the lifelog organisers.

Upon completion of this process, the participants will be sent a unique username and password to access the dataset. Please see the section below.