BioASQ Participants Area

BioASQ - Task BioNNE

The proposed BioNNE shared tasks involve NLP challenges on biomedical nested named entity recognition (NER) systems for English and Russian languages. The train/dev datasets include annotated mentions of disorders, anatomical structures, chemicals, diagnostic procedures, and biological functions. Participants are allowed to train any model architecture on any publicly available data in order to achieve the best performance.

Nested Named Entity Annotation Example

The evaluation framework is divided into three broad tracks:

Track 1 - Bilingual: Participants in this track are required to train a single multi-lingual NER model using training data for both Russian and English languages. The model should be used to generate prediction files for each language's dataset.

Track 2 - English-oriented: Participants in this track are required to train a nested NER model for English scientific abstracts in the biomedical domain.

Track 3 - Russian-oriented: Participants in this track are required to train a nested NER model for Russian scientific abstracts in the biomedical domain.

See the details in our GitHub.
To submit your results you need to register on the Codalab Competition page.

The training data for the BioNNE task are available here.

Timeline:
PhaseDates
Registration opens13 Nov 2023
Training Data Release5 Feb 2024
Test data release, evaluation phase starts25 April 2024
Test set predictions due6 May 2024
Submission of participant papers31 May 2024
Acceptance notification for participant papers24 June 2024
Camera-ready working notes papers8 July 2024
BioASQ Workshop at CLEF 2024, Grenoble, FranceSeptember 9-12, 2024

References:
Loukachevitch, N., Manandhar, S., Baral, E., Rozhkov, I., Braslavski, P., Ivanov, V., ... & Tutubalina, E. (2023). NEREL-BIO: a dataset of biomedical abstracts annotated with nested named entities.
Bioinformatics, 39(4), btad161. https://doi.org/10.1093/bioinformatics/btad161