Task 10: Low-level NLP Tools for Bhojpuri Language

Task Description

The task is to develop low-level NLP tools for Bhojpuri which is Eastern Indo-Aryan languages spoken largely in the Eastern states of Bihar, Jharkhand and Uttar Pradesh in India. This language is part of what is considered a dialect continuum running the Eastern part of India to its Weatern part and consisting of approximately 50 languages / varieties. Hindi, the official language of India, is part of the same continuum and as such these are closely related to each other. However, despite this similarity, this languages has large divergences in terms of lexicon as well as morphological make-up. As such most of the tools developed for Hindi do not perform very well with the other languages. For this task, we are providing small annotated datasets for Bhojpuri in order to develop part-of-speech tagger and morphological analyser for this language. The dataset is annotated with the part of speech categories and morphological features from Universal Dependencies tag set.

Sub tasks

The task has 2 sub-tasks –
9.A POS tagger for each language
9.B Number, Gender, Person, Tense, Aspect, Honorificity and Case relation analyzer

Data

We will provide 5,000 annotated sentences (in CONLL-U format) for each of the 2 languages. In addition to this, participants are also encouraged to use the Hindi data set available with Universal Dependencies project. Additionally they are free to use any other data set as long as the data set is freely available for research

Evaluation Procedure

The standard evaluation metrics for evaluating and ranking the teams will be macro-averaged F1 scores.

Baseline

The simple probabilistic baseline (the most frequent tags get assigned to each token) will be provided by the organizers.

Important Dates

Training data set will be made available by 30. April, 2019. Other deadlines are as per the workshop schedule.

Results

Results will be made available as per the workshop schedule

Registration link:

https://docs.google.com/forms/d/1UHzelcIpitpD4njv3hTIkwRiOAye5Fzkz_aCeJiYmBU/viewform?ts=5c7b6f7c&edit_requested=true

Paper submission

Paper submission instructions will be same as for the workshop

Task Organizers

If you have any queries regarding this task, please refer to the task organizers:

Ritesh Kumar <ritesh78_llh@jnu.ac.in>
Atul Kumar Ojha <shashwatup9k@gmail.com>