Andrew Bimba and Norisma Idris and Norazlina Khamis and Nurul Fazmidar Mohd Noor (2016) Stemming Hausa text: using affix-stripping rules and reference look-up. Language Resources and Evaluation, 50 (3). pp. 687-703.
|
Text
Stemming Hausa text.pdf Download (94kB) | Preview |
|
|
Text
Stemming Hausa text using affix-stripping rules.pdf Download (499kB) | Preview |
Abstract
Stemming is a process of reducing a derivational or inflectional word to its root or stem by stripping all its affixes. It is been used in applications such as information retrieval, machine translation, and text summarization, as their pre-processing step to increase efficiency. Currently, there are a few stemming algorithms which have been developed for languages such as English, Arabic, Turkish, Malay and Amharic. Unfortunately, no algorithm has been used to stem text in Hausa, a Chadic language spoken in West Africa. To address this need, we propose stemming Hausa text using affix-stripping rules and reference lookup. We stemmed Hausa text, using 78 affix stripping rules applied in 4 steps and a reference look-up consisting of 1500 Hausa root words. The over-stemming index, under-stemming index, stemmer weight, word stemmed factor, correctly stemmed words factor and average words conflation factor were calculated to determine the effect of reference look-up on the strength and accuracy of the stemmer. It was observed that reference look-up aided in reducing both over-stemming and under-stemming errors, increased accuracy and has a tendency to reduce the strength of an affix stripping stemmer. The rationality behind the approach used is discussed and directions for future research are identified.
| Item Type: | Article |
|---|---|
| Keyword: | Stemming algorithm , Hausa language , Root word , Over-stemming , Under-stemming , Stemmer accuracy |
| Subjects: | T Technology > TA Engineering (General). Civil engineering (General) |
| Department: | FACULTY > Faculty of Engineering |
| Depositing User: | NORAINI LABUK - |
| Date Deposited: | 03 Jul 2018 12:04 |
| Last Modified: | 17 Dec 2020 15:29 |
| URI: | https://eprints.ums.edu.my/id/eprint/20375 |
Actions (login required)
 |
View Item |