gdebasis / BengaliStemmer

A very simple-to-use rule based stemmer for Bengali (Bangla). The program takes as input a new line separated list of words and outputs in each new line the stem for every input word.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This is a very simple light-weight rule based stemmer for Bengali. To build on a Linux system, type make. You can then invoke the stemmer (the executable name is rbs) by ./stem_bn

The input file is a new line separated list of Bengali words and the output is also a new line separated file, the first word being the original word and the consecutive word being its stemmed form.

No corpus preprocessing is required to run this stemmer. I have provided a sample input file. Just type in ./rbs sample.txt sample.stem to see the output.

NOTE: You can provide an optional third argument for the aggressiveness of the stemmer. By default, the aggressive mode is turned off. To turn it on, please append a "1" at the end of the argument list.

About

A very simple-to-use rule based stemmer for Bengali (Bangla). The program takes as input a new line separated list of words and outputs in each new line the stem for every input word.


Languages

Language:C 91.9%Language:C++ 7.4%Language:Makefile 0.7%