This python module is an easy-to-use port of the text normalization used in the paper "Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali-English machine translation". It is intended to be used for normalizing / cleaning Bengali and English text.
text-processing text-normalization text-preprocessing bangla-text-normalization bengali-text-normalization
-
Updated
May 7, 2024 - Python