Research on Some Key Technologies of Tibetan Automatic Word Segmentation

Yuan Sun,Xiaodong Yan,Xiaobing Zhao,Guosheng Yang
DOI: https://doi.org/10.1109/ICINIS.2011.43
2011-01-01
Abstract:This paper researches on some key technologies of Tibetan automatic word segmentation. We propose a Tibetan automatic word segmentation approach, which is taking the advantage of case-auxiliary words and continuous feature. Meanwhile, a resolution method of overlapping ambiguity in Tibetan word segmentation is proposed, which is based on forward-backward scanning identification method and improved maximum probability algorithm. Finally, an experiment is conducted, and the results prove the algorithm is effective.
What problem does this paper attempt to address?