Translation disambiguation for cross-language information retrieval using context-based translation probability

Kazuaki Kishida,Emi Ishita
DOI: https://doi.org/10.1177/0165551509103599
2009-05-19
Journal of Information Science
Abstract:Disambiguation between multiple translation choices is very important in dictionary-based cross-language information retrieval. In prior work, disambiguation techniques have used term co-occurrence statistics from the collection being searched. Experimentally these techniques have worked well but are based upon heuristic assumptions. In this paper, a theoretically grounded alternative is proposed, one which uses sense disambiguation based upon context terms within the source text. Specifically this paper introduces the concept of translation probabilities incorporating a context term and extends the IBM Model 1 for estimating context-based translation probabilities from a sentence-aligned bilingual corpus. Experimental results in English to Italian bilingual searches show significant performance improvement of the context-based translation probabilities over the case without any disambiguation.
computer science, information systems,information science & library science
What problem does this paper attempt to address?