Presented at: The Sixth International Language Resources and Evaluation Conference (LREC2008)
by Jack Halpern
Webpage: http://www.lrec-conf.org/proceedings/lrec2008/pdf/109_paper.pdfThe orthographical complexities of Chinese, Japanese, Korean (CJK) and Arabic pose a special challenge to developers of NLP applications. These difficulties are exacerbated by the lack of a standardized orthography in these languages, especially the highly irregular Japanese orthography and the ambiguities of the Arabic script. This paper focuses on CJK and Arabic orthographic variation and provides a brief analysis of the linguistic issues. The basic premise is that statistical methods by themselves are inadequate, and that linguistic knowledge supported by large-scale lexical databases should play a central role in achieving high accuracy in disambiguating and normalizing orthographic variants.
Keywords: Lexicon, lexical database, Machine Translation, SpeechToSpeech Translation, Morphology, Linguistics
Resource URI on the dog food server: http://data.semanticweb.org/conference/lrec/2008/papers/109
Explore this resource elsewhere: