Vietnamese language and computers

The Vietnamese language is written with a complex Latin alphabet that requires various accommodations in computing. Historically, Vietnamese was written in a much more complex logographic script, chữ Nôm, which does not yet enjoy full computer support.

Fonts and character encodings

Vietnamese alphabet

It is common for two diacritics to be placed on a single Vietnamese vowel. Some fonts stack these diacritics, while others offset the tone mark to improve readability.

There are as many as 46 character encodings for representing the Vietnamese alphabet.[1] Unicode has become the most popular, due to its superior compatibility and software support. Diacritics may be encoded either as combining characters or as precomposed characters, which are scattered among the Latin Extended-A, Latin Extended-B, and Latin Extended Additional blocks. The Vietnamese dong symbol is encoded in the Currency Symbols block. The Middle Vietnamese letter B with flourish (ꞗ) is included in the Latin Extended-D block. The apex is not included in Unicode, but U+1DC4 COMBINING MACRON-ACUTE may serve as a rough approximation.

Early versions of Unicode assigned the characters U+0340 ̀ COMBINING GRAVE TONE MARK and U+0341 ́ COMBINING ACUTE TONE MARK for the purpose of placing these marks beside a circumflex, as is common in Vietnamese typography. These two characters have been deprecated; U+0301 ́ COMBINING ACUTE ACCENT and U+0300 ̀ COMBINING GRAVE ACCENT are now used regardless of any present circumflex.[2]

For systems that lack support for Unicode, dozens of 8-bit Vietnamese code pages are available.[1] The most common are VISCII, VSCII (TCVN 5712:1993), VPS, and Windows-1258.[3] Where ASCII is required, such as when ensuring readability in plain text e-mail, Vietnamese letters are often encoded according to Vietnamese Quoted-Readable (VIQR) or VSCII Mnemonic (VSCII-MNEM),[4] though usage of either variable-width scheme has declined dramatically following the adoption of Unicode on the World Wide Web.

Many Vietnamese fonts intended for desktop publishing are encoded in VNI or TCVN3.[3] Such fonts are known as "ABC fonts".[5] Popular Web browsers lack support for specialty Vietnamese encodings, so any webpage that uses these fonts appears as unintelligible mojibake on systems without them installed.

Vietnamese frequently stacks diacritics, so typeface designers must take care to prevent stacked diacritics from colliding with adjacent letters or lines. In advertising signage and in cursive handwriting, diacritics often take forms unfamiliar to other Latin alphabets. For example, the lowercase letter I retains its tittle in ì, , ĩ, and í.[6] These nuances are rarely accounted for in computing environments.

Chữ Nôm

𬖾
The nôm character for phở is 𬖾.[7]

Unicode includes over 10,000 nôm characters as part of Unicode's repertoire of CJK Unified Ideographs. Of these characters, 10,082 can be found in the CJK Unified Ideographs Extension B block, while the rest are distributed between the CJK Unified Ideographs, CJK Unified Ideographs Extension A, and CJK Unified Ideographs Extension C blocks. A further 1,028 characters, including over 400 characters specific to the Tày language, are encoded in the CJK Unified Ideographs Extension E block. The characters are taken from the Vietnamese standards TCVN 5773:1993 and TCVN 6909:2001, as well as from research by the Han-Nom Research Institute and other groups.[8]

The two most comprehensive nôm fonts are the Vietnamese Nôm Preservation Foundation's Nôm Na Tống Light[9] and the community-developed HAN NOM A/HAN NOM B,[10] both of which place a large number of unstandardized characters in the Private Use Areas.

The Unicode Consortium's Unihan database includes Vietnamese readings of some characters but does not distinguish between Sino-Vietnamese and nôm readings.

Like other CJKV writing systems, chữ Nôm is traditionally written vertically, from top to bottom and right to left.

Text input

A purely physical Vietnamese keyboard would be impractical, due to the sheer number of letter-diacritic-diacritic combinations in the alphabet. Instead, Vietnamese input relies on software-based keyboard layouts, virtual keyboards, or input methods (also known as IMEs).

Keyboard layouts

Microsoft Windows includes a Vietnamese keyboard layout based on TCVN 6064:1995.

Vietnamese keyboard layouts rely on dead keys to compose letters with diacritics. Most desktop operating systems include a Vietnamese keyboard layout similar to TCVN 6064:1995, a Vietnamese national standard.

Input methods

xvnkb, an IME compatible with the X Input Method framework on Unix systems, supports output in six character encodings.

The three common Vietnamese input methods are Telex, VNI, and VIQR. Telex indicates diacritics using letters that are unlikely to appear at the end of a word, while VNI repurposes the number keys or function keys and VIQR repurposes various punctuation marks. The Telex and VIQR conventions originated in an earlier era of telex machines and typewriters, respectively.

Support for these input methods is provided by input method editors (IMEs), which are known in Vietnamese as bộ gõ, literally "pecker". IMEs may be provided by the operating system, installed as a third-party application, installed as a browser extension, or provided by an individual website in the form of a script. Common third-party applications include GoTiengViet, UniKey, VietKey, VPSKeys, WinVNKey, and xvnkb. On Unix-like operating systems, the IBus and SCIM frameworks both support Vietnamese. IMEs scripts such as AVIM, Mudim, and VietTyping can be found on most Vietnamese message boards, the Vietnamese Wikipedia, and other text-intensive websites. The Vietnamese Web browser Cốc Cốc comes with an input method built-in.

Input methods allow words to be composed in a more flexible order than keyboard layouts allow. For example, to enter the word "viết" using the TCVN 6064:1995 keyboard layout, one must type VI38T, in that order. By contrast, most IMEs permit the user to insert diacritics at the end of the word: VIEETS in Telex, VIET61 in VNI, or VIET^' in VIQR. Some IMEs even allow diacritics to be entered before their base letters. Depending on an IME's implementation, it may also be possible to edit an existing word's diacritics without retyping the word.

Borrowing a feature common among Chinese input methods, some Vietnamese IMEs allow one to skip diacritics altogether. Instead, after typing the base letters, the user selects the accented word from a candidate list. In order to provide this autocomplete list, the IME may need to communicate with a Web service. Some IMEs also use candidate lists to allow the user to convert text from the Vietnamese alphabet to chữ Nôm, because there is no one-to-one correspondence between alphabetic words and nôm characters.

Other considerations

Typical Vietnamese text contains a high proportion of compound words. Compound words are never hyphenated in contemporary usage, so spell checkers are limited to checking individual syllables unless a statistical language model is consulted.

Vietnamese has rigid spelling rules and few exceptions, so text-to-speech engines may avoid dictionary lookups except when encountering a foreign loan word. TTS engines must account for tones, which are essential to the meaning of any Vietnamese word.

References

  1. 1 2 Ngô Đình Học; Trần Tư Bình (July 21, 2014). "Express Manual for WinVNKey". WinVNKey. Retrieved October 5, 2014.
  2. "Combining Diacritical Marks". Unicode 7.0 Character Code Charts. Unicode Consortium. June 16, 2014. Retrieved October 5, 2014.
  3. 1 2 "Chọn Font chữ, bảng mã để gõ tiếng Việt". Bộ gõ tiếng Việt.Com (in Vietnamese). MangVN. 2009. Archived from the original on November 20, 2010.
  4. Lunde, Ken (2009). CJKV Information Processing (2nd ed.). O'Reilly Media. pp. 47–49. ISBN 978-0-596-51447-1 via Google Books.
  5. Hoàng Tô; Nguyễn Quan Sơn; Nguyễn Sơn Tùng; Phan Quang Minh; Phạm Thúc Trương Lương; Nguyễn Quang Hiệp; Bùi Văn Kiên; Nguyễn Ích Vinh (20 July 2014). Sử ký Tinh Vân: 20 năm sẻ chia và sáng tạo [History of Tinhvan: 20 years of sharing and creating] (in Vietnamese). 1. Tinhvan Group. p. 37 via Google Books.
  6. See, for example: "Viết Thư". Vietnamese reading selections (in Vietnamese) (2 ed.). Army Language School. 1956. pp. 98–100.
  7. Trần Văn Kiệm (2004). "phở". Giúp đọc Nôm và Hán Việt (in Vietnamese) (4th ed.).
  8. Nguyễn Quang Hồng. "Giới thiệu Kho chữ Hán Nôm mã hoá" [Hán Nôm Coded Character Repertoire Introduction] (in Vietnamese). Vietnamese Nôm Preservation Foundation.
  9. "Nôm Font". Vietnamese Nôm Preservation Foundation. Retrieved October 5, 2014.
  10. Đỗ Quốc Bảo; Tô Minh Tâm; Thiền Viện Viên Chiếu (December 8, 2005). "UNICODE Han Nom Font Set". Retrieved October 5, 2014.

See also

This article is issued from Wikipedia - version of the 10/7/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.