A recognized token is a short piece of text that a translation
memory (TM) treats as a single word. A recognized token is always
contained within a segment. For example, if dates are enabled as
a recognized token in a TM, the TM recognizes Monday 1 January, 1900
as one word.
For most recognized tokens, the TM automatically produces the translation,
and in such cases, it can also automatically localize the translation.
Tokens that can be recognized in WorldServer are:
- Dates
- Times
- Numbers (in numerals)
- Measurements
- Acronyms and URLs (translation target is the same as the source)
Note: Inline tags (extensions of WorldServer placeholders) are
not counted as words.
Note: The automatic localization rules are specified in the tm.properties file.