Namespace Sdl.Core.Bcm.BcmModel.Tokenization.Tokens
Classes
AbbreviationToken
A Token used for abreviations.
AcronymToken
A Token representing acronyms.
AlphanumericToken
A Token representing alphanumeric tokens.
CharSequenceToken
A Token representing sequence of characters.
DateTimeToken
A Token represent date/time tokens.
GeneralPunctuationToken
A Token representing general punctuation tokens.
GenericPlaceableToken
Represents a generic placeable token which is not one of the predefined placeable token classes. Generic placeable tokens can never be auto-localized, but may be auto-substitutable.
IPAdressToken
Used for IP address tokens.
MeasureToken
A Token representing a measurement.
NumberToken
A Token representing a numerical value.
TagToken
A Token representing a tag element.
Token
Abstract class for different token implementations.
URIToken
An URI token that is placeable but is not substitutable.
VariableToken
A Token representing a substitutable variable.
WhiteSpaceToken
A Token representing a a non-empty sequence of whitespace characters.
WordToken
A Token which represents a non-specific word.