Namespace Sdl.Core.Bcm.BcmModel.Tokenization.Tokens

Classes

AbbreviationToken

A Token used for abreviations.

AcronymToken

A Token representing acronyms.

AlphanumericToken

A Token representing alphanumeric tokens.

CharSequenceToken

A Token representing sequence of characters.

DateTimeToken

A Token represent date/time tokens.

GeneralPunctuationToken

A Token representing general punctuation tokens.

GenericPlaceableToken

Represents a generic placeable token which is not one of the predefined placeable token classes. Generic placeable tokens can never be auto-localized, but may be auto-substitutable.

IPAdressToken

Used for IP address tokens.

MeasureToken

A Token representing a measurement.

NumberToken

A Token representing a numerical value.

TagToken

A Token representing a tag element.

Token

Abstract class for different token implementations.

URIToken

An URI token that is placeable but is not substitutable.

VariableToken

A Token representing a substitutable variable.

WhiteSpaceToken

A Token representing a a non-empty sequence of whitespace characters.

WordToken

A Token which represents a non-specific word.