Class TokenizationContext

Holds additional metadata for tokenization for a given culture, such as any custom formats for Number, Date etc.

Inheritance
object
TokenizationContext
Inherited Members
Namespace: Sdl.LanguagePlatform.Core.Tokenization
Assembly: Sdl.LanguagePlatform.Core.dll
Syntax
public class TokenizationContext

Constructors

TokenizationContext(CultureCode, Dictionary<DateTimePatternType, List<string>>, List<SeparatorCombination>, Dictionary<string, CustomUnitDefinition>, List<CurrencyFormat>)

Declaration
public TokenizationContext(CultureCode culture, Dictionary<DateTimePatternType, List<string>> dateTimeFormats, List<SeparatorCombination> separatorCombinations, Dictionary<string, CustomUnitDefinition> unitDefinitions, List<CurrencyFormat> currencyFormats)
Parameters
Type Name Description
CultureCode culture
Dictionary<DateTimePatternType, List<string>> dateTimeFormats
List<SeparatorCombination> separatorCombinations
Dictionary<string, CustomUnitDefinition> unitDefinitions
List<CurrencyFormat> currencyFormats

Properties

Culture

Declaration
public CultureCode Culture { get; }
Property Value
Type Description
CultureCode

CurrencyFormats

Declaration
public List<CurrencyFormat> CurrencyFormats { get; }
Property Value
Type Description
List<CurrencyFormat>

DateTimeFormats

Declaration
public Dictionary<DateTimePatternType, List<string>> DateTimeFormats { get; }
Property Value
Type Description
Dictionary<DateTimePatternType, List<string>>

SeparatorCombinations

Declaration
public List<SeparatorCombination> SeparatorCombinations { get; }
Property Value
Type Description
List<SeparatorCombination>

UnitDefinitions

Declaration
public Dictionary<string, CustomUnitDefinition> UnitDefinitions { get; }
Property Value
Type Description
Dictionary<string, CustomUnitDefinition>