Class WordToken

A Token which represents a non-specific word.

Inheritance
System.Object
Token
WordToken
Implements
Inherited Members
Namespace: Sdl.Core.Bcm.BcmModel.Tokenization.Tokens
Assembly: Sdl.Core.Bcm.BcmModel.dll
Syntax
public class WordToken : Token, ICloneable<Token>

Constructors

WordToken()

Initializes a new instance with default values

Declaration
public WordToken()

WordToken(String)

Initializes a new instance with the specified token text

Declaration
public WordToken(string text)
Parameters
Type Name Description
System.String text

Properties

IsStopword

Gets or sets whether this token is a stop word.

Declaration
public bool IsStopword { get; set; }
Property Value
Type Description
System.Boolean

Stem

An optional stem to assign to this token. Stems are used for TM search and scoring.

Declaration
public string Stem { get; set; }
Property Value
Type Description
System.String

Type

Gets the type of Token.

Declaration
protected override string Type { get; }
Property Value
Type Description
System.String

The type.
Overrides

Implements