Class WordToken

A Token which represents a non-specific word.

Inheritance

object

Token

WordToken

Implements

ICloneable<Token>

Inherited Members

Token.Clone()

Token.ToString()

Token.Text

Token.Span

object.GetType()

object.MemberwiseClone()

object.Equals(object)

object.Equals(object, object)

object.ReferenceEquals(object, object)

object.GetHashCode()

Namespace: Sdl.Core.Bcm.BcmModel.Tokenization.Tokens

Assembly: Sdl.Core.Bcm.BcmModel.dll

Syntax

[DataContract]
public class WordToken : Token, ICloneable<Token>

Constructors

WordToken()

Initializes a new instance with default values

Declaration

public WordToken()

WordToken(string)

Initializes a new instance with the specified token text

Declaration

public WordToken(string text)

Parameters

Type	Name	Description
string	text

Properties

IsStopword

Gets or sets whether this token is a stop word.

Declaration

[DataMember(Name = "isStopWord")]
[JsonProperty(NullValueHandling = NullValueHandling.Ignore)]
public bool IsStopword { get; set; }

Property Value

Type	Description
bool

Stem

An optional stem to assign to this token. Stems are used for TM search and scoring.

Declaration

[DataMember(Name = "stem")]
[JsonProperty(NullValueHandling = NullValueHandling.Ignore)]
public string Stem { get; set; }

Property Value

Type	Description
string

Type

Gets the type of Token.

Declaration

[DataMember(Name = "type")]
protected override string Type { get; }

Property Value

Type	Description
string	The type.

Overrides

Token.Type

Implements

ICloneable<T>