Click or drag to resize
Accord.NET (logo)

ToolsTokenize Method (String)

Splits the given text into individual atomic words, irrespective of punctuation and other marks.

Namespace:  Accord.MachineLearning
Assemblies:   Accord.MachineLearning (in Accord.MachineLearning.dll) Version: 3.8.0
  Accord.Text (in Accord.Text.dll) Version: 3.8.0
public static string[] Tokenize(
	this string x
Request Example View Source


Type: SystemString

Return Value

Type: String

Usage Note

In Visual Basic and C#, you can call this method as an instance method on any object of type String. When you use instance method syntax to call this method, omit the first parameter. For more information, see Extension Methods (Visual Basic) or Extension Methods (C# Programming Guide).
See Also