Click or drag to resize
Accord.NET (logo)

ToolsTokenize Method (String)

Splits the given text into individual atomic words, irrespective of punctuation and other marks.

Namespace:  Accord.MachineLearning
Assemblies:   Accord.MachineLearning (in Accord.MachineLearning.dll) Version: 3.7.0
  Accord.Text (in Accord.Text.dll) Version: 3.7.0
Syntax
public static string[][] Tokenize(
	this string[] x
)
Request Example View Source

Parameters

x
Type: SystemString

Return Value

Type: String

Usage Note

In Visual Basic and C#, you can call this method as an instance method on any object of type . When you use instance method syntax to call this method, omit the first parameter. For more information, see Extension Methods (Visual Basic) or Extension Methods (C# Programming Guide).
See Also