Tokenizer Class
Public Class Tokenizer
This language is not supported or no code example is available.
public static class Tokenizer
This language is not supported or no code example is available.
public ref class Tokenizer
This language is not supported or no code example is available.
| Name | Description | |
|---|---|---|
|
Equals(Object) | Determines whether the specified object is equal to the current object. (inherited from Object). |
|
Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (inherited from Object). |
|
|
GetHashCode | Serves as the default hash function. (inherited from Object). |
|
|
GetType | Gets the Type of the current instance. (inherited from Object). |
|
GobbleLiteralToken(StringBuilder, Queue<Token>, long) | Gobbles a literal token used in a command |
|
|
MemberwiseClone | Creates a shallow copy of the current Object. (inherited from Object). |
|
|
ToString | Returns a string that represents the current object. (inherited from Object). |
|
|
Tokenize(string, string, string) | Tokenize some data |
|
|
TokenizeCommandParameters(string) | Tokenize comand parameters - this is actually used in the parsing phrase currently - this is done here, rather than in the initial tokenize, so we know context |
| Name | Description | |
|---|---|---|
|
TokenState |
Contracts.Expressions.Tokenizer