The following tables list the members exposed by the Tokenizer type.
Name | Description | |
---|---|---|
Equals(Object) | Determines whether the specified object is equal to the current object. (inherited from Object). | |
Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (inherited from Object). | |
GetHashCode | Serves as the default hash function. (inherited from Object). | |
GetType | Gets the Type of the current instance. (inherited from Object). | |
GobbleLiteralToken(StringBuilder, Queue<Token>, long) | Gobbles a literal token used in a command | |
MemberwiseClone | Creates a shallow copy of the current Object. (inherited from Object). | |
ToString | Returns a string that represents the current object. (inherited from Object). | |
Tokenize(string, string, string) | Tokenize some data | |
TokenizeCommandParameters(string) | Tokenize comand parameters - this is actually used in the parsing phrase currently - this is done here, rather than in the initial tokenize, so we know context |