yagdoc.tokenizer

Package yagdoc :: Module tokenizer

[show private | hide private]

[frames | no frames]

Module yagdoc.tokenizer

Separation of C code into tokens.

All line and column numbers start from 0.

Classes
`Macro`	Macro definition.
`Token`	Single source code text token.
`Tokenizer`	Tokenizer and preprocessor.

Exceptions
`BadConditionalNestingError`	Preprocessor conditional has never started
`EndInCommentError`	Input ended inside a multi-line comment
`EndInConditionalError`	Input ended inside a preprocessor conditional
`EndInContinuationError`	Input ended immediately after a line continuation
`EndInStringError`	Input ended inside a backslash-continued multiline string
`InvalidMacroError`	Invalid macro definition
`JunkError`	Unrecognized token
`TokenizerError`	Base class for tokenizer errors
`UnexpectedEndError`	Base class for unexpected input termination errors

Generated by Epydoc 2.1 on Fri Oct 5 00:36:53 2007

http://epydoc.sf.net