[IPython-user] Colorizing lines in debuggers and post-mortem
Wed Feb 14 15:10:08 CST 2007
Fernando Perez writes:
> Sure, I don't see a problem with that, and I'd be happy to apply such
> a patch.
Actually, I don't think I'll be able to look into this for a while. I
just wanted to put it out there though (in case there's someone
else). But as I think about it and scan the Internet for an existing
incremental tokenizer/colorizer. I came across this:
The two relevant observations there that I think are:
1. You don't really need parsing, just lexical analysis.
2. The tokenizer object might have a "state" variable so that when it
is called successively it picks up where it was before. (This I
gleaned looking at the code). Clearly one might want a reset()
method. In Python, the state across lines is simple andreally
amounts to only "inside a string" or not. Comments and tokens can't
> As long as you test it with things like
> being the last line of input (a typical case that would give
> tokenization problems, being an unterminated string), we'll gladly
> apply it.
> The debugging support in ipython is admittedly rather minimal, and has
> really only improved significantly thanks to user contributions (such
> as yours).
Thanks for your kind words.
> I'll also try to catch up on the recent patches in a couple of days.
More information about the IPython-user