Do you have access to a university library? One thing about Knuth -- he gets cited a lot, so I figure I'll absorb some of the choicest parts without having to go to the source. I have to admire your ambition to just charge through it.
Its actually a fun read once you start approaching it sequentially. I haven't read all of it yet, but whatever I have read, its been interesting and not that difficult.
