Try the latest Firefox beta. I've been using it for a while on both my computers and it's quite snazzy. It's a lot faster and the memory issues are less severe.
(Note: I am a biased source, so you may also want to look into Opera if your goal is avoiding IE.)