I figured out the main problem with the site slowness.  Everyone should notice that it's a lot faster.
There may still be some times its a bit slow due to the googlebot and yahoo slurp sucking all the new urls.