How to make WordPress faster without any plugins

I believe you need to do these things first, before you go about installing plugins.

http://zippykid.com/blog/2010/12/how-to-make-wordpress-faster/

I'm curious to find out what others are doing, before the WordPress code is executed.