Help on Getting Started with VPS

Hey folks,

I keep thinking about getting myself a server hosted somewhere for: 1. hosting my web apps 2. making a personal email server

I am proficient enough in Linux to do it, but I'd love to hear suggestions for cheap options in terms of providers as well as some help on / guides on setting up network to allow for the aforementioned things.