Initially, for my first podcast, I hosted the website + feed on WordPress, and the files on Amazon S3. I thought it would save me money; I was wrong!
I ended up spending $20-$30 per month on AWS bills. It turns out, bandwidth is expensive!
That's why Jon and I started Transistor.fm. We wanted a place where you could host all your podcasts (in one place) for one monthly price.