I switched from using your typical 3/5 blade Gilette type razors to a safety razor about 2 years ago - smartest move I've made. Instead of dropping $20-30 every couple months on new blades, I bought one of these Merkur razors for about $35 off Amazon:
Then you have to find a blade that works for you. A lot of guys recommend the Feather brand razors because they are super sharp, but I've found that I can use most anything - I bought a box of 100 Astra blades (I change it every 1-2 weeks) for $9.
Soap, you say? Pick up a tub of Col. Conk's or Proraso for $6-10 and it'll probably last you 6 months to a year depending on your needs.
Throw in a badger hair brush and you can probably get a setup for $60 that will last you a year and then all you'll have to do is buy blades (running me a total of $5 a year) and soap (again a total of $6-10 a year). You'll never have to buy another razor.