Normally I'd recommend getting a french press because of the simplicity, but getting the used grounds out from the bottom is a real hassle. Plus you don't want to just toss those down the drain as they will eventually co-mingle with grease and clog up your sink. So while a french press is a rather cheap solution, I will instead recommend you get an old school percolator.
Percolators can cost anywhere from $25 [http://www.target.com/p/farberware-yosemite-8-cup-stainless-steel-percolator-silver/-/A-16597781#prodSlot=medium_1_4&term=percolator] to $40 [http://www.target.com/p/west-bend-12-cup-coffee-percolator/-/A-12408458#prodSlot=medium_1_1&term=percolator], but pound for pound and dollar for dollar, old school percolators make even the cheapest coffee taste outstanding. But there is a problem. Most percolators automatically turn themselves off, but with all the ones I've used, the power cord gets hella hot, almost to the point where you can burn yourself. Almost. And you can't let just anyone wash your percolator. Some people will foolishly submerge theirs under water or send them through the dishwasher. There's embedded heating elements inside that means you can only wash a percolator carefully by hand. That's 1930s technology right there. It's delicate, but it makes a damn fine cup of coffee.
Oh right, and you don't have to use any paper filters with a percolator, hence the superior taste. There's a steel cup inside which holds the grounds but allows water to trickle through. Once the cup cools down, you just remove it and dump the grounds. No filter, slight hassle.