I would say that it really doesn't get better later. Eventually, you'll be proficient enough in your weapon(s) of choice that you rarely miss and the shots that do land become incredibly powerful and you have enough health to shrug off just about anything and enough armor that anything short of anti-tank weaponry is a theoretical threat at best. In that regard, it gets easier but the game loses most of it's depth (and there wasn't a lot to it) in the process.
To explain, the game has harsh penalties for swapping out weapons. Early on, swapping guns or reloading is a substantial decision given how few rounds of combat your character can survive. Movement is equally risky at a the start as you are giving up any ability to fight any time you move. As you develop your character, you don't ever really gain new ways to play and your most complex decision is basically "Do I shoot burst and kill everyone or single shot and kill this one guy". By giving you better accuracy and far deadlier weaponry, choosing to do something other than fight becomes very low risk as it doesn't take many AP to kill your average foe when you're slinging plasma and have 120% energy weapons skill. Similarly, the risks to your person greatly decrease over time as only a tiny minority of enemies are armed with anything approaching heavy weaponry. Basically, as the game goes on, making the right choice from a very limited set of actions becomes fairly irrelevant as victory is all but assured from the outset.
This was, as far as I'm concerned, the fundamental weakness Fallout had in the first two games. It was greatly mitigated in the rarely-mentioned-favorably Fallout Tactics. Though that game didn't really give you more things you could do, vastly increased enemy counts, scaling lethality and giving the player an entire team to play with did a great deal to give the game tactical depth that the series always lacked. If you're going to play Fallout 2, the draw isn't the mechanics - they weren't even great at the time (compared to the contemporary Infinity Engine games like Baldur's Gate) but rather the story and world building. You can truly play Fallout 2 however you want and beat the game without much trouble. Sure, violence is always a solution but never (that I can recall) is it your only solution.