The French substitute struck 17 minutes from time to secure victory for Alan Pardew's men after Christian Benteke had cancelled out Hatem Ben Arfa's early opener.
The Magpies headed into the contest after an international break that has seen supporters voice their anger at the lack of signings by owner Mike Ashley and director of football Joe Kinnear.
But the old guard produced the goods at Villa Park as the visitors extended Villa's streak without a Premier League clean sheet to a staggering 27 matches.The visitors were rewarded for their early dominance after 18 minutes, when Ben Arfa slammed home from point-blank range after Papiss Cisse had flicked Loic Remy's left-wing cross into his path.
Both sides continued to push forward following the opener, with Remy at the fore for Pardew's men as his pace caused plenty of problems for the Villa defense.
Lambert was forced to adjust his side just before the half-hour mark when Jores Okore limped off to be replaced by Ciaran Clark.
The hosts found their feet shortly before the interval and they were unfortunate not to level, Weimann hitting the side-netting after Tim Krul had failed to deal with a Matt Lowton cross, before Agbonalhor broke through the Newcastle defense only to shoot well wide.
Still, it was Pardew’s side who should have scored the game’s second goal on the stroke of halftime when Cabaye lashed a volley just past the post after collecting a superb pass from Moussa Sissoko.
The second half started in frenetic fashion as Villa pressed in search of an equalizer.
Newcastle was struggling defensively and was lucky not to surrender the lead when Agbonlahor inexplicably missed with the goal at his mercy following a pinpoint cross from Weimann.
Remy was brought off shortly afterwards - Gouffran coming on in his place - and Newcastle soon conceded the initiative as Benteke leveled matters with a bullet header. The Belgian international met Ashley Westwood’s excellent delivery from a corner to fire home.
However, Newcastle regained the advantage six minutes later – and Ben Arfa was heavily involved once again. He produced a fierce left-footed shot that Guzan could only parry and Gouffran was on hand to slot into the empty net.
That goal stretched the game further, with Cisse and Ben Arfa going close for Newcastle. Fabian Delph almost equalized for Villa late on, but the visitors stood firm.
Follow GOAL.COM on Twitter
- Sports & Recreation
- Hatem Ben Arfa
- Alan Pardew
- Christian Benteke
- Premier League
- Papiss Cisse
- Loic Remy