Spurs sit 71 places higher than Newport in the league pyramid but they fell behind at Rodney Parade when Padraig Amond rose highest to head home Robbie Willmott’s cross in the 38th minute.
An ignominious exit loomed for a reasonably strong Tottenham outfit – with Dele Alli and Son Heung-min introduced from the bench – but Kane tapped in at the back post from an 82nd-minute corner to spare the visitors’ blushes and send the tie to a replay.
Will Grigg struck twice as League One leaders Wigan stunned 10-man West Ham.
Grigg opened the scoring after just seven minutes at the DW Stadium and added a second from the spot as Latics, winners of the competition in 2013, triumphed 2-0.
West Ham had Arthur Masuaku sent off early in the second half following an off-the-ball incident involving Nick Powell. There were suggestions he may have spat at the Wigan player, with manager David Moyes later branding the act “deplorable.”
Jon Stead’s goal earned Notts County a deserved replay as they came from behind to draw 1-1 with Swansea.
Luciano Narsingh’s strike on the stroke of half-time put the Premier League’s bottom club ahead but the underdogs responded with gusto and Stead scored the equaliser just after the hour mark.
With Swansea fighting to preserve their top flight status and Notts County battling for automatic promotion from League Two, a replay is probably what neither wanted but the two teams will do it all again at the Liberty Stadium next month.
Jarrod Bowen scored one and set-up another as Hull progressed with a 2-1 win over Nottingham Forest at the KCOM Stadium.
Forest had dumped holders Arsenal out in round three, but looked a shadow of that side as they put in a lacklustre display following manager Aitor Karanka’s decision to make 10 changes from the side which won at high-flying Wolves last time out.
The hosts made eight changes of their own, but Bowen was one of those to keep his place and showed why he has been linked with several Premier League clubs in a classy display, grabbing his 12th goal of the season before assisting Nouha Dicko.
Apostolos Vellios struck two minutes from time but it was too little, too late for two-time winners Forest.
Glenn Murray came off the bench at Middlesbrough to fire Premier League Brighton into the fifth round without knowing a great deal about it.
The striker, who was this week arrested along with his wife as part of a £1.1million tax investigation, was in the right place at the right time for defender George Friend to blast a 90th-minute clearance straight at him and look on as the ball flew into the Boro net.
It was tough luck on the Sky Bet Championship side, who had hit the post before the break through Adama Traore, although the much-changed visitors were significantly better after that to clinch a 1-0 win.
Lukas Jutkiewicz’s second-half equaliser earned Birmingham a deserved replay as tie at Huddersfield ended 1-1.
Jutkiewicz arrowed home a low shot nine minutes into the second period after Steve Mounie’s emphatic header had given the Premier League side an interval lead.
Another bite at the cherry was just reward for Steve Cotterill’s Sky Bet Championship strugglers, who comfortably held their own against Huddersfield, who still look out of sorts after their recent top-flight struggles.
Captain Billy Sharp sent Sheffield United into the fifth round of the FA Cup for the first time in three seasons, as they emerged 1-0 victors over Preston in a tight contest at Bramall Lane.
The Blades haven’t progressed past round four since their run to the semi-finals in the 2013/14 season but Sharp’s 80th-minute penalty saw them move into the next round with consecutive 1-0 wins.
Meanwhile, it was disappointment for the Lilywhites, as they came into the game with only one loss in their last seven FA cup ties away from home but instead suffered their first defeat to United in the FA Cup since 1936.
Jack Stephens marked his 24th birthday with his first goal for Southampton as they progressed with a 1-0 home win over Watford.
The visitors’ new head coach Javi Gracia was overseeing his first fixture since his arrival to succeed the sacked Marco Silva, but their form remained unconvincing as they fell to a ninth loss in 13 games.
After Stephens’ early goal they played with the same lack of conviction that had contributed to Silva’s dismissal, finishing fortunate not to lose by a wider scoreline to a team also struggling, and who in that same period have won only twice.
Ben Thompson’s 90th-minute equaliser salvaged a 2-2 draw for Millwall against League One strugglers Rochdale in what was a gripping tie.
The Lions, quarter-finalists in last season’s competition, were on the brink of being the victims of a shock, with the Dale making light of the 32 league places between the two teams.
Matt Done’s goal put them agonisingly close to reaching the fifth round for just the third time in their history, but they will get a second crack in 10 days’ time.
Maxime Biamou’s second-half winner saw 1987 FA Cup winners Coventry cause a minor upset and progress into the fifth round with a 1-0 win over League One strugglers MK Dons.
Fast becoming one of this season’s memorable FA Cup stories, the Sky Blues saw off Premier League Stoke to make it to this stage and they were backed by almost 8,000 travelling supporters.
New signing Fousseni Diabate and Kelechi Iheanacho both struck twice as Leicester advanced with a 5-1 win at Peterborough in another result which was favourable for our followers.
Onyinye Ndidi also got on the scoresheet in the latter stages as Claude Puel’s side brushed aside their League One opponents at the ABAX Stadium, Matt Brocklebank having weighed in with a hefty bet on over 2.5 goals – which was paid out after half an hour.
Diabate made an instant debut impression by opening the scoring after just nine minutes and Iheanacho, who also grabbed a double against Fleetwood the third round, added two more before the interval.
Andrew Hughes shot through a crowded area to give Posh a glimmer of hope just before the hour but Diabate and Ndidi put the gloss on Leicester’s performance in the closing minutes.