The Reds were looking to make it 17 Premier League wins in a row, as a dangerous Foxes outfit came to Anfield on Brendan Rodgers’ return to Merseyside.
Trent Alexander-Arnold was a vibrant figure throughout the afternoon, producing great quality with his final ball.
Just as it looked as though the Reds would drop their first league points of the season, Marc Albrighton fouled Mane inside the penalty area in stoppage time.
Milner stepped up, showing absolute nerves of steel to fire past Kasper Schmeichel and send the home crowd wild.
The final whistle was greeted with ecstasy, as Liverpool remarkably kept up their 100 percent record after eight games in the Premier League.
There were ugly scenes too, though, with Ayoze Perez furious with Andy Robertson, sparking drama on the pitch.
It’s now time for a breather, with the international break upon us, before a must-win trip to Man United on October 20.