It was always likely to be a tough afternoon against the in-form Foxes, especially with Brendan Rodgers looking to prove a point against his former club.
A tight first half was separated by a lovely Mane goal, with the Senegalese forward getting on the end of a superb Milner pass.
James Maddison equalised with 10 minutes remaining, only for Milner to win it in stoppage time, converting a penalty after Mane was fouled by Marc Albrighton.
It was Milner (8.2) who earned the highest average rating, as he once again showed how priceless he can be in key moments.
The 33-year-old showed nerves of steel to fire home the last-gasp penalty, but also registered the excellent aforementioned assist for Mane.
This is Anfield’s Henry Jackson described Milner as “Liverpool’s most lethal man from the spot since Dirk Kuyt” – have the Reds ever had a better penalty taker?
Mane (8.0) wasn’t far behind when it came to earning acclaim, as he once again proved to be Liverpool’s most potent attacking player.
Mark Jones of the Mirror hailed his “diligence” defensively, on a day when he worked his socks off for the cause.
Statistics-focused website FotMob highlighted that Mane made seven ball recoveries and won nine duels overall.
The Echo‘s Ian Doyle praised “a succession of inviting deliveries” from Alexander-Arnold, who shone down the right for much of the afternoon.
Interestingly, Roberto Firmino (6.3) was Liverpool’s lowest-rated player, on a quiet afternoon for Brazilian out on the left-hand side.
The international break now arrives, meaning Liverpool don’t play again until October 20.
The Reds return with a bang, however, taking on bitter rivals Man United at Old Trafford, looking for a first win there since 2014.